-- Logs begin at Thu 2022-10-27 08:57:43 UTC, end at Thu 2022-10-27 10:11:55 UTC. -- Oct 27 09:32:18.638448 dv-cinder-797970-7-smb systemd[1]: Starting Devstack devstack@keystone.service... Oct 27 09:32:18.645880 dv-cinder-797970-7-smb devstack@keystone.service[88298]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Oct 27 09:32:18.647978 dv-cinder-797970-7-smb devstack@keystone.service[88298]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Oct 27 09:32:18 2022] *** Oct 27 09:32:18.647978 dv-cinder-797970-7-smb devstack@keystone.service[88298]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 27 09:32:18.647978 dv-cinder-797970-7-smb devstack@keystone.service[88298]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 27 09:32:18.647978 dv-cinder-797970-7-smb devstack@keystone.service[88298]: nodename: dv-cinder-797970-7-smb Oct 27 09:32:18.647978 dv-cinder-797970-7-smb devstack@keystone.service[88298]: machine: x86_64 Oct 27 09:32:18.647978 dv-cinder-797970-7-smb devstack@keystone.service[88298]: clock source: unix Oct 27 09:32:18.647978 dv-cinder-797970-7-smb devstack@keystone.service[88298]: pcre jit disabled Oct 27 09:32:18.647978 dv-cinder-797970-7-smb devstack@keystone.service[88298]: detected number of CPU cores: 4 Oct 27 09:32:18.647978 dv-cinder-797970-7-smb devstack@keystone.service[88298]: current working directory: / Oct 27 09:32:18.648560 dv-cinder-797970-7-smb devstack@keystone.service[88298]: detected binary path: /usr/bin/uwsgi-core Oct 27 09:32:18.648560 dv-cinder-797970-7-smb devstack@keystone.service[88298]: your processes number limit is 47680 Oct 27 09:32:18.648560 dv-cinder-797970-7-smb devstack@keystone.service[88298]: your memory page size is 4096 bytes Oct 27 09:32:18.648560 dv-cinder-797970-7-smb devstack@keystone.service[88298]: detected max file descriptor number: 2048 Oct 27 09:32:18.648560 dv-cinder-797970-7-smb devstack@keystone.service[88298]: lock engine: pthread robust mutexes Oct 27 09:32:18.648560 dv-cinder-797970-7-smb devstack@keystone.service[88298]: thunder lock: enabled Oct 27 09:32:18.648560 dv-cinder-797970-7-smb devstack@keystone.service[88298]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Oct 27 09:32:18.648560 dv-cinder-797970-7-smb devstack@keystone.service[88298]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Oct 27 09:32:18.691581 dv-cinder-797970-7-smb devstack@keystone.service[88298]: Python main interpreter initialized at 0x55bd8ed279c0 Oct 27 09:32:18.691581 dv-cinder-797970-7-smb devstack@keystone.service[88298]: python threads support enabled Oct 27 09:32:18.691581 dv-cinder-797970-7-smb devstack@keystone.service[88298]: your server socket listen backlog is limited to 100 connections Oct 27 09:32:18.691581 dv-cinder-797970-7-smb devstack@keystone.service[88298]: your mercy for graceful operations on workers is 90 seconds Oct 27 09:32:18.691969 dv-cinder-797970-7-smb devstack@keystone.service[88298]: mapped 403077 bytes (393 KB) for 2 cores Oct 27 09:32:18.692046 dv-cinder-797970-7-smb devstack@keystone.service[88298]: *** Operational MODE: preforking *** Oct 27 09:32:18.692309 dv-cinder-797970-7-smb devstack@keystone.service[88298]: *** uWSGI is running in multiple interpreter mode *** Oct 27 09:32:18.692309 dv-cinder-797970-7-smb devstack@keystone.service[88298]: spawned uWSGI master process (pid: 88298) Oct 27 09:32:18.692522 dv-cinder-797970-7-smb systemd[1]: Started Devstack devstack@keystone.service. Oct 27 09:32:18.693617 dv-cinder-797970-7-smb devstack@keystone.service[88298]: spawned uWSGI worker 1 (pid: 88311, cores: 1) Oct 27 09:32:18.693617 dv-cinder-797970-7-smb devstack@keystone.service[88298]: spawned uWSGI worker 2 (pid: 88312, cores: 1) Oct 27 09:32:18.693617 dv-cinder-797970-7-smb devstack@keystone.service[88298]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 27 09:32:23.023375 dv-cinder-797970-7-smb devstack@keystone.service[88312]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 27 09:32:23.023375 dv-cinder-797970-7-smb devstack@keystone.service[88312]: from cryptography.utils import int_from_bytes Oct 27 09:32:23.024171 dv-cinder-797970-7-smb devstack@keystone.service[88312]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 27 09:32:23.024171 dv-cinder-797970-7-smb devstack@keystone.service[88312]: from cryptography.utils import int_from_bytes Oct 27 09:32:23.028618 dv-cinder-797970-7-smb devstack@keystone.service[88311]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 27 09:32:23.028618 dv-cinder-797970-7-smb devstack@keystone.service[88311]: from cryptography.utils import int_from_bytes Oct 27 09:32:23.029089 dv-cinder-797970-7-smb devstack@keystone.service[88311]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 27 09:32:23.029089 dv-cinder-797970-7-smb devstack@keystone.service[88311]: from cryptography.utils import int_from_bytes Oct 27 09:32:23.073541 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 27 09:32:23.075509 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 27 09:32:23.075509 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG uwsgi [-] command line args: [] {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 27 09:32:23.075509 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 27 09:32:23.075509 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG uwsgi [-] ================================================================================ {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 27 09:32:23.075509 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG uwsgi [-] admin_token = **** {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:32:23.075509 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG uwsgi [-] config_dir = [] {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:32:23.075509 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:32:23.075509 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG uwsgi [-] config_source = [] {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:32:23.075509 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG uwsgi [-] debug = True {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:32:23.075998 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:32:23.075998 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:32:23.075998 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG uwsgi [-] insecure_debug = False {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:32:23.076390 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:32:23.076460 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:32:23.076686 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG uwsgi [-] list_limit = None {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:32:23.077026 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG uwsgi [-] log_config_append = None {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:32:23.077026 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:32:23.077245 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG uwsgi [-] log_dir = None {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:32:23.077395 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG uwsgi [-] log_file = None {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:32:23.077607 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:32:23.077718 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 27 09:32:23.077850 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:32:23.077937 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 27 09:32:23.078091 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:32:23.078213 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG uwsgi [-] command line args: [] {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 27 09:32:23.078336 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:32:23.078439 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 27 09:32:23.078546 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:32:23.078636 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG uwsgi [-] ================================================================================ {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 27 09:32:23.078716 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:32:23.078849 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG uwsgi [-] admin_token = **** {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:32:23.078932 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:32:23.079033 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG uwsgi [-] config_dir = [] {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:32:23.079121 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:32:23.079247 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:32:23.079323 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:32:23.079448 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG uwsgi [-] config_source = [] {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:32:23.080078 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:32:23.080283 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG uwsgi [-] debug = True {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:32:23.080381 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:32:23.080530 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:32:23.080665 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:32:23.080793 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:32:23.081002 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:32:23.081088 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG uwsgi [-] notification_format = cadf {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:32:23.081207 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG uwsgi [-] insecure_debug = False {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:32:23.081282 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:32:23.081449 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:32:23.081706 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:32:23.081790 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.65/identity {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:32:23.081914 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG uwsgi [-] publish_errors = False {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:32:23.082001 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG uwsgi [-] list_limit = None {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:32:23.082113 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG uwsgi [-] log_config_append = None {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:32:23.082191 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:32:23.082295 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:32:23.082380 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:32:23.082464 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG uwsgi [-] log_dir = None {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:32:23.082568 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:32:23.082681 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG uwsgi [-] log_file = None {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:32:23.082760 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:32:23.082923 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:32:23.083009 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:32:23.083215 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:32:23.083306 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG uwsgi [-] standard_threads = False {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:32:23.083436 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG uwsgi [-] strict_password_check = False {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:32:23.083512 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:32:23.083630 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:32:23.083710 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:32:23.083797 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG uwsgi [-] use_eventlog = False {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:32:23.083870 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:32:23.083969 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG uwsgi [-] use_journal = False {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:32:23.084055 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:32:23.084134 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG uwsgi [-] use_json = False {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:32:23.084231 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:32:23.084376 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG uwsgi [-] use_stderr = False {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:32:23.084458 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG uwsgi [-] use_syslog = False {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:32:23.084535 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:32:23.084676 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG uwsgi [-] watch_log_file = False {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:32:23.084755 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:32:23.084965 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.085068 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:32:23.085203 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:32:23.085281 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.085441 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:32:23.085532 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.085687 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.085770 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:32:23.085932 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG uwsgi [-] notification_format = cadf {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:32:23.086017 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.086170 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.086259 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:32:23.086418 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.086684 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.086766 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.65/identity {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:32:23.086877 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG uwsgi [-] publish_errors = False {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:32:23.086964 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.087149 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:32:23.087294 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.087374 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:32:23.087549 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:32:23.087698 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.087773 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.087900 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:32:23.088019 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:32:23.088109 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.088249 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.088338 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG uwsgi [-] standard_threads = False {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:32:23.088477 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG uwsgi [-] strict_password_check = False {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:32:23.088561 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.088723 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:32:23.088809 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.088887 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG uwsgi [-] use_eventlog = False {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:32:23.088970 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.089066 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG uwsgi [-] use_journal = False {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:32:23.089198 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.089278 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG uwsgi [-] use_json = False {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:32:23.089409 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG uwsgi [-] use_stderr = False {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:32:23.089492 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.089579 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG uwsgi [-] use_syslog = False {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:32:23.089684 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.089807 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG uwsgi [-] watch_log_file = False {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:32:23.089920 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.090067 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.090174 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.090655 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.090753 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.090839 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.090919 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.090998 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.091077 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.091159 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.091284 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.091368 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.091448 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.091574 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.091661 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.091815 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.091895 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.092068 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.092147 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.092320 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.092409 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.092550 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.092629 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.092784 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.092867 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.093033 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.093188 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.093265 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.093390 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.093505 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.093584 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.093752 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.093879 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.093969 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.094041 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.094205 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.094284 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.094443 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.094568 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.094700 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.094860 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.094939 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.095171 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.095819 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.096163 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.096244 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.096409 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.096630 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.096709 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.096885 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.096975 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.097126 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.097212 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.097361 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.097440 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.097597 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.097683 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.097834 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.097920 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.098077 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.098168 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.098305 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.098392 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.098600 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.098739 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.098844 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.098952 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.099058 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.099166 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.099266 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.099363 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.099474 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.099576 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.099706 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.099814 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.099957 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.100072 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.100194 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.100304 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.100433 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.100514 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.100667 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.100791 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.100923 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.101043 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.101157 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.101235 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.101390 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.101469 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.101624 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.101739 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.101861 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.101941 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.102127 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.102219 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.102360 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.102441 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.102626 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.102711 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.102849 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.102975 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.103093 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.103170 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.103314 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.103427 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.103550 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.103631 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.103784 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.103865 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG uwsgi [-] cache.enabled = True {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.104018 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.104098 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.104254 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.104344 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.104491 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.104611 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.104723 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.104806 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.104959 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.105042 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.105192 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.105270 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.105427 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.105506 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.105663 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.105751 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.105899 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.105979 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.106130 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.106284 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.106372 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.106445 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.106632 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.106728 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.106868 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.106957 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.107105 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.107185 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.107342 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.107422 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.107580 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.107709 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.107823 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.107912 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.108058 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.108139 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.108293 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.108372 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.108524 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.108612 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.108755 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.108834 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.108985 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.109066 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.109219 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.109307 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG uwsgi [-] cache.enabled = True {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.109449 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.109529 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.109688 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.109766 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.109919 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.110007 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.110165 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.110244 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.110398 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.110480 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.110671 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.110765 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.110945 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.111070 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.111358 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.111454 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.111630 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG uwsgi [-] auth.external = None {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.111815 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.111969 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG uwsgi [-] auth.mapped = None {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.112059 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.112268 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.112358 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.112505 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.112602 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.112740 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG uwsgi [-] auth.password = None {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.112833 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.112973 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG uwsgi [-] auth.token = None {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.113052 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.113215 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.113304 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.113467 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG uwsgi [-] catalog.caching = True {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.113611 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.113689 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.113761 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.113916 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.114010 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.114161 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.114243 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.114407 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.114498 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.114662 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.114746 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.114899 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG uwsgi [-] credential.caching = True {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.114993 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.115138 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.115219 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG uwsgi [-] credential.driver = sql {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.115376 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.115457 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.115618 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.115706 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.115855 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.115935 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.116099 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.116180 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.116334 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.116424 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.116580 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.116663 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.116832 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.116914 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.117068 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.117157 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.117347 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG uwsgi [-] auth.external = None {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.117426 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.117594 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG uwsgi [-] auth.mapped = None {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.117696 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.117867 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.117959 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.118125 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.118205 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.118361 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.118441 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG uwsgi [-] auth.password = None {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.118626 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG uwsgi [-] auth.token = None {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.118721 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.118862 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG uwsgi [-] federation.caching = True {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.118948 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.119101 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.119190 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG uwsgi [-] catalog.caching = True {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.119348 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG uwsgi [-] federation.driver = sql {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.119448 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.119580 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.119668 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.119808 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.119895 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.120055 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.120224 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.120301 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.120633 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.120784 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG uwsgi [-] credential.caching = True {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.120873 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.121015 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.121112 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG uwsgi [-] credential.driver = sql {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.121268 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.121415 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.121492 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.121564 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.121807 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.121899 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.122056 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.122145 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG uwsgi [-] identity.caching = True {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.122297 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.122386 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.122567 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.122659 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.122804 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.122894 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.123041 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.123140 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.123288 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG uwsgi [-] identity.driver = sql {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.123378 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.123520 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.123609 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.123757 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.123846 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.124004 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.124102 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.124252 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.124351 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.124515 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.124732 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.124812 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.124875 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG uwsgi [-] federation.caching = True {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.124996 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.125074 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.125240 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.125329 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG uwsgi [-] federation.driver = sql {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.125484 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.125566 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.125731 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.125812 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.125987 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.126067 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.126223 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.126304 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.126511 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.126627 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.126778 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.126979 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.127073 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.127234 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.127343 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.127475 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.127595 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.127705 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.127855 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.127940 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.128106 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG uwsgi [-] identity.caching = True {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.128201 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.128360 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.128441 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.128616 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.128702 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.128845 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.128926 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.129088 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.129168 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.129331 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.129411 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG uwsgi [-] identity.driver = sql {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.129565 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.129644 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.129794 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.129872 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.130035 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.130116 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.130264 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.130345 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.130504 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.130606 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.130755 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG uwsgi [-] ldap.password = **** {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.130838 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.131032 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.131124 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.131222 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.131303 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.131502 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.131583 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.131757 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.131837 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.132019 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.132100 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.132269 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.132349 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.132517 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.132599 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.132749 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.132843 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.132981 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.133061 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.133223 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.133302 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.133465 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.133553 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.133700 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.133780 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.133930 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.134009 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.134166 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.134256 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.134398 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG uwsgi [-] ldap.user = None {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.134478 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.134660 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.134744 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.134896 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.134988 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.135140 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.135220 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.135387 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.135466 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.135628 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.135718 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.135870 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.135951 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.136106 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.136192 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.136336 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.136426 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.136577 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.136647 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.136814 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG uwsgi [-] ldap.password = **** {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.136894 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.137047 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.137135 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.137280 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.137361 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.137521 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.137600 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.137764 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.137853 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.138005 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.138085 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.138251 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.138331 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.138495 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.138607 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.138751 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.138832 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.138984 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.139065 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.139218 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.139306 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.139455 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.139536 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.139690 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.139771 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.139927 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.140014 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.140166 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.140295 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.140413 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.140535 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG uwsgi [-] ldap.user = None {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.140650 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.140812 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.140902 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG uwsgi [-] policy.driver = sql {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.141108 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.141219 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.141323 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.141404 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.141570 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.141651 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.141802 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG uwsgi [-] receipt.caching = True {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.141883 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.142579 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.142674 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.144332 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.144465 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.144544 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.144544 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.144676 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.144748 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.144829 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.144903 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG uwsgi [-] resource.caching = True {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.144974 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.145046 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.145117 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.145188 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG uwsgi [-] resource.driver = sql {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.145338 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.145414 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.145486 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.145558 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.145630 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.145703 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.145784 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.145858 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG uwsgi [-] revoke.caching = True {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.145930 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.146002 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.146074 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.146146 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.146226 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.146300 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG uwsgi [-] role.cache_time = None {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.146371 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.146443 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG uwsgi [-] role.caching = True {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.146540 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.146617 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG uwsgi [-] role.driver = sql {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.146703 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.146778 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG uwsgi [-] role.list_limit = None {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.146851 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.146923 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.147071 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.147154 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.147314 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.147395 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.147560 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.147641 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.147847 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.147950 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.148112 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.148200 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG uwsgi [-] policy.driver = sql {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.148332 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.148412 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.148577 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.148667 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.148810 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.148893 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.149144 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG uwsgi [-] receipt.caching = True {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.149239 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.149421 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.149509 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.149585 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.149658 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.149731 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.149804 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.150016 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.150219 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.150366 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.150498 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.150664 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG uwsgi [-] resource.caching = True {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.150793 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.150924 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.151065 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.151194 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG uwsgi [-] resource.driver = sql {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.151321 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.151448 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.151575 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.151702 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.151838 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.151964 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.152109 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.152237 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG uwsgi [-] revoke.caching = True {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.152365 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.152492 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.152627 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.152758 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.152887 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.153014 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG uwsgi [-] role.cache_time = None {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.153145 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.153229 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG uwsgi [-] role.caching = True {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.153368 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.153497 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG uwsgi [-] role.driver = sql {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.153627 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.153769 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG uwsgi [-] role.list_limit = None {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.153897 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.154022 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.154161 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.154289 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.154419 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.154559 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.154685 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.154685 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG uwsgi [-] token.cache_time = None {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.154940 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.155069 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG uwsgi [-] token.caching = True {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.155199 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.155330 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.155458 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.155605 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG uwsgi [-] token.provider = fernet {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.155690 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.155799 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.155925 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.156009 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.156175 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.156309 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.156435 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.156561 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.156691 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.156820 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.156949 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.157087 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.157228 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.157359 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG uwsgi [-] trust.driver = sql {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.157359 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.157557 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.157621 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.157734 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.158299 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.158370 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.158430 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.158489 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.158585 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.158793 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.158924 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.158924 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.159195 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.159324 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.159458 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.159539 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.159620 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG uwsgi [-] database.connection = **** {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.159778 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.159860 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.160030 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.160111 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.160274 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.160413 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.160544 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.160670 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.160807 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.160936 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.161064 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.161204 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.161332 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.161461 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.161589 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.161715 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.161843 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.161979 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.162105 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.162234 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.162361 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.162489 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG uwsgi [-] token.cache_time = None {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.162644 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.162737 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG uwsgi [-] token.caching = True {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.162861 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.162939 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.163012 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.163084 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG uwsgi [-] token.provider = fernet {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.163156 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.163238 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.163312 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.163385 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.163457 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.163578 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.163661 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.163779 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 27 09:32:23.163861 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.164059 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.164310 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.164573 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG uwsgi [-] trust.driver = sql {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.164817 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.165099 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.165337 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.165590 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.165871 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.166107 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.166356 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.166660 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.166927 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG uwsgi [-] database.connection = **** {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.167178 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.167432 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.167676 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.167920 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.168159 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.168400 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.168639 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.168880 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.169130 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.169367 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.169615 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.169855 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.170107 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.170347 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.170635 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.170874 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.171119 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.171359 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:32:23.171533 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 27 09:32:23.193152 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=88312) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 09:32:23.193406 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=88312) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 09:32:23.193623 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=88312) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 09:32:23.197385 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=88311) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 09:32:23.197630 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=88311) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 09:32:23.197863 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=88311) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 09:32:23.201966 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=88312) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 09:32:23.215084 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=88311) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 09:32:23.243790 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=88312) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 09:32:23.244018 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=88312) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 09:32:23.244320 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=88311) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 09:32:23.244554 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=88311) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 09:32:23.297553 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=88312) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 09:32:23.298167 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=88311) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 09:32:23.355291 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=88312) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 09:32:23.355456 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=88312) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 09:32:23.356407 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=88311) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 09:32:23.356643 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=88311) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 09:32:23.516923 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=88312) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 09:32:23.517296 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=88312) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 09:32:23.517950 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=88312) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 09:32:23.518041 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=88311) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 09:32:23.518181 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=88312) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 09:32:23.518275 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=88311) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 09:32:23.518412 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=88312) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 09:32:23.518551 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=88311) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 09:32:23.518686 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=88312) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 09:32:23.518766 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=88311) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 09:32:23.518898 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=88311) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 09:32:23.519086 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=88311) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 09:32:23.546092 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=88312) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 09:32:23.546250 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=88311) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 09:32:23.546337 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=88312) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 09:32:23.546459 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=88311) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 09:32:23.546566 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=88312) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 09:32:23.546752 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=88311) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 09:32:23.546852 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=88312) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 09:32:23.546930 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=88311) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 09:32:23.547005 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=88312) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 09:32:23.547144 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=88311) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 09:32:23.547229 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=88312) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 09:32:23.547355 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=88312) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 09:32:23.547442 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=88311) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 09:32:23.547566 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=88311) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 09:32:23.558688 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=88312) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 09:32:23.558961 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=88311) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 09:32:23.575032 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=88311) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 09:32:23.575238 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=88312) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 09:32:23.575391 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=88311) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 09:32:23.575529 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=88312) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 09:32:23.575660 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=88311) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 09:32:23.575804 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=88312) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 09:32:23.575932 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=88311) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 09:32:23.576067 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=88312) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 09:32:23.576197 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=88311) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 09:32:23.576329 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=88312) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 09:32:23.576417 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=88311) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 09:32:23.576492 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=88312) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 09:32:23.576564 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=88311) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 09:32:23.576635 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=88312) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 09:32:23.594010 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=88311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 09:32:23.594218 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=88311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 27 09:32:23.594327 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=88312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 09:32:23.594489 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=88312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 27 09:32:23.594593 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=88311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 09:32:23.594774 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=88311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 27 09:32:23.594857 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=88312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 09:32:23.595054 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=88311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 09:32:23.595161 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=88312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 27 09:32:23.595357 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=88311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 09:32:23.595595 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=88312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 09:32:23.595678 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=88311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 09:32:23.595900 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=88311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 09:32:23.596153 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=88312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 09:32:23.596763 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=88312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 09:32:23.597020 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=88312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 09:32:23.608498 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=88311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 09:32:23.608498 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=88311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 09:32:23.608498 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=88311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 09:32:23.608498 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=88311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 09:32:23.614216 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=88312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 09:32:23.614475 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=88311) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 27 09:32:23.614589 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=88312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 09:32:23.614803 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=88312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 09:32:23.615096 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=88312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 09:32:23.617391 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=88311) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 27 09:32:23.617677 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=88311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 09:32:23.617965 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=88311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 09:32:23.618251 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=88311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 09:32:23.618563 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=88311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 09:32:23.618837 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=88311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 09:32:23.619113 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=88311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 09:32:23.619392 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=88311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 09:32:23.619708 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=88311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 09:32:23.619994 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=88311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 09:32:23.620268 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=88311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 09:32:23.622454 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=88312) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 27 09:32:23.625375 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=88312) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 27 09:32:23.625868 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=88312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 09:32:23.625998 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=88312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 09:32:23.626286 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=88312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 09:32:23.627115 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=88312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 09:32:23.627385 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=88312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 09:32:23.627659 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=88312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 09:32:23.627938 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=88312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 09:32:23.628326 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=88312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 09:32:23.628609 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=88312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 09:32:23.628885 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=88312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 09:32:23.644324 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=88311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 09:32:23.645891 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=88311) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 27 09:32:23.650255 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=88311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 09:32:23.650905 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=88311) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 27 09:32:23.651191 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=88311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 09:32:23.651478 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=88311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 09:32:23.652063 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=88312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 09:32:23.653512 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=88312) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 27 09:32:23.653802 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=88312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 09:32:23.657925 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=88311) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 27 09:32:23.658372 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=88311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 09:32:23.660395 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=88312) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 27 09:32:23.660687 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=88312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 09:32:23.660976 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=88312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 09:32:23.664189 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=88311) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 27 09:32:23.664486 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=88311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 09:32:23.664774 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=88311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 09:32:23.665062 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=88311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 09:32:23.665345 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=88311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 09:32:23.665624 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=88311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 09:32:23.665901 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=88311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 09:32:23.666176 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=88311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 09:32:23.667540 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=88312) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 27 09:32:23.667832 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=88312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 09:32:23.671982 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=88312) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 27 09:32:23.672316 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=88312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 09:32:23.672580 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=88312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 09:32:23.672866 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=88312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 09:32:23.673146 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=88312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 09:32:23.677362 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=88312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 09:32:23.677362 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=88312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 09:32:23.677362 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=88312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 09:32:23.682336 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=88311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 09:32:23.682644 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=88311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 09:32:23.686474 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=88311) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 27 09:32:23.689868 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=88311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 09:32:23.690166 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=88311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 09:32:23.690433 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=88312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 09:32:23.691238 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=88312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 09:32:23.694843 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=88311) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 27 09:32:23.695141 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=88312) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 27 09:32:23.698041 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=88311) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 27 09:32:23.698430 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=88312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 09:32:23.698760 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=88312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 09:32:23.701417 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=88311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 09:32:23.701723 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=88311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 09:32:23.702013 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=88311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 09:32:23.702318 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=88311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 09:32:23.702628 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=88311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 09:32:23.702925 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=88311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 09:32:23.703045 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=88312) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 27 09:32:23.706774 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=88312) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 27 09:32:23.710080 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=88312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 09:32:23.710386 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=88312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 09:32:23.710711 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=88312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 09:32:23.711015 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=88312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 09:32:23.711311 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=88312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 09:32:23.711596 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=88312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 09:32:23.718805 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=88311) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 27 09:32:23.719135 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=88311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 09:32:23.719407 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=88311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 09:32:23.719678 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=88311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 09:32:23.726917 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=88311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 09:32:23.727937 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=88312) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 27 09:32:23.728233 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=88312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 09:32:23.728456 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=88311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 09:32:23.728608 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=88312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 09:32:23.728765 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=88312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 09:32:23.729995 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=88311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 09:32:23.730281 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=88311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 09:32:23.733066 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=88311) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 27 09:32:23.733351 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=88311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 09:32:23.733636 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=88311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 09:32:23.733921 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=88311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 09:32:23.734319 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=88311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 09:32:23.736306 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=88312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 09:32:23.738050 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=88312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 09:32:23.739632 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=88312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 09:32:23.740006 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=88312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 09:32:23.742732 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=88312) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 27 09:32:23.743023 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=88312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 09:32:23.743419 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=88312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 09:32:23.743767 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=88312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 09:32:23.744064 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=88312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 09:32:23.746437 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=88311) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 27 09:32:23.746759 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=88311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 09:32:23.752142 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=88311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 09:32:23.752142 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=88311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 09:32:23.752142 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=88311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 09:32:23.752142 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=88311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 09:32:23.752142 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=88311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 09:32:23.756667 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=88312) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 27 09:32:23.756959 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=88312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 09:32:23.757356 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=88312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 09:32:23.757645 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=88312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 09:32:23.757946 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=88312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 09:32:23.758244 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=88312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 09:32:23.758544 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=88312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 09:32:23.764540 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=88311) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 27 09:32:23.767544 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=88311) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 27 09:32:23.770467 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=88311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 09:32:23.771942 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=88311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 09:32:23.773415 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=88311) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 27 09:32:23.773709 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=88311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 09:32:23.774109 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=88311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 09:32:23.774574 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=88312) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 27 09:32:23.777315 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=88312) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 27 09:32:23.780336 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=88312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 09:32:23.780574 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=88311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 09:32:23.786184 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=88312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 09:32:23.786344 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=88311) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 27 09:32:23.786474 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=88312) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 27 09:32:23.786474 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=88312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 09:32:23.786474 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=88312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 09:32:23.786697 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=88311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 09:32:23.786697 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=88311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 09:32:23.786697 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=88311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 09:32:23.786697 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=88311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 09:32:23.790474 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=88312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 09:32:23.791989 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=88312) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 27 09:32:23.793845 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=88311) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 27 09:32:23.794141 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=88311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 09:32:23.794427 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=88311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 09:32:23.795033 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=88312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 09:32:23.795329 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=88312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 09:32:23.795617 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=88312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 09:32:23.795899 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=88312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 09:32:23.802012 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=88311) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 27 09:32:23.802306 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=88311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 09:32:23.802618 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=88311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 09:32:23.802903 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=88311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 09:32:23.803176 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=88311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 09:32:23.803450 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=88311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 09:32:23.803729 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=88311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 09:32:23.804007 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=88311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 09:32:23.804281 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=88312) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 27 09:32:23.804377 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=88311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 09:32:23.804548 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=88311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 09:32:23.804640 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=88312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 09:32:23.804883 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=88311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 09:32:23.805017 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=88312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 09:32:23.805104 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=88311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 09:32:23.805386 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=88311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 09:32:23.805767 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=88311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 09:32:23.812839 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=88312) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 27 09:32:23.813128 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=88312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 09:32:23.813416 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=88312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 09:32:23.813701 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=88312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 09:32:23.815051 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=88312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 09:32:23.815051 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=88312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 09:32:23.815278 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=88312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 09:32:23.815577 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=88312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 09:32:23.815853 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=88312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 09:32:23.816130 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=88312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 09:32:23.816465 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=88312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 09:32:23.816748 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=88312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 09:32:23.817020 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=88312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 09:32:23.817291 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=88312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 09:32:23.840896 dv-cinder-797970-7-smb devstack@keystone.service[88311]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55bd8ed279c0 pid: 88311 (default app) Oct 27 09:32:23.844474 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c095dd8-da25-4f05-9136-8048dc5a56a8 None None] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:32:23.845438 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c095dd8-da25-4f05-9136-8048dc5a56a8 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:32:23.845438 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c095dd8-da25-4f05-9136-8048dc5a56a8 None None] PATH_INFO: `/v3` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:32:23.849290 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1/1] 10.222.0.65 () {50 vars in 791 bytes} [Thu Oct 27 09:32:23 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 09:32:23.850706 dv-cinder-797970-7-smb devstack@keystone.service[88312]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55bd8ed279c0 pid: 88312 (default app) Oct 27 09:32:31.885710 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177d829f-ee82-43ce-836d-7f6b91af1960 None None] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:32:31.886261 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177d829f-ee82-43ce-836d-7f6b91af1960 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:32:31.886261 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177d829f-ee82-43ce-836d-7f6b91af1960 None None] PATH_INFO: `/` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:32:31.887598 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2/2] 10.222.0.65 () {54 vars in 927 bytes} [Thu Oct 27 09:32:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 27 09:32:31.895773 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346fdcb2-9a2e-4add-a3ec-a6530c2253c8 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:32:31.896298 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346fdcb2-9a2e-4add-a3ec-a6530c2253c8 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:32:31.896298 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346fdcb2-9a2e-4add-a3ec-a6530c2253c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:32:31.967434 dv-cinder-797970-7-smb devstack@keystone.service[88312]: INFO dbcounter [None req-346fdcb2-9a2e-4add-a3ec-a6530c2253c8 None None] Registered counter for database keystone Oct 27 09:32:31.989213 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG oslo_db.sqlalchemy.engines [None req-346fdcb2-9a2e-4add-a3ec-a6530c2253c8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=88312) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 27 09:32:31.995791 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writer thread running {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 27 09:32:32.177424 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG passlib.handlers.bcrypt [None req-346fdcb2-9a2e-4add-a3ec-a6530c2253c8 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=88312) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Oct 27 09:32:32.177816 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG passlib.handlers.bcrypt [None req-346fdcb2-9a2e-4add-a3ec-a6530c2253c8 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=88312) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Oct 27 09:32:32.236168 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-346fdcb2-9a2e-4add-a3ec-a6530c2253c8 None None] MFA Rules not processed for user `b5065084bf664b99bdeac46067cb0f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:32:32.238317 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-346fdcb2-9a2e-4add-a3ec-a6530c2253c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:32:32.377148 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1/3] 10.222.0.65 () {58 vars in 1024 bytes} [Thu Oct 27 09:32:31 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 485 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Oct 27 09:32:32.836565 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177d829f-ee82-43ce-836d-7f6b91af1960 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:32:32.908905 dv-cinder-797970-7-smb devstack@keystone.service[88311]: INFO dbcounter [None req-177d829f-ee82-43ce-836d-7f6b91af1960 None None] Registered counter for database keystone Oct 27 09:32:32.928513 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG oslo_db.sqlalchemy.engines [None req-177d829f-ee82-43ce-836d-7f6b91af1960 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=88311) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 27 09:32:32.934880 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writer thread running {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 27 09:32:33.053820 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177d829f-ee82-43ce-836d-7f6b91af1960 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:32:33.058214 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68948985-2853-42cd-8034-b2ed9f37173a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:32:33.058982 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68948985-2853-42cd-8034-b2ed9f37173a admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:32:33.059321 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68948985-2853-42cd-8034-b2ed9f37173a admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:32:33.059612 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68948985-2853-42cd-8034-b2ed9f37173a admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:32:33.069053 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68948985-2853-42cd-8034-b2ed9f37173a admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:32:33.120760 dv-cinder-797970-7-smb devstack@keystone.service[88311]: WARNING keystone.common.rbac_enforcer.enforcer [None req-68948985-2853-42cd-8034-b2ed9f37173a admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Oct 27 09:32:33.121042 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68948985-2853-42cd-8034-b2ed9f37173a admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:32:33.131532 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3/4] 10.222.0.65 () {58 vars in 1324 bytes} [Thu Oct 27 09:32:32 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 27 09:32:33.137580 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346fdcb2-9a2e-4add-a3ec-a6530c2253c8 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:32:33.155191 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346fdcb2-9a2e-4add-a3ec-a6530c2253c8 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:32:33.159889 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25547ee0-0a47-40b1-8927-4910e7c1a84a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:32:33.160980 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25547ee0-0a47-40b1-8927-4910e7c1a84a admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:32:33.161258 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25547ee0-0a47-40b1-8927-4910e7c1a84a admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:32:33.161536 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25547ee0-0a47-40b1-8927-4910e7c1a84a admin admin] PATH_INFO: `/v3/projects/9c03247ba584473d97a93650c876aafd` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:32:33.163012 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25547ee0-0a47-40b1-8927-4910e7c1a84a admin admin] RBAC: Authorizing `identity:get_project(project_id=9c03247ba584473d97a93650c876aafd)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:32:33.213457 dv-cinder-797970-7-smb devstack@keystone.service[88312]: WARNING keystone.common.rbac_enforcer.enforcer [None req-25547ee0-0a47-40b1-8927-4910e7c1a84a admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Oct 27 09:32:33.213791 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25547ee0-0a47-40b1-8927-4910e7c1a84a admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:32:33.218331 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2/5] 10.222.0.65 () {56 vars in 1207 bytes} [Thu Oct 27 09:32:33 2022] GET /identity/v3/projects/9c03247ba584473d97a93650c876aafd => generated 344 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 09:32:35.386745 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4946ed10-b634-4eab-9176-eca21629ca68 None None] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:32:35.387299 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4946ed10-b634-4eab-9176-eca21629ca68 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:32:35.387299 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4946ed10-b634-4eab-9176-eca21629ca68 None None] PATH_INFO: `/` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:32:35.391547 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4/6] 10.222.0.65 () {54 vars in 927 bytes} [Thu Oct 27 09:32:35 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 09:32:35.397392 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5873a5b-4aa7-4ffe-9d1e-500d1acd68df None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:32:35.397864 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5873a5b-4aa7-4ffe-9d1e-500d1acd68df None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:32:35.397959 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5873a5b-4aa7-4ffe-9d1e-500d1acd68df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:32:35.418481 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-a5873a5b-4aa7-4ffe-9d1e-500d1acd68df None None] MFA Rules not processed for user `b5065084bf664b99bdeac46067cb0f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:32:35.420024 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-a5873a5b-4aa7-4ffe-9d1e-500d1acd68df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:32:35.428601 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3/7] 10.222.0.65 () {58 vars in 1024 bytes} [Thu Oct 27 09:32:35 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Oct 27 09:32:35.698973 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4946ed10-b634-4eab-9176-eca21629ca68 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:32:35.713032 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4946ed10-b634-4eab-9176-eca21629ca68 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:32:35.717451 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d459c0-db25-4387-bda7-bd17faced935 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:32:35.718048 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d459c0-db25-4387-bda7-bd17faced935 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:32:35.718330 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d459c0-db25-4387-bda7-bd17faced935 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:32:35.718634 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d459c0-db25-4387-bda7-bd17faced935 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:32:35.727578 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d459c0-db25-4387-bda7-bd17faced935 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:32:35.729365 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d459c0-db25-4387-bda7-bd17faced935 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:32:35.738247 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 5/8] 10.222.0.65 () {58 vars in 1324 bytes} [Thu Oct 27 09:32:35 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 27 09:32:35.743956 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5873a5b-4aa7-4ffe-9d1e-500d1acd68df None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:32:35.753526 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5873a5b-4aa7-4ffe-9d1e-500d1acd68df None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:32:35.757895 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c1288f-6214-4897-bd85-ded2239ce046 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:32:35.758571 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c1288f-6214-4897-bd85-ded2239ce046 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:32:35.758857 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c1288f-6214-4897-bd85-ded2239ce046 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:32:35.759135 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c1288f-6214-4897-bd85-ded2239ce046 admin admin] PATH_INFO: `/v3/users/b5065084bf664b99bdeac46067cb0f0b` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:32:35.760443 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c1288f-6214-4897-bd85-ded2239ce046 admin admin] RBAC: Authorizing `identity:get_user(user_id=b5065084bf664b99bdeac46067cb0f0b)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:32:35.762273 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c1288f-6214-4897-bd85-ded2239ce046 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:32:35.763837 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4/9] 10.222.0.65 () {56 vars in 1198 bytes} [Thu Oct 27 09:32:35 2022] GET /identity/v3/users/b5065084bf664b99bdeac46067cb0f0b => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 09:32:38.008461 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facb5426-12ee-429d-b49d-31d2de2b50e2 None None] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:32:38.008997 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facb5426-12ee-429d-b49d-31d2de2b50e2 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:32:38.008997 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facb5426-12ee-429d-b49d-31d2de2b50e2 None None] PATH_INFO: `/` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:32:38.010323 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 6/10] 10.222.0.65 () {54 vars in 927 bytes} [Thu Oct 27 09:32:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 09:32:38.015941 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27176a53-0858-4fb9-8aaf-f8a7e44af6c9 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:32:38.016363 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27176a53-0858-4fb9-8aaf-f8a7e44af6c9 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:32:38.016481 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27176a53-0858-4fb9-8aaf-f8a7e44af6c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:32:38.034414 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-27176a53-0858-4fb9-8aaf-f8a7e44af6c9 None None] MFA Rules not processed for user `b5065084bf664b99bdeac46067cb0f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:32:38.035527 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be60626f-347b-4de8-b4ec-6bd82213e008 None None] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:32:38.035649 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-27176a53-0858-4fb9-8aaf-f8a7e44af6c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:32:38.035814 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be60626f-347b-4de8-b4ec-6bd82213e008 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:32:38.036092 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be60626f-347b-4de8-b4ec-6bd82213e008 None None] PATH_INFO: `/` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:32:38.037429 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 7/11] 10.222.0.65 () {54 vars in 927 bytes} [Thu Oct 27 09:32:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 27 09:32:38.042702 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7a0960-ab0a-4b09-9b11-f48e79119716 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:32:38.042981 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7a0960-ab0a-4b09-9b11-f48e79119716 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:32:38.043262 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7a0960-ab0a-4b09-9b11-f48e79119716 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:32:38.086458 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG passlib.handlers.bcrypt [None req-2f7a0960-ab0a-4b09-9b11-f48e79119716 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=88311) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Oct 27 09:32:38.086886 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG passlib.handlers.bcrypt [None req-2f7a0960-ab0a-4b09-9b11-f48e79119716 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=88311) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Oct 27 09:32:38.117610 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 5/12] 10.222.0.65 () {58 vars in 1024 bytes} [Thu Oct 27 09:32:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 27 09:32:38.136536 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-2f7a0960-ab0a-4b09-9b11-f48e79119716 None None] MFA Rules not processed for user `b5065084bf664b99bdeac46067cb0f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:32:38.138109 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-2f7a0960-ab0a-4b09-9b11-f48e79119716 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:32:38.239313 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 8/13] 10.222.0.65 () {58 vars in 1024 bytes} [Thu Oct 27 09:32:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 27 09:32:38.384741 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27176a53-0858-4fb9-8aaf-f8a7e44af6c9 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:32:38.410726 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:32:38.490039 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27176a53-0858-4fb9-8aaf-f8a7e44af6c9 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:32:38.509131 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7a0960-ab0a-4b09-9b11-f48e79119716 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:32:38.524789 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866565e5-3d2d-43e0-a1d7-25141447e785 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:32:38.525412 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866565e5-3d2d-43e0-a1d7-25141447e785 None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:32:38.525690 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866565e5-3d2d-43e0-a1d7-25141447e785 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:32:38.525965 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866565e5-3d2d-43e0-a1d7-25141447e785 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:32:38.537872 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866565e5-3d2d-43e0-a1d7-25141447e785 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 09:32:38.546826 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application [None req-866565e5-3d2d-43e0-a1d7-25141447e785 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 27 09:32:38.546826 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 09:32:38.546826 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 09:32:38.546826 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 09:32:38.546826 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 09:32:38.546826 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 09:32:38.546826 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 09:32:38.546826 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 09:32:38.546826 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 09:32:38.546826 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 09:32:38.546826 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 09:32:38.546826 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 09:32:38.546826 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 27 09:32:38.546826 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 27 09:32:38.546826 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 27 09:32:38.546826 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 27 09:32:38.547731 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 27 09:32:38.547731 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 27 09:32:38.547731 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 27 09:32:38.547731 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 27 09:32:38.547731 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 09:32:38.547731 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 09:32:38.547731 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 09:32:38.547731 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 09:32:38.547731 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 09:32:38.547731 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 09:32:38.547731 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 09:32:38.547731 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application with Lock( Oct 27 09:32:38.547731 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 09:32:38.547731 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._enter() Oct 27 09:32:38.547731 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 09:32:38.547731 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 09:32:38.549132 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 09:32:38.549132 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.creator() Oct 27 09:32:38.549132 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 09:32:38.549132 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application created_value = creator( Oct 27 09:32:38.549132 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 27 09:32:38.549132 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 27 09:32:38.549132 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 27 09:32:38.549132 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 27 09:32:38.549132 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 27 09:32:38.549132 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 27 09:32:38.549132 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 27 09:32:38.549132 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application Oct 27 09:32:38.549132 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 6/14] 10.222.0.65 () {56 vars in 1096 bytes} [Thu Oct 27 09:32:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 09:32:38.554487 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866565e5-3d2d-43e0-a1d7-25141447e785 None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:32:38.613381 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7a0960-ab0a-4b09-9b11-f48e79119716 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:32:38.615983 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:32:38.644522 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:32:38.651426 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834267a3-5417-4404-8f68-d4678921302a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:32:38.652302 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834267a3-5417-4404-8f68-d4678921302a None admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:32:38.652587 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834267a3-5417-4404-8f68-d4678921302a None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:32:38.652863 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834267a3-5417-4404-8f68-d4678921302a None admin] PATH_INFO: `/v3/domains` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:32:38.653910 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834267a3-5417-4404-8f68-d4678921302a None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:32:38.655495 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834267a3-5417-4404-8f68-d4678921302a None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:32:38.658492 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866565e5-3d2d-43e0-a1d7-25141447e785 None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:32:38.692742 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ec194a-bedc-4b22-82a4-8322226437f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:32:38.693349 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ec194a-bedc-4b22-82a4-8322226437f7 None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:32:38.693631 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ec194a-bedc-4b22-82a4-8322226437f7 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:32:38.693907 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ec194a-bedc-4b22-82a4-8322226437f7 None admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:32:38.694593 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ec194a-bedc-4b22-82a4-8322226437f7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 09:32:38.694896 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ec194a-bedc-4b22-82a4-8322226437f7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:32:38.696324 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ec194a-bedc-4b22-82a4-8322226437f7 None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:32:38.708642 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 7/15] 10.222.0.65 () {56 vars in 1099 bytes} [Thu Oct 27 09:32:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 09:32:38.713736 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.sql.core [None req-834267a3-5417-4404-8f68-d4678921302a None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Oct 27 09:32:38.713736 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 27 09:32:38.713736 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [parameters: {'id': '25d9cc0645df4932966ca90386701187', 'name': 'Default', 'domain_id': '<>', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': None, 'is_domain': 1}] Oct 27 09:32:38.713736 dv-cinder-797970-7-smb devstack@keystone.service[88311]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=88311) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 27 09:32:38.714189 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ec194a-bedc-4b22-82a4-8322226437f7 None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:32:38.732754 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application [None req-834267a3-5417-4404-8f68-d4678921302a None admin] Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default. Oct 27 09:32:38.732754 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 09:32:38.732754 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 27 09:32:38.732754 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 27 09:32:38.732754 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 27 09:32:38.732754 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 27 09:32:38.732754 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 27 09:32:38.732754 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application result = self._query(query) Oct 27 09:32:38.732754 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 27 09:32:38.732754 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application conn.query(q) Oct 27 09:32:38.732754 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 27 09:32:38.732754 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 27 09:32:38.732754 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 27 09:32:38.732754 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application result.read() Oct 27 09:32:38.733629 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 27 09:32:38.733629 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 27 09:32:38.733629 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 27 09:32:38.733629 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 27 09:32:38.733629 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 27 09:32:38.733629 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 27 09:32:38.733629 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 27 09:32:38.733629 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 27 09:32:38.733629 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Oct 27 09:32:38.733629 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application Oct 27 09:32:38.733629 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 27 09:32:38.733629 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application Oct 27 09:32:38.733629 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 09:32:38.733629 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 27 09:32:38.733629 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 27 09:32:38.733629 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Oct 27 09:32:38.733629 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return project_ref.to_dict() Oct 27 09:32:38.733629 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 27 09:32:38.734508 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application next(self.gen) Oct 27 09:32:38.734508 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1068, in _transaction_scope Oct 27 09:32:38.734508 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application yield resource Oct 27 09:32:38.734508 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 27 09:32:38.734508 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application next(self.gen) Oct 27 09:32:38.734508 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 670, in _session Oct 27 09:32:38.734508 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application self.session.rollback() Oct 27 09:32:38.734508 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 27 09:32:38.734508 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application self.force_reraise() Oct 27 09:32:38.734508 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 27 09:32:38.734508 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application raise self.value Oct 27 09:32:38.734508 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 667, in _session Oct 27 09:32:38.734508 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 27 09:32:38.734508 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 695, in _end_session_transaction Oct 27 09:32:38.734508 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application session.commit() Oct 27 09:32:38.734508 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 27 09:32:38.734508 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 27 09:32:38.735349 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 27 09:32:38.735349 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application self._prepare_impl() Oct 27 09:32:38.735349 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 27 09:32:38.735349 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application self.session.flush() Oct 27 09:32:38.735349 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 27 09:32:38.735349 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application self._flush(objects) Oct 27 09:32:38.735349 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 27 09:32:38.735349 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 27 09:32:38.735349 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 27 09:32:38.735349 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application compat.raise_( Oct 27 09:32:38.735349 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 27 09:32:38.735349 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application raise exception Oct 27 09:32:38.735349 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 27 09:32:38.735349 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application flush_context.execute() Oct 27 09:32:38.735349 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 27 09:32:38.735349 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application rec.execute(self) Oct 27 09:32:38.735349 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 27 09:32:38.736273 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 27 09:32:38.736273 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 27 09:32:38.736273 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 27 09:32:38.736273 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Oct 27 09:32:38.736273 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application c = connection._execute_20( Oct 27 09:32:38.736273 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 27 09:32:38.736273 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 27 09:32:38.736273 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 27 09:32:38.736273 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 27 09:32:38.736273 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 27 09:32:38.736273 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 27 09:32:38.736273 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 27 09:32:38.736273 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 27 09:32:38.736273 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 27 09:32:38.736273 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 27 09:32:38.737012 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 27 09:32:38.737012 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application raise exception Oct 27 09:32:38.737012 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 27 09:32:38.737012 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 27 09:32:38.737012 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 27 09:32:38.737012 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 27 09:32:38.737012 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 27 09:32:38.737012 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application result = self._query(query) Oct 27 09:32:38.737012 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 27 09:32:38.737012 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application conn.query(q) Oct 27 09:32:38.737012 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 27 09:32:38.737012 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 27 09:32:38.737012 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 27 09:32:38.737012 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application result.read() Oct 27 09:32:38.737012 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 27 09:32:38.737012 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 27 09:32:38.737012 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 27 09:32:38.737777 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 27 09:32:38.737777 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 27 09:32:38.737777 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 27 09:32:38.737777 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 27 09:32:38.737777 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 27 09:32:38.737777 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Oct 27 09:32:38.737777 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 27 09:32:38.737777 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application [parameters: {'id': '25d9cc0645df4932966ca90386701187', 'name': 'Default', 'domain_id': '<>', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': None, 'is_domain': 1}] Oct 27 09:32:38.737777 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 27 09:32:38.737777 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application Oct 27 09:32:38.737777 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 27 09:32:38.737777 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application Oct 27 09:32:38.737777 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 09:32:38.737777 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Oct 27 09:32:38.737777 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Oct 27 09:32:38.738473 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 27 09:32:38.738473 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 27 09:32:38.738473 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name Default. Oct 27 09:32:38.738473 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application Oct 27 09:32:38.738473 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 27 09:32:38.738473 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application Oct 27 09:32:38.738473 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 09:32:38.738473 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 09:32:38.738473 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 09:32:38.738473 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 09:32:38.738473 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 09:32:38.738473 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 09:32:38.738473 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 09:32:38.738473 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 09:32:38.738473 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 09:32:38.738473 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 09:32:38.738473 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 09:32:38.740127 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 128, in post Oct 27 09:32:38.740127 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_domain( Oct 27 09:32:38.740127 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 09:32:38.740127 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 09:32:38.740127 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 765, in create_domain Oct 27 09:32:38.740127 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application is_domain_project = self.create_project( Oct 27 09:32:38.740127 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 09:32:38.740127 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 09:32:38.740127 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Oct 27 09:32:38.740127 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application raise exception.Conflict( Oct 27 09:32:38.740127 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default. Oct 27 09:32:38.740127 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application Oct 27 09:32:38.740127 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 9/16] 10.222.0.65 () {60 vars in 1137 bytes} [Thu Oct 27 09:32:38 2022] POST /identity/v3/domains => generated 190 bytes in 225 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Oct 27 09:32:38.740953 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834267a3-5417-4404-8f68-d4678921302a None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:32:38.820668 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ec194a-bedc-4b22-82a4-8322226437f7 None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:32:38.842249 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834267a3-5417-4404-8f68-d4678921302a None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:32:38.860400 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8d6076-898f-40ca-8e7e-364ee4d00051 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:32:38.862247 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8d6076-898f-40ca-8e7e-364ee4d00051 None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:32:38.862381 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8d6076-898f-40ca-8e7e-364ee4d00051 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:32:38.862706 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8d6076-898f-40ca-8e7e-364ee4d00051 None admin] PATH_INFO: `/v3/users/b5065084bf664b99bdeac46067cb0f0b` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:32:38.863895 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8d6076-898f-40ca-8e7e-364ee4d00051 None admin] RBAC: Authorizing `identity:get_user(user_id=b5065084bf664b99bdeac46067cb0f0b)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:32:38.865367 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8d6076-898f-40ca-8e7e-364ee4d00051 None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:32:38.866980 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 8/17] 10.222.0.65 () {56 vars in 1177 bytes} [Thu Oct 27 09:32:38 2022] GET /identity/v3/users/b5065084bf664b99bdeac46067cb0f0b => generated 247 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 09:32:38.872614 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8d6076-898f-40ca-8e7e-364ee4d00051 None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:32:38.879128 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02409e0-1217-430d-a3f5-7b511352bbb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:32:38.879974 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02409e0-1217-430d-a3f5-7b511352bbb2 None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:32:38.880251 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02409e0-1217-430d-a3f5-7b511352bbb2 None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:32:38.880513 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02409e0-1217-430d-a3f5-7b511352bbb2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:32:38.887890 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:32:38.898206 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02409e0-1217-430d-a3f5-7b511352bbb2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:32:38.899703 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02409e0-1217-430d-a3f5-7b511352bbb2 None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:32:38.915484 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application [None req-d02409e0-1217-430d-a3f5-7b511352bbb2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 09:32:38.915484 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 09:32:38.915484 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 09:32:38.915484 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 09:32:38.915484 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 09:32:38.915484 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 09:32:38.915484 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 09:32:38.915484 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 09:32:38.915484 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 09:32:38.915484 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 09:32:38.915484 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 09:32:38.915484 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 09:32:38.915484 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 27 09:32:38.915484 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 27 09:32:38.915484 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 27 09:32:38.915484 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 27 09:32:38.916383 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 09:32:38.916383 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 09:32:38.916383 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 09:32:38.916383 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 09:32:38.916383 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 09:32:38.916383 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 09:32:38.916383 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 09:32:38.916383 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application with Lock( Oct 27 09:32:38.916383 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 09:32:38.916383 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._enter() Oct 27 09:32:38.916383 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 09:32:38.916383 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 09:32:38.916383 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 09:32:38.916383 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.creator() Oct 27 09:32:38.916383 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 09:32:38.916383 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application created_value = creator( Oct 27 09:32:38.916383 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 27 09:32:38.917155 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 27 09:32:38.917155 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 09:32:38.917155 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application Oct 27 09:32:38.917155 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 10/18] 10.222.0.65 () {56 vars in 1108 bytes} [Thu Oct 27 09:32:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 09:32:38.923898 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02409e0-1217-430d-a3f5-7b511352bbb2 None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:32:38.947572 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:32:38.980391 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8d6076-898f-40ca-8e7e-364ee4d00051 None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:32:39.016815 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ebbdec-323e-4272-8d38-c084503bd34d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:32:39.017500 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ebbdec-323e-4272-8d38-c084503bd34d None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:32:39.017777 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ebbdec-323e-4272-8d38-c084503bd34d None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:32:39.018050 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ebbdec-323e-4272-8d38-c084503bd34d None admin] PATH_INFO: `/v3/domains/default` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:32:39.019212 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ebbdec-323e-4272-8d38-c084503bd34d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:32:39.020668 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ebbdec-323e-4272-8d38-c084503bd34d None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:32:39.022218 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 9/19] 10.222.0.65 () {56 vars in 1108 bytes} [Thu Oct 27 09:32:38 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 09:32:39.027962 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ebbdec-323e-4272-8d38-c084503bd34d None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:32:39.030101 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02409e0-1217-430d-a3f5-7b511352bbb2 None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:32:39.065977 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb47868-f8d5-4302-83d5-61ed68e2331d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:32:39.066610 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb47868-f8d5-4302-83d5-61ed68e2331d None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:32:39.066890 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb47868-f8d5-4302-83d5-61ed68e2331d None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:32:39.067164 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb47868-f8d5-4302-83d5-61ed68e2331d None admin] PATH_INFO: `/v3/domains` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:32:39.067812 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb47868-f8d5-4302-83d5-61ed68e2331d None admin] RBAC: Adding query filter params (name=Default) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 09:32:39.068113 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb47868-f8d5-4302-83d5-61ed68e2331d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:32:39.069493 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb47868-f8d5-4302-83d5-61ed68e2331d None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:32:39.086479 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 11/20] 10.222.0.65 () {56 vars in 1109 bytes} [Thu Oct 27 09:32:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 09:32:39.112373 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:32:39.134197 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ebbdec-323e-4272-8d38-c084503bd34d None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:32:39.172867 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e73fb0-30e9-42c7-a637-1757c3c295e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:32:39.173572 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e73fb0-30e9-42c7-a637-1757c3c295e7 None admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:32:39.173925 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e73fb0-30e9-42c7-a637-1757c3c295e7 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:32:39.174273 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e73fb0-30e9-42c7-a637-1757c3c295e7 None admin] PATH_INFO: `/v3/domains/default/users/b5065084bf664b99bdeac46067cb0f0b/roles/6ad17b9f9dea4b66ab2da3677d7e715d` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:32:39.176400 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e73fb0-30e9-42c7-a637-1757c3c295e7 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=b5065084bf664b99bdeac46067cb0f0b, role_id=6ad17b9f9dea4b66ab2da3677d7e715d)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:32:39.177891 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e73fb0-30e9-42c7-a637-1757c3c295e7 None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:32:39.398063 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 10/21] 10.222.0.65 () {58 vars in 1361 bytes} [Thu Oct 27 09:32:39 2022] PUT /identity/v3/domains/default/users/b5065084bf664b99bdeac46067cb0f0b/roles/6ad17b9f9dea4b66ab2da3677d7e715d => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 09:32:41.791596 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82d0317-2825-4597-8190-112d4252f706 None None] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:32:41.792106 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82d0317-2825-4597-8190-112d4252f706 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:32:41.792214 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82d0317-2825-4597-8190-112d4252f706 None None] PATH_INFO: `/` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:32:41.793668 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 12/22] 10.222.0.65 () {54 vars in 927 bytes} [Thu Oct 27 09:32:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 09:32:41.805599 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0df937-38dd-48c6-9e0f-dbf99f96c87c None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:32:41.806076 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0df937-38dd-48c6-9e0f-dbf99f96c87c None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:32:41.806166 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0df937-38dd-48c6-9e0f-dbf99f96c87c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:32:41.835735 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-0a0df937-38dd-48c6-9e0f-dbf99f96c87c None None] MFA Rules not processed for user `b5065084bf664b99bdeac46067cb0f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:32:41.837284 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-0a0df937-38dd-48c6-9e0f-dbf99f96c87c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:32:41.924099 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b7f4c3-11ca-4132-a3af-d501739019e4 None None] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:32:41.924380 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b7f4c3-11ca-4132-a3af-d501739019e4 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:32:41.924843 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b7f4c3-11ca-4132-a3af-d501739019e4 None None] PATH_INFO: `/` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:32:41.926676 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 13/23] 10.222.0.65 () {54 vars in 927 bytes} [Thu Oct 27 09:32:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 09:32:41.932238 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a510ce35-8fba-488d-9242-6245b2423793 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:32:41.932692 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a510ce35-8fba-488d-9242-6245b2423793 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:32:41.933118 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a510ce35-8fba-488d-9242-6245b2423793 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:32:41.942592 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 11/24] 10.222.0.65 () {58 vars in 1024 bytes} [Thu Oct 27 09:32:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 27 09:32:41.975806 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-a510ce35-8fba-488d-9242-6245b2423793 None None] MFA Rules not processed for user `b5065084bf664b99bdeac46067cb0f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:32:41.977336 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-a510ce35-8fba-488d-9242-6245b2423793 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:32:42.084429 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 14/25] 10.222.0.65 () {58 vars in 1024 bytes} [Thu Oct 27 09:32:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 27 09:32:42.093636 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef510fe1-041c-4eb0-a9c7-07e54bd224c7 None None] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:32:42.093946 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef510fe1-041c-4eb0-a9c7-07e54bd224c7 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:32:42.094233 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef510fe1-041c-4eb0-a9c7-07e54bd224c7 None None] PATH_INFO: `/` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:32:42.102897 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 12/26] 10.222.0.65 () {54 vars in 927 bytes} [Thu Oct 27 09:32:42 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 09:32:42.108980 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2142ad3e-791e-417e-8206-20750fda50b3 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:32:42.109475 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2142ad3e-791e-417e-8206-20750fda50b3 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:32:42.109887 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2142ad3e-791e-417e-8206-20750fda50b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:32:42.138571 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-2142ad3e-791e-417e-8206-20750fda50b3 None None] MFA Rules not processed for user `b5065084bf664b99bdeac46067cb0f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:32:42.139989 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-2142ad3e-791e-417e-8206-20750fda50b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:32:42.145415 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:32:42.198640 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144c5665-2a7b-4e4b-bd4a-1e928e3a026a None None] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:32:42.198961 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144c5665-2a7b-4e4b-bd4a-1e928e3a026a None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:32:42.199211 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144c5665-2a7b-4e4b-bd4a-1e928e3a026a None None] PATH_INFO: `/` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:32:42.200763 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 13/27] 10.222.0.65 () {54 vars in 927 bytes} [Thu Oct 27 09:32:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 27 09:32:42.221660 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186cca72-4e03-4a07-98db-a9cafd75c86f None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:32:42.221955 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186cca72-4e03-4a07-98db-a9cafd75c86f None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:32:42.222231 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186cca72-4e03-4a07-98db-a9cafd75c86f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:32:42.256781 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-186cca72-4e03-4a07-98db-a9cafd75c86f None None] MFA Rules not processed for user `b5065084bf664b99bdeac46067cb0f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:32:42.256956 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 15/28] 10.222.0.65 () {58 vars in 1024 bytes} [Thu Oct 27 09:32:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 27 09:32:42.257990 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-186cca72-4e03-4a07-98db-a9cafd75c86f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:32:42.360042 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:32:42.365587 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 14/29] 10.222.0.65 () {58 vars in 1024 bytes} [Thu Oct 27 09:32:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 27 09:32:42.386127 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2142ad3e-791e-417e-8206-20750fda50b3 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:32:42.459632 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186cca72-4e03-4a07-98db-a9cafd75c86f None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:32:42.574155 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2142ad3e-791e-417e-8206-20750fda50b3 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:32:42.643882 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2ae363-e90f-49d6-9d44-02793ab0934b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:32:42.646064 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2ae363-e90f-49d6-9d44-02793ab0934b None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:32:42.647861 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2ae363-e90f-49d6-9d44-02793ab0934b None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:32:42.648344 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2ae363-e90f-49d6-9d44-02793ab0934b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:32:42.662728 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186cca72-4e03-4a07-98db-a9cafd75c86f None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:32:42.667492 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:32:42.673454 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2ae363-e90f-49d6-9d44-02793ab0934b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:32:42.689961 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2ae363-e90f-49d6-9d44-02793ab0934b None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:32:42.698945 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application [None req-cb2ae363-e90f-49d6-9d44-02793ab0934b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 09:32:42.698945 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 09:32:42.698945 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 09:32:42.698945 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 09:32:42.698945 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 09:32:42.698945 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 09:32:42.698945 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 09:32:42.698945 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 09:32:42.698945 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 09:32:42.698945 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 09:32:42.698945 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 09:32:42.698945 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 09:32:42.698945 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 27 09:32:42.698945 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 27 09:32:42.698945 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 27 09:32:42.698945 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 27 09:32:42.699747 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 09:32:42.699747 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 09:32:42.699747 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 09:32:42.699747 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 09:32:42.699747 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 09:32:42.699747 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 09:32:42.699747 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 09:32:42.699747 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application with Lock( Oct 27 09:32:42.699747 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 09:32:42.699747 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._enter() Oct 27 09:32:42.699747 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 09:32:42.699747 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 09:32:42.699747 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 09:32:42.699747 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.creator() Oct 27 09:32:42.699747 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 09:32:42.699747 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application created_value = creator( Oct 27 09:32:42.699747 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 27 09:32:42.700532 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 27 09:32:42.700532 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 09:32:42.700532 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application Oct 27 09:32:42.709864 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 16/30] 10.222.0.65 () {56 vars in 1108 bytes} [Thu Oct 27 09:32:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 324 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 09:32:42.710875 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2ae363-e90f-49d6-9d44-02793ab0934b None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:32:42.742620 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6928fb06-f283-4640-9009-11146ebdb812 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:32:42.743503 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6928fb06-f283-4640-9009-11146ebdb812 None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:32:42.743924 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6928fb06-f283-4640-9009-11146ebdb812 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:32:42.744597 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6928fb06-f283-4640-9009-11146ebdb812 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:32:42.765005 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6928fb06-f283-4640-9009-11146ebdb812 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 09:32:42.774211 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application [None req-6928fb06-f283-4640-9009-11146ebdb812 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 27 09:32:42.774211 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 09:32:42.774211 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 09:32:42.774211 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 09:32:42.774211 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 09:32:42.774211 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 09:32:42.774211 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 09:32:42.774211 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 09:32:42.774211 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 09:32:42.774211 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 09:32:42.774211 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 09:32:42.774211 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 09:32:42.774211 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 27 09:32:42.774211 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 27 09:32:42.774211 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 27 09:32:42.774211 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 27 09:32:42.776077 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 27 09:32:42.776077 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 27 09:32:42.776077 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 27 09:32:42.776077 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 27 09:32:42.776077 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 09:32:42.776077 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 09:32:42.776077 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 09:32:42.776077 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 09:32:42.776077 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 09:32:42.776077 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 09:32:42.776077 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 09:32:42.776077 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application with Lock( Oct 27 09:32:42.776077 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 09:32:42.776077 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._enter() Oct 27 09:32:42.776077 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 09:32:42.776077 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 09:32:42.777856 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 09:32:42.777856 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.creator() Oct 27 09:32:42.777856 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 09:32:42.777856 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application created_value = creator( Oct 27 09:32:42.777856 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 27 09:32:42.777856 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 27 09:32:42.777856 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 27 09:32:42.777856 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 27 09:32:42.777856 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 27 09:32:42.777856 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 27 09:32:42.777856 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 27 09:32:42.777856 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application Oct 27 09:32:42.784840 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 15/31] 10.222.0.65 () {56 vars in 1096 bytes} [Thu Oct 27 09:32:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 326 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 27 09:32:42.788517 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6928fb06-f283-4640-9009-11146ebdb812 None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:32:42.872409 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:32:42.891463 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2ae363-e90f-49d6-9d44-02793ab0934b None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:32:42.919419 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6928fb06-f283-4640-9009-11146ebdb812 None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:32:42.937582 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1d25b7-811b-412e-bdae-579907c9cf64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:32:42.939051 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1d25b7-811b-412e-bdae-579907c9cf64 None admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:32:42.939447 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1d25b7-811b-412e-bdae-579907c9cf64 None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:32:42.939835 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1d25b7-811b-412e-bdae-579907c9cf64 None admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:32:42.940785 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1d25b7-811b-412e-bdae-579907c9cf64 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:32:42.942190 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1d25b7-811b-412e-bdae-579907c9cf64 None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:32:42.960137 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038431ec-9c75-4593-8b9f-44e86f1fb07c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:32:42.960873 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038431ec-9c75-4593-8b9f-44e86f1fb07c None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:32:42.961223 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038431ec-9c75-4593-8b9f-44e86f1fb07c None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:32:42.961614 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038431ec-9c75-4593-8b9f-44e86f1fb07c None admin] PATH_INFO: `/v3/domains` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:32:42.962335 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038431ec-9c75-4593-8b9f-44e86f1fb07c None admin] RBAC: Adding query filter params (name=Default) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 09:32:42.962730 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038431ec-9c75-4593-8b9f-44e86f1fb07c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:32:42.964316 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038431ec-9c75-4593-8b9f-44e86f1fb07c None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:32:42.983062 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 16/32] 10.222.0.65 () {56 vars in 1109 bytes} [Thu Oct 27 09:32:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 09:32:42.983845 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038431ec-9c75-4593-8b9f-44e86f1fb07c None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:32:43.097341 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038431ec-9c75-4593-8b9f-44e86f1fb07c None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:32:43.120136 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:32:43.136132 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cf8a1d-a238-44c2-acbe-f78506b8fc3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:32:43.136851 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cf8a1d-a238-44c2-acbe-f78506b8fc3b None admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:32:43.137142 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cf8a1d-a238-44c2-acbe-f78506b8fc3b None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:32:43.137476 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cf8a1d-a238-44c2-acbe-f78506b8fc3b None admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:32:43.139712 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1cf8a1d-a238-44c2-acbe-f78506b8fc3b None admin] RBAC: Authorizing `identity:create_role()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:32:43.139712 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1cf8a1d-a238-44c2-acbe-f78506b8fc3b None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:32:43.181013 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 17/33] 10.222.0.65 () {60 vars in 1131 bytes} [Thu Oct 27 09:32:42 2022] POST /identity/v3/roles => generated 225 bytes in 470 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 09:32:43.186998 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1d25b7-811b-412e-bdae-579907c9cf64 None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:32:43.227795 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 17/34] 10.222.0.65 () {60 vars in 1131 bytes} [Thu Oct 27 09:32:42 2022] POST /identity/v3/roles => generated 219 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 09:32:43.232217 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cf8a1d-a238-44c2-acbe-f78506b8fc3b None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:32:43.271522 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:32:43.364407 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1d25b7-811b-412e-bdae-579907c9cf64 None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:32:43.426101 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6759eebe-886a-4580-8005-304ed3faf3aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:32:43.426772 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6759eebe-886a-4580-8005-304ed3faf3aa None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:32:43.427055 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6759eebe-886a-4580-8005-304ed3faf3aa None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:32:43.427331 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6759eebe-886a-4580-8005-304ed3faf3aa None admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:32:43.428041 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6759eebe-886a-4580-8005-304ed3faf3aa None admin] RBAC: Adding query filter params (name=admin) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 09:32:43.428346 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6759eebe-886a-4580-8005-304ed3faf3aa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:32:43.429605 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cf8a1d-a238-44c2-acbe-f78506b8fc3b None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:32:43.429887 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6759eebe-886a-4580-8005-304ed3faf3aa None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:32:43.443958 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 18/35] 10.222.0.65 () {56 vars in 1099 bytes} [Thu Oct 27 09:32:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 09:32:43.445281 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ff63cc-0782-4bd8-bc5a-2a994a9ed738 None None] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:32:43.445575 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ff63cc-0782-4bd8-bc5a-2a994a9ed738 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:32:43.445858 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ff63cc-0782-4bd8-bc5a-2a994a9ed738 None None] PATH_INFO: `/` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:32:43.457876 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 19/36] 10.222.0.65 () {54 vars in 927 bytes} [Thu Oct 27 09:32:43 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 09:32:43.458680 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ff63cc-0782-4bd8-bc5a-2a994a9ed738 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:32:43.489384 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a7bfd6-2da6-4f01-96d2-8ebae66e35a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:32:43.490026 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a7bfd6-2da6-4f01-96d2-8ebae66e35a9 None admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:32:43.490314 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a7bfd6-2da6-4f01-96d2-8ebae66e35a9 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:32:43.490624 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a7bfd6-2da6-4f01-96d2-8ebae66e35a9 None admin] PATH_INFO: `/v3/projects` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:32:43.491300 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a7bfd6-2da6-4f01-96d2-8ebae66e35a9 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:32:43.492829 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a7bfd6-2da6-4f01-96d2-8ebae66e35a9 None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:32:43.629277 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ff63cc-0782-4bd8-bc5a-2a994a9ed738 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:32:43.647315 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:32:43.660873 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 18/37] 10.222.0.65 () {60 vars in 1141 bytes} [Thu Oct 27 09:32:43 2022] POST /identity/v3/projects => generated 301 bytes in 432 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 09:32:43.663144 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604a8e63-82b5-4e5f-a394-e6b9d74c6056 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:32:43.663453 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604a8e63-82b5-4e5f-a394-e6b9d74c6056 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:32:43.663724 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604a8e63-82b5-4e5f-a394-e6b9d74c6056 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:32:43.677740 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfd8bca-c3d8-445c-b251-b7dc173f7bcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:32:43.678502 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfd8bca-c3d8-445c-b251-b7dc173f7bcd None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:32:43.678857 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfd8bca-c3d8-445c-b251-b7dc173f7bcd None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:32:43.679193 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfd8bca-c3d8-445c-b251-b7dc173f7bcd None admin] PATH_INFO: `/v3/users/b5065084bf664b99bdeac46067cb0f0b` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:32:43.680985 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfd8bca-c3d8-445c-b251-b7dc173f7bcd None admin] RBAC: Authorizing `identity:get_user(user_id=b5065084bf664b99bdeac46067cb0f0b)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:32:43.682625 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfd8bca-c3d8-445c-b251-b7dc173f7bcd None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:32:43.686418 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 20/38] 10.222.0.65 () {56 vars in 1177 bytes} [Thu Oct 27 09:32:43 2022] GET /identity/v3/users/b5065084bf664b99bdeac46067cb0f0b => generated 247 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 09:32:43.691472 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfd8bca-c3d8-445c-b251-b7dc173f7bcd None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:32:43.696764 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-604a8e63-82b5-4e5f-a394-e6b9d74c6056 None None] MFA Rules not processed for user `b5065084bf664b99bdeac46067cb0f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:32:43.698282 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-604a8e63-82b5-4e5f-a394-e6b9d74c6056 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:32:43.738834 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:32:43.794984 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 19/39] 10.222.0.65 () {58 vars in 1024 bytes} [Thu Oct 27 09:32:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 27 09:32:43.796788 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72831346-cb41-4053-a296-9f30607c0a6b None None] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:32:43.797193 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72831346-cb41-4053-a296-9f30607c0a6b None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:32:43.797598 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72831346-cb41-4053-a296-9f30607c0a6b None None] PATH_INFO: `/` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:32:43.800083 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 20/40] 10.222.0.65 () {54 vars in 927 bytes} [Thu Oct 27 09:32:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 09:32:43.807207 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c49b8ac-0b38-42b0-8b61-3615e4879167 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:32:43.807499 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c49b8ac-0b38-42b0-8b61-3615e4879167 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:32:43.807900 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c49b8ac-0b38-42b0-8b61-3615e4879167 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:32:43.826796 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfd8bca-c3d8-445c-b251-b7dc173f7bcd None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:32:43.883591 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82814af5-4bc5-44f8-91c8-382afa8e2142 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:32:43.885031 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82814af5-4bc5-44f8-91c8-382afa8e2142 None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:32:43.885031 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82814af5-4bc5-44f8-91c8-382afa8e2142 None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:32:43.885031 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82814af5-4bc5-44f8-91c8-382afa8e2142 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:32:43.885883 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82814af5-4bc5-44f8-91c8-382afa8e2142 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:32:43.887519 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82814af5-4bc5-44f8-91c8-382afa8e2142 None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:32:43.889192 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 21/41] 10.222.0.65 () {56 vars in 1108 bytes} [Thu Oct 27 09:32:43 2022] GET /identity/v3/domains/default => generated 199 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 09:32:43.896087 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82814af5-4bc5-44f8-91c8-382afa8e2142 None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:32:43.946663 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-6c49b8ac-0b38-42b0-8b61-3615e4879167 None None] MFA Rules not processed for user `b5065084bf664b99bdeac46067cb0f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:32:43.947833 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-6c49b8ac-0b38-42b0-8b61-3615e4879167 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:32:43.967161 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:32:44.024704 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82814af5-4bc5-44f8-91c8-382afa8e2142 None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:32:44.034725 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 21/42] 10.222.0.65 () {58 vars in 1024 bytes} [Thu Oct 27 09:32:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 27 09:32:44.070429 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a68d7b-0468-4469-89bd-fe842098f0dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:32:44.071161 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a68d7b-0468-4469-89bd-fe842098f0dd None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:32:44.071516 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a68d7b-0468-4469-89bd-fe842098f0dd None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:32:44.071856 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a68d7b-0468-4469-89bd-fe842098f0dd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:32:44.072673 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a68d7b-0468-4469-89bd-fe842098f0dd None admin] RBAC: Adding query filter params (role.id=6ad17b9f9dea4b66ab2da3677d7e715d, scope.domain.id=default, user.id=b5065084bf664b99bdeac46067cb0f0b) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 09:32:44.072996 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a68d7b-0468-4469-89bd-fe842098f0dd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:32:44.074444 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a68d7b-0468-4469-89bd-fe842098f0dd None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:32:44.083706 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 22/43] 10.222.0.65 () {56 vars in 1322 bytes} [Thu Oct 27 09:32:43 2022] GET /identity/v3/role_assignments?user.id=b5065084bf664b99bdeac46067cb0f0b&scope.domain.id=default&role.id=6ad17b9f9dea4b66ab2da3677d7e715d => generated 530 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 09:32:44.087888 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c49b8ac-0b38-42b0-8b61-3615e4879167 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:32:44.195631 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:32:44.207443 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c49b8ac-0b38-42b0-8b61-3615e4879167 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:32:44.249366 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e082d9a-c91a-4d99-8692-4f39c9e2e593 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:32:44.250015 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e082d9a-c91a-4d99-8692-4f39c9e2e593 None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:32:44.250301 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e082d9a-c91a-4d99-8692-4f39c9e2e593 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:32:44.250610 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e082d9a-c91a-4d99-8692-4f39c9e2e593 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:32:44.252452 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e082d9a-c91a-4d99-8692-4f39c9e2e593 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:32:44.253937 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e082d9a-c91a-4d99-8692-4f39c9e2e593 None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:32:44.255779 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 22/44] 10.222.0.65 () {56 vars in 1108 bytes} [Thu Oct 27 09:32:44 2022] GET /identity/v3/domains/default => generated 199 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 09:32:44.261234 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a68d7b-0468-4469-89bd-fe842098f0dd None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:32:44.299240 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e082d9a-c91a-4d99-8692-4f39c9e2e593 None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:32:44.381522 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a68d7b-0468-4469-89bd-fe842098f0dd None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:32:44.396387 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:32:44.412720 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e082d9a-c91a-4d99-8692-4f39c9e2e593 None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:32:44.416979 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95c89a4-fc9e-4547-a2c6-1262c88a7ebf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:32:44.417592 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95c89a4-fc9e-4547-a2c6-1262c88a7ebf None admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:32:44.417876 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95c89a4-fc9e-4547-a2c6-1262c88a7ebf None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:32:44.418167 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95c89a4-fc9e-4547-a2c6-1262c88a7ebf None admin] PATH_INFO: `/v3/projects` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:32:44.418873 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95c89a4-fc9e-4547-a2c6-1262c88a7ebf None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:32:44.420332 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95c89a4-fc9e-4547-a2c6-1262c88a7ebf None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:32:44.447732 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89c3385-1f4a-4f06-a980-e2aa567f2f3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:32:44.451724 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89c3385-1f4a-4f06-a980-e2aa567f2f3a None admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:32:44.451724 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89c3385-1f4a-4f06-a980-e2aa567f2f3a None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:32:44.451724 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89c3385-1f4a-4f06-a980-e2aa567f2f3a None admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:32:44.451724 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89c3385-1f4a-4f06-a980-e2aa567f2f3a None admin] RBAC: Authorizing `identity:create_role()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:32:44.451724 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89c3385-1f4a-4f06-a980-e2aa567f2f3a None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:32:44.558359 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 23/45] 10.222.0.65 () {60 vars in 1141 bytes} [Thu Oct 27 09:32:44 2022] POST /identity/v3/projects => generated 312 bytes in 298 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 09:32:44.592129 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 23/46] 10.222.0.65 () {60 vars in 1131 bytes} [Thu Oct 27 09:32:44 2022] POST /identity/v3/roles => generated 223 bytes in 294 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 09:32:46.822620 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b48cd11-1be3-49fc-8b2a-75f445d328ec None None] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:32:46.823173 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b48cd11-1be3-49fc-8b2a-75f445d328ec None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:32:46.823262 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b48cd11-1be3-49fc-8b2a-75f445d328ec None None] PATH_INFO: `/` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:32:46.824552 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 24/47] 10.222.0.65 () {54 vars in 927 bytes} [Thu Oct 27 09:32:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 09:32:46.830489 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea98e15-b23e-4c6d-aae5-91b63ee66308 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:32:46.830935 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea98e15-b23e-4c6d-aae5-91b63ee66308 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:32:46.831045 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea98e15-b23e-4c6d-aae5-91b63ee66308 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:32:46.849965 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-7ea98e15-b23e-4c6d-aae5-91b63ee66308 None None] MFA Rules not processed for user `b5065084bf664b99bdeac46067cb0f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:32:46.851245 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-7ea98e15-b23e-4c6d-aae5-91b63ee66308 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:32:46.866875 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:32:46.919444 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 24/48] 10.222.0.65 () {58 vars in 1024 bytes} [Thu Oct 27 09:32:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 27 09:32:47.188990 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b48cd11-1be3-49fc-8b2a-75f445d328ec None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:32:47.292387 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b48cd11-1be3-49fc-8b2a-75f445d328ec None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:32:47.326596 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd685c3-6b2a-4ddc-8781-eb32d3c80764 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:32:47.327222 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd685c3-6b2a-4ddc-8781-eb32d3c80764 None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:32:47.327509 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd685c3-6b2a-4ddc-8781-eb32d3c80764 None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:32:47.327787 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd685c3-6b2a-4ddc-8781-eb32d3c80764 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:32:47.329976 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd685c3-6b2a-4ddc-8781-eb32d3c80764 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:32:47.331482 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd685c3-6b2a-4ddc-8781-eb32d3c80764 None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:32:47.333055 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 25/49] 10.222.0.65 () {56 vars in 1108 bytes} [Thu Oct 27 09:32:47 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 09:32:47.338808 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea98e15-b23e-4c6d-aae5-91b63ee66308 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:32:47.439336 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea98e15-b23e-4c6d-aae5-91b63ee66308 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:32:47.473295 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac9e75c-b162-415f-8c47-8001fef3e70b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:32:47.473902 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac9e75c-b162-415f-8c47-8001fef3e70b None admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:32:47.474191 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac9e75c-b162-415f-8c47-8001fef3e70b None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:32:47.474473 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac9e75c-b162-415f-8c47-8001fef3e70b None admin] PATH_INFO: `/v3/projects` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:32:47.475173 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac9e75c-b162-415f-8c47-8001fef3e70b None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:32:47.476637 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac9e75c-b162-415f-8c47-8001fef3e70b None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:32:47.554236 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 25/50] 10.222.0.65 () {60 vars in 1140 bytes} [Thu Oct 27 09:32:47 2022] POST /identity/v3/projects => generated 298 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 09:32:49.773186 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fb04b9-aef6-4067-bf17-d583aace270c None None] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:32:49.773706 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fb04b9-aef6-4067-bf17-d583aace270c None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:32:49.773795 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fb04b9-aef6-4067-bf17-d583aace270c None None] PATH_INFO: `/` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:32:49.775248 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 26/51] 10.222.0.65 () {54 vars in 927 bytes} [Thu Oct 27 09:32:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 09:32:49.780500 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1980c1f0-4a4a-4a2a-8492-7bd6636b1b05 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:32:49.780904 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1980c1f0-4a4a-4a2a-8492-7bd6636b1b05 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:32:49.781055 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1980c1f0-4a4a-4a2a-8492-7bd6636b1b05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:32:49.787965 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:32:49.800590 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-1980c1f0-4a4a-4a2a-8492-7bd6636b1b05 None None] MFA Rules not processed for user `b5065084bf664b99bdeac46067cb0f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:32:49.801774 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-1980c1f0-4a4a-4a2a-8492-7bd6636b1b05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:32:49.872860 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 26/52] 10.222.0.65 () {58 vars in 1024 bytes} [Thu Oct 27 09:32:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 27 09:32:50.144633 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fb04b9-aef6-4067-bf17-d583aace270c None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:32:50.179934 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:32:50.244778 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fb04b9-aef6-4067-bf17-d583aace270c None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:32:50.277853 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ffaa81-9b86-4dc8-b044-3dd4e45dacee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:32:50.278477 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ffaa81-9b86-4dc8-b044-3dd4e45dacee None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:32:50.278788 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ffaa81-9b86-4dc8-b044-3dd4e45dacee None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:32:50.279062 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ffaa81-9b86-4dc8-b044-3dd4e45dacee None admin] PATH_INFO: `/v3/domains/default` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:32:50.280155 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ffaa81-9b86-4dc8-b044-3dd4e45dacee None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:32:50.281597 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ffaa81-9b86-4dc8-b044-3dd4e45dacee None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:32:50.283805 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 27/53] 10.222.0.65 () {56 vars in 1108 bytes} [Thu Oct 27 09:32:50 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 09:32:50.289381 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1980c1f0-4a4a-4a2a-8492-7bd6636b1b05 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:32:50.386030 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1980c1f0-4a4a-4a2a-8492-7bd6636b1b05 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:32:50.416267 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:32:50.421028 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e97355-405f-4ce0-aa7f-2ff791f5c8a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:32:50.421634 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e97355-405f-4ce0-aa7f-2ff791f5c8a1 None admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:32:50.421916 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e97355-405f-4ce0-aa7f-2ff791f5c8a1 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:32:50.422192 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e97355-405f-4ce0-aa7f-2ff791f5c8a1 None admin] PATH_INFO: `/v3/users` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:32:50.423438 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e97355-405f-4ce0-aa7f-2ff791f5c8a1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:32:50.424878 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e97355-405f-4ce0-aa7f-2ff791f5c8a1 None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:32:50.522334 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 27/54] 10.222.0.65 () {60 vars in 1132 bytes} [Thu Oct 27 09:32:50 2022] POST /identity/v3/users => generated 275 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 09:32:54.076492 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0610cfe-313f-4348-94ba-76e6d3d12ce3 None None] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:32:54.077503 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0610cfe-313f-4348-94ba-76e6d3d12ce3 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:32:54.078008 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0610cfe-313f-4348-94ba-76e6d3d12ce3 None None] PATH_INFO: `/` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:32:54.079814 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 28/55] 10.222.0.65 () {54 vars in 927 bytes} [Thu Oct 27 09:32:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 09:32:54.083229 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f1add3-f645-42b5-a196-d11f0748ac69 None None] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:32:54.083632 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f1add3-f645-42b5-a196-d11f0748ac69 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:32:54.083825 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f1add3-f645-42b5-a196-d11f0748ac69 None None] PATH_INFO: `/` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:32:54.085169 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 28/56] 10.222.0.65 () {54 vars in 927 bytes} [Thu Oct 27 09:32:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 27 09:32:54.088093 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239b5706-7909-4116-af45-a2234c52da59 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:32:54.088382 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239b5706-7909-4116-af45-a2234c52da59 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:32:54.088669 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239b5706-7909-4116-af45-a2234c52da59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:32:54.091477 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c456fbd4-3fc3-469e-92cf-fa9ffa683795 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:32:54.092005 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c456fbd4-3fc3-469e-92cf-fa9ffa683795 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:32:54.092503 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c456fbd4-3fc3-469e-92cf-fa9ffa683795 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:32:54.128853 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-239b5706-7909-4116-af45-a2234c52da59 None None] MFA Rules not processed for user `b5065084bf664b99bdeac46067cb0f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:32:54.130253 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-c456fbd4-3fc3-469e-92cf-fa9ffa683795 None None] MFA Rules not processed for user `b5065084bf664b99bdeac46067cb0f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:32:54.132204 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-239b5706-7909-4116-af45-a2234c52da59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:32:54.133733 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-c456fbd4-3fc3-469e-92cf-fa9ffa683795 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:32:54.253168 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 29/57] 10.222.0.65 () {58 vars in 1024 bytes} [Thu Oct 27 09:32:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 27 09:32:54.258780 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 29/58] 10.222.0.65 () {58 vars in 1024 bytes} [Thu Oct 27 09:32:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 27 09:32:54.260113 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211d6232-a95c-46d3-ba4f-92c66a6ad209 None None] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:32:54.260407 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211d6232-a95c-46d3-ba4f-92c66a6ad209 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:32:54.260690 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211d6232-a95c-46d3-ba4f-92c66a6ad209 None None] PATH_INFO: `/` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:32:54.262233 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 30/59] 10.222.0.65 () {54 vars in 927 bytes} [Thu Oct 27 09:32:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 09:32:54.280285 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d555299-a9be-4279-b232-2eea8e5922dc None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:32:54.280926 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d555299-a9be-4279-b232-2eea8e5922dc None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:32:54.281436 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d555299-a9be-4279-b232-2eea8e5922dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:32:54.317228 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-8d555299-a9be-4279-b232-2eea8e5922dc None None] MFA Rules not processed for user `b5065084bf664b99bdeac46067cb0f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:32:54.318811 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-8d555299-a9be-4279-b232-2eea8e5922dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:32:54.353000 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:32:54.414159 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 30/60] 10.222.0.65 () {58 vars in 1024 bytes} [Thu Oct 27 09:32:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 27 09:32:54.554328 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211d6232-a95c-46d3-ba4f-92c66a6ad209 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:32:54.645227 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d555299-a9be-4279-b232-2eea8e5922dc None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:32:54.672999 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211d6232-a95c-46d3-ba4f-92c66a6ad209 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:32:54.692071 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:32:54.710550 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb499e7b-8160-48b2-9002-4ccf193cdae1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:32:54.711373 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb499e7b-8160-48b2-9002-4ccf193cdae1 None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:32:54.711663 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb499e7b-8160-48b2-9002-4ccf193cdae1 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:32:54.711944 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb499e7b-8160-48b2-9002-4ccf193cdae1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:32:54.723942 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb499e7b-8160-48b2-9002-4ccf193cdae1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 09:32:54.730062 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application [None req-eb499e7b-8160-48b2-9002-4ccf193cdae1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 27 09:32:54.730062 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 09:32:54.730062 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 09:32:54.730062 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 09:32:54.730062 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 09:32:54.730062 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 09:32:54.730062 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 09:32:54.730062 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 09:32:54.730062 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 09:32:54.730062 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 09:32:54.730062 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 09:32:54.730062 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 09:32:54.730062 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 27 09:32:54.730062 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 27 09:32:54.730062 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 27 09:32:54.730062 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 27 09:32:54.731193 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 27 09:32:54.731193 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 27 09:32:54.731193 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 27 09:32:54.731193 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 27 09:32:54.731193 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 09:32:54.731193 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 09:32:54.731193 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 09:32:54.731193 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 09:32:54.731193 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 09:32:54.731193 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 09:32:54.731193 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 09:32:54.731193 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application with Lock( Oct 27 09:32:54.731193 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 09:32:54.731193 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._enter() Oct 27 09:32:54.731193 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 09:32:54.731193 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 09:32:54.732095 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 09:32:54.732095 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.creator() Oct 27 09:32:54.732095 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 09:32:54.732095 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application created_value = creator( Oct 27 09:32:54.732095 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 27 09:32:54.732095 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 27 09:32:54.732095 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 27 09:32:54.732095 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 27 09:32:54.732095 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 27 09:32:54.732095 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 27 09:32:54.732095 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 27 09:32:54.732095 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application Oct 27 09:32:54.735196 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 31/61] 10.222.0.65 () {56 vars in 1099 bytes} [Thu Oct 27 09:32:54 2022] GET /identity/v3/roles/member => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 09:32:54.737024 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045832ba-31dd-47ad-b4ee-1cf10866b665 None None] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:32:54.737477 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045832ba-31dd-47ad-b4ee-1cf10866b665 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:32:54.737896 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045832ba-31dd-47ad-b4ee-1cf10866b665 None None] PATH_INFO: `/` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:32:54.739506 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 32/62] 10.222.0.65 () {54 vars in 927 bytes} [Thu Oct 27 09:32:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 09:32:54.744754 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fce500a-2ec6-47a9-9060-520c7d99a78d None None] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:32:54.744754 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fce500a-2ec6-47a9-9060-520c7d99a78d None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:32:54.745021 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fce500a-2ec6-47a9-9060-520c7d99a78d None None] PATH_INFO: `/` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:32:54.747184 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 33/63] 10.222.0.65 () {54 vars in 927 bytes} [Thu Oct 27 09:32:54 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 09:32:54.747321 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fce500a-2ec6-47a9-9060-520c7d99a78d None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:32:54.868854 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fce500a-2ec6-47a9-9060-520c7d99a78d None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:32:54.898657 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d555299-a9be-4279-b232-2eea8e5922dc None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:32:54.904508 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfbfef2-af72-4245-bf1d-b4167a080f74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:32:54.905125 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfbfef2-af72-4245-bf1d-b4167a080f74 None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:32:54.905412 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfbfef2-af72-4245-bf1d-b4167a080f74 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:32:54.905697 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfbfef2-af72-4245-bf1d-b4167a080f74 None admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:32:54.906419 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfbfef2-af72-4245-bf1d-b4167a080f74 None admin] RBAC: Adding query filter params (name=member) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 09:32:54.906851 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfbfef2-af72-4245-bf1d-b4167a080f74 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:32:54.908264 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfbfef2-af72-4245-bf1d-b4167a080f74 None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:32:54.917037 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 34/64] 10.222.0.65 () {56 vars in 1101 bytes} [Thu Oct 27 09:32:54 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 09:32:54.918316 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9e68d5-c3bb-4f32-a8d3-dca615ba0632 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:32:54.918663 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9e68d5-c3bb-4f32-a8d3-dca615ba0632 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:32:54.918928 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9e68d5-c3bb-4f32-a8d3-dca615ba0632 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:32:54.936894 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf41325-ff58-40f4-aa46-acbcfe239a08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:32:54.937380 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-fe9e68d5-c3bb-4f32-a8d3-dca615ba0632 None None] MFA Rules not processed for user `b5065084bf664b99bdeac46067cb0f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:32:54.937502 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf41325-ff58-40f4-aa46-acbcfe239a08 None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:32:54.938269 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf41325-ff58-40f4-aa46-acbcfe239a08 None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:32:54.938576 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf41325-ff58-40f4-aa46-acbcfe239a08 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:32:54.939393 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-fe9e68d5-c3bb-4f32-a8d3-dca615ba0632 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:32:54.949942 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf41325-ff58-40f4-aa46-acbcfe239a08 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 09:32:54.957040 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application [None req-cdf41325-ff58-40f4-aa46-acbcfe239a08 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 27 09:32:54.957040 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 09:32:54.957040 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 09:32:54.957040 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 09:32:54.957040 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 09:32:54.957040 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 09:32:54.957040 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 09:32:54.957040 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 09:32:54.957040 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 09:32:54.957040 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 09:32:54.957040 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 09:32:54.957040 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 09:32:54.957040 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 27 09:32:54.957040 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 27 09:32:54.957040 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 27 09:32:54.957040 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 27 09:32:54.957863 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 27 09:32:54.957863 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 27 09:32:54.957863 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 27 09:32:54.957863 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 27 09:32:54.957863 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 09:32:54.957863 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 09:32:54.957863 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 09:32:54.957863 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 09:32:54.957863 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 09:32:54.957863 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 09:32:54.957863 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 09:32:54.957863 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application with Lock( Oct 27 09:32:54.957863 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 09:32:54.957863 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._enter() Oct 27 09:32:54.957863 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 09:32:54.957863 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 09:32:54.958860 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 09:32:54.958860 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.creator() Oct 27 09:32:54.958860 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 09:32:54.958860 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application created_value = creator( Oct 27 09:32:54.958860 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 27 09:32:54.958860 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 27 09:32:54.958860 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 27 09:32:54.958860 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 27 09:32:54.958860 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 27 09:32:54.958860 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 27 09:32:54.958860 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 27 09:32:54.958860 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application Oct 27 09:32:54.958860 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 31/65] 10.222.0.65 () {56 vars in 1096 bytes} [Thu Oct 27 09:32:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 313 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 27 09:32:54.960136 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362b0437-fef7-468c-b80f-f0435fcd3751 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:32:54.960136 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362b0437-fef7-468c-b80f-f0435fcd3751 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:32:54.960136 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362b0437-fef7-468c-b80f-f0435fcd3751 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:32:54.976715 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:32:54.977491 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-362b0437-fef7-468c-b80f-f0435fcd3751 None None] MFA Rules not processed for user `b5065084bf664b99bdeac46067cb0f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:32:54.978732 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-362b0437-fef7-468c-b80f-f0435fcd3751 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:32:54.995944 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:32:55.010600 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 35/66] 10.222.0.65 () {58 vars in 1024 bytes} [Thu Oct 27 09:32:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 27 09:32:55.015525 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9e68d5-c3bb-4f32-a8d3-dca615ba0632 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:32:55.047837 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 32/67] 10.222.0.65 () {58 vars in 1024 bytes} [Thu Oct 27 09:32:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 27 09:32:55.048692 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362b0437-fef7-468c-b80f-f0435fcd3751 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:32:55.131048 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9e68d5-c3bb-4f32-a8d3-dca615ba0632 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:32:55.166897 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a25763-eaed-43ac-a79e-2a3b3e9a95bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:32:55.167860 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a25763-eaed-43ac-a79e-2a3b3e9a95bf None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:32:55.168332 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a25763-eaed-43ac-a79e-2a3b3e9a95bf None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:32:55.168796 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a25763-eaed-43ac-a79e-2a3b3e9a95bf None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:32:55.170897 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362b0437-fef7-468c-b80f-f0435fcd3751 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:32:55.180749 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a25763-eaed-43ac-a79e-2a3b3e9a95bf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 09:32:55.185902 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application [None req-e8a25763-eaed-43ac-a79e-2a3b3e9a95bf None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 27 09:32:55.185902 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 09:32:55.185902 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 09:32:55.185902 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 09:32:55.185902 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 09:32:55.185902 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 09:32:55.185902 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 09:32:55.185902 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 09:32:55.185902 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 09:32:55.185902 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 09:32:55.185902 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 09:32:55.185902 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 09:32:55.185902 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 27 09:32:55.185902 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 27 09:32:55.185902 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 27 09:32:55.185902 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 27 09:32:55.186755 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 27 09:32:55.186755 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 27 09:32:55.186755 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 27 09:32:55.186755 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 27 09:32:55.186755 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 09:32:55.186755 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 09:32:55.186755 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 09:32:55.186755 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 09:32:55.186755 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 09:32:55.186755 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 09:32:55.186755 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 09:32:55.186755 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application with Lock( Oct 27 09:32:55.186755 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 09:32:55.186755 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._enter() Oct 27 09:32:55.186755 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 09:32:55.186755 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 09:32:55.187630 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 09:32:55.187630 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.creator() Oct 27 09:32:55.187630 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 09:32:55.187630 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application created_value = creator( Oct 27 09:32:55.187630 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 27 09:32:55.187630 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 27 09:32:55.187630 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 27 09:32:55.187630 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 27 09:32:55.187630 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 27 09:32:55.187630 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 27 09:32:55.187630 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 27 09:32:55.187630 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application Oct 27 09:32:55.189844 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 36/68] 10.222.0.65 () {56 vars in 1114 bytes} [Thu Oct 27 09:32:55 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 09:32:55.190947 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a25763-eaed-43ac-a79e-2a3b3e9a95bf None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:32:55.217166 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2c9978-8c94-4f9c-bcff-0bf2f72c4f8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:32:55.217963 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2c9978-8c94-4f9c-bcff-0bf2f72c4f8e None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:32:55.218232 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2c9978-8c94-4f9c-bcff-0bf2f72c4f8e None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:32:55.218529 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2c9978-8c94-4f9c-bcff-0bf2f72c4f8e None admin] PATH_INFO: `/v3/users/25440275d47c4aacb7bdf0ee93b382f3` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:32:55.223923 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:32:55.236453 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2c9978-8c94-4f9c-bcff-0bf2f72c4f8e None admin] RBAC: Authorizing `identity:get_user(user_id=25440275d47c4aacb7bdf0ee93b382f3)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:32:55.237955 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2c9978-8c94-4f9c-bcff-0bf2f72c4f8e None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:32:55.239909 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 33/69] 10.222.0.65 () {56 vars in 1177 bytes} [Thu Oct 27 09:32:55 2022] GET /identity/v3/users/25440275d47c4aacb7bdf0ee93b382f3 => generated 275 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 09:32:55.240770 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2c9978-8c94-4f9c-bcff-0bf2f72c4f8e None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:32:55.254772 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:32:55.302313 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a25763-eaed-43ac-a79e-2a3b3e9a95bf None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:32:55.338315 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb138c6-6e2b-45a3-8deb-384d1e7d308b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:32:55.338951 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb138c6-6e2b-45a3-8deb-384d1e7d308b None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:32:55.339234 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb138c6-6e2b-45a3-8deb-384d1e7d308b None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:32:55.339510 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb138c6-6e2b-45a3-8deb-384d1e7d308b None admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:32:55.340171 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb138c6-6e2b-45a3-8deb-384d1e7d308b None admin] RBAC: Adding query filter params (name=admin) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 09:32:55.340478 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb138c6-6e2b-45a3-8deb-384d1e7d308b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:32:55.341874 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb138c6-6e2b-45a3-8deb-384d1e7d308b None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:32:55.350251 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2c9978-8c94-4f9c-bcff-0bf2f72c4f8e None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:32:55.350765 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 37/70] 10.222.0.65 () {56 vars in 1099 bytes} [Thu Oct 27 09:32:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 09:32:55.355489 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb138c6-6e2b-45a3-8deb-384d1e7d308b None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:32:55.392211 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746a3d99-f9de-41bc-a655-6ad98b850a91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:32:55.392821 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746a3d99-f9de-41bc-a655-6ad98b850a91 None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:32:55.393107 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746a3d99-f9de-41bc-a655-6ad98b850a91 None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:32:55.393385 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746a3d99-f9de-41bc-a655-6ad98b850a91 None admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:32:55.394057 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746a3d99-f9de-41bc-a655-6ad98b850a91 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 09:32:55.394360 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746a3d99-f9de-41bc-a655-6ad98b850a91 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:32:55.395832 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746a3d99-f9de-41bc-a655-6ad98b850a91 None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:32:55.404133 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 34/71] 10.222.0.65 () {56 vars in 1111 bytes} [Thu Oct 27 09:32:55 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 09:32:55.404937 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746a3d99-f9de-41bc-a655-6ad98b850a91 None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:32:55.460122 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:32:55.468753 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb138c6-6e2b-45a3-8deb-384d1e7d308b None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:32:55.484215 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:32:55.504661 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9569e4b7-7674-4e38-a559-499ad66534dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:32:55.505348 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9569e4b7-7674-4e38-a559-499ad66534dc None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:32:55.505637 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9569e4b7-7674-4e38-a559-499ad66534dc None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:32:55.505937 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9569e4b7-7674-4e38-a559-499ad66534dc None admin] PATH_INFO: `/v3/projects/a2e51b2800f14e7fa67e9bed4cc6498b` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:32:55.507104 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9569e4b7-7674-4e38-a559-499ad66534dc None admin] RBAC: Authorizing `identity:get_project(project_id=a2e51b2800f14e7fa67e9bed4cc6498b)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:32:55.508614 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9569e4b7-7674-4e38-a559-499ad66534dc None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:32:55.510275 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 38/72] 10.222.0.65 () {56 vars in 1186 bytes} [Thu Oct 27 09:32:55 2022] GET /identity/v3/projects/a2e51b2800f14e7fa67e9bed4cc6498b => generated 298 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 09:32:55.511086 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9569e4b7-7674-4e38-a559-499ad66534dc None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:32:55.513528 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746a3d99-f9de-41bc-a655-6ad98b850a91 None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:32:55.549313 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e88c0e-9762-4682-be9b-6f57e52ef57d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:32:55.549944 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e88c0e-9762-4682-be9b-6f57e52ef57d None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:32:55.550233 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e88c0e-9762-4682-be9b-6f57e52ef57d None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:32:55.550505 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e88c0e-9762-4682-be9b-6f57e52ef57d None admin] PATH_INFO: `/v3/domains/default` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:32:55.551647 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e88c0e-9762-4682-be9b-6f57e52ef57d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:32:55.553102 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e88c0e-9762-4682-be9b-6f57e52ef57d None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:32:55.554696 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 35/73] 10.222.0.65 () {56 vars in 1108 bytes} [Thu Oct 27 09:32:55 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 09:32:55.555495 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e88c0e-9762-4682-be9b-6f57e52ef57d None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:32:55.625957 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9569e4b7-7674-4e38-a559-499ad66534dc None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:32:55.657687 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e88c0e-9762-4682-be9b-6f57e52ef57d None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:32:55.659924 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7172934f-a03e-4d33-ba4a-19e3c2e34274 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:32:55.660565 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7172934f-a03e-4d33-ba4a-19e3c2e34274 None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:32:55.660851 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7172934f-a03e-4d33-ba4a-19e3c2e34274 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:32:55.661131 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7172934f-a03e-4d33-ba4a-19e3c2e34274 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:32:55.671292 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7172934f-a03e-4d33-ba4a-19e3c2e34274 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 09:32:55.676761 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application [None req-7172934f-a03e-4d33-ba4a-19e3c2e34274 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 27 09:32:55.676761 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 09:32:55.676761 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 09:32:55.676761 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 09:32:55.676761 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 09:32:55.676761 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 09:32:55.676761 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 09:32:55.676761 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 09:32:55.676761 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 09:32:55.676761 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 09:32:55.676761 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 09:32:55.676761 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 09:32:55.676761 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 27 09:32:55.676761 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 27 09:32:55.676761 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 27 09:32:55.676761 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 27 09:32:55.677758 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 27 09:32:55.677758 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 27 09:32:55.677758 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 27 09:32:55.677758 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 27 09:32:55.677758 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 09:32:55.677758 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 09:32:55.677758 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 09:32:55.677758 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 09:32:55.677758 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 09:32:55.677758 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 09:32:55.677758 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 09:32:55.677758 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application with Lock( Oct 27 09:32:55.677758 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 09:32:55.677758 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._enter() Oct 27 09:32:55.677758 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 09:32:55.677758 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 09:32:55.678563 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 09:32:55.678563 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.creator() Oct 27 09:32:55.678563 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 09:32:55.678563 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application created_value = creator( Oct 27 09:32:55.678563 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 27 09:32:55.678563 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 27 09:32:55.678563 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 27 09:32:55.678563 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 27 09:32:55.678563 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 27 09:32:55.678563 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 27 09:32:55.678563 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 27 09:32:55.678563 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application Oct 27 09:32:55.678563 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 39/74] 10.222.0.65 () {56 vars in 1099 bytes} [Thu Oct 27 09:32:55 2022] GET /identity/v3/roles/member => generated 84 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 09:32:55.679205 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7172934f-a03e-4d33-ba4a-19e3c2e34274 None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:32:55.693911 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a10ab7-5d10-4c28-a8ef-5445752e4e99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:32:55.694585 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a10ab7-5d10-4c28-a8ef-5445752e4e99 None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:32:55.694880 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a10ab7-5d10-4c28-a8ef-5445752e4e99 None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:32:55.695158 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a10ab7-5d10-4c28-a8ef-5445752e4e99 None admin] PATH_INFO: `/v3/users/b5065084bf664b99bdeac46067cb0f0b` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:32:55.696316 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a10ab7-5d10-4c28-a8ef-5445752e4e99 None admin] RBAC: Authorizing `identity:get_user(user_id=b5065084bf664b99bdeac46067cb0f0b)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:32:55.697757 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a10ab7-5d10-4c28-a8ef-5445752e4e99 None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:32:55.699377 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 36/75] 10.222.0.65 () {56 vars in 1177 bytes} [Thu Oct 27 09:32:55 2022] GET /identity/v3/users/b5065084bf664b99bdeac46067cb0f0b => generated 247 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 09:32:55.700116 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a10ab7-5d10-4c28-a8ef-5445752e4e99 None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:32:55.700806 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:32:55.713531 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:32:55.785381 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7172934f-a03e-4d33-ba4a-19e3c2e34274 None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:32:55.806022 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a10ab7-5d10-4c28-a8ef-5445752e4e99 None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:32:55.819628 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80624c37-0e7d-4a71-8912-f1bf5d673e46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:32:55.820274 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80624c37-0e7d-4a71-8912-f1bf5d673e46 None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:32:55.820560 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80624c37-0e7d-4a71-8912-f1bf5d673e46 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:32:55.820843 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80624c37-0e7d-4a71-8912-f1bf5d673e46 None admin] PATH_INFO: `/v3/users/25440275d47c4aacb7bdf0ee93b382f3` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:32:55.822027 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80624c37-0e7d-4a71-8912-f1bf5d673e46 None admin] RBAC: Authorizing `identity:get_user(user_id=25440275d47c4aacb7bdf0ee93b382f3)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:32:55.823586 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80624c37-0e7d-4a71-8912-f1bf5d673e46 None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:32:55.825197 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 40/76] 10.222.0.65 () {56 vars in 1177 bytes} [Thu Oct 27 09:32:55 2022] GET /identity/v3/users/25440275d47c4aacb7bdf0ee93b382f3 => generated 275 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 09:32:55.825944 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80624c37-0e7d-4a71-8912-f1bf5d673e46 None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:32:55.843978 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5877816c-e2ad-495e-a324-2d8b71656dc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:32:55.844879 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5877816c-e2ad-495e-a324-2d8b71656dc5 None admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:32:55.845165 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5877816c-e2ad-495e-a324-2d8b71656dc5 None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:32:55.845438 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5877816c-e2ad-495e-a324-2d8b71656dc5 None admin] PATH_INFO: `/v3/projects/a2e51b2800f14e7fa67e9bed4cc6498b/users/25440275d47c4aacb7bdf0ee93b382f3/roles/43543ce1450245af9661cb017bac17bd` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:32:55.847464 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5877816c-e2ad-495e-a324-2d8b71656dc5 None admin] RBAC: Authorizing `identity:create_grant(project_id=a2e51b2800f14e7fa67e9bed4cc6498b, user_id=25440275d47c4aacb7bdf0ee93b382f3, role_id=43543ce1450245af9661cb017bac17bd)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:32:55.848897 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5877816c-e2ad-495e-a324-2d8b71656dc5 None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:32:55.918484 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:32:55.931794 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80624c37-0e7d-4a71-8912-f1bf5d673e46 None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:32:55.935077 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 37/77] 10.222.0.65 () {58 vars in 1439 bytes} [Thu Oct 27 09:32:55 2022] PUT /identity/v3/projects/a2e51b2800f14e7fa67e9bed4cc6498b/users/25440275d47c4aacb7bdf0ee93b382f3/roles/43543ce1450245af9661cb017bac17bd => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 09:32:55.943337 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5877816c-e2ad-495e-a324-2d8b71656dc5 None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:32:55.972004 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f372ce-26b5-4851-a239-0251e976bac2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:32:55.972557 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f372ce-26b5-4851-a239-0251e976bac2 None admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:32:55.972848 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f372ce-26b5-4851-a239-0251e976bac2 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:32:55.973148 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f372ce-26b5-4851-a239-0251e976bac2 None admin] PATH_INFO: `/v3/users` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:32:55.973811 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f372ce-26b5-4851-a239-0251e976bac2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:32:55.975398 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f372ce-26b5-4851-a239-0251e976bac2 None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:32:56.029444 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:32:56.067933 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5877816c-e2ad-495e-a324-2d8b71656dc5 None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:32:56.096295 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 41/78] 10.222.0.65 () {60 vars in 1132 bytes} [Thu Oct 27 09:32:55 2022] POST /identity/v3/users => generated 289 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 09:32:56.097234 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f372ce-26b5-4851-a239-0251e976bac2 None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:32:56.119572 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff9d9aa-af7b-44b8-b6a2-8dd676e4744f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:32:56.119572 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff9d9aa-af7b-44b8-b6a2-8dd676e4744f None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:32:56.119858 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff9d9aa-af7b-44b8-b6a2-8dd676e4744f None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:32:56.120120 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff9d9aa-af7b-44b8-b6a2-8dd676e4744f None admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:32:56.120693 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff9d9aa-af7b-44b8-b6a2-8dd676e4744f None admin] RBAC: Adding query filter params (name=member) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 09:32:56.121005 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff9d9aa-af7b-44b8-b6a2-8dd676e4744f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:32:56.122453 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff9d9aa-af7b-44b8-b6a2-8dd676e4744f None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:32:56.132320 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 38/79] 10.222.0.65 () {56 vars in 1101 bytes} [Thu Oct 27 09:32:55 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 09:32:56.133335 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff9d9aa-af7b-44b8-b6a2-8dd676e4744f None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:32:56.244298 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f372ce-26b5-4851-a239-0251e976bac2 None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:32:56.271764 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff9d9aa-af7b-44b8-b6a2-8dd676e4744f None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:32:56.284218 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05fd057-ad42-4de3-864d-a35162415181 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:32:56.284876 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05fd057-ad42-4de3-864d-a35162415181 None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:32:56.285181 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05fd057-ad42-4de3-864d-a35162415181 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:32:56.285451 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05fd057-ad42-4de3-864d-a35162415181 None admin] PATH_INFO: `/v3/projects/a2e51b2800f14e7fa67e9bed4cc6498b` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:32:56.286871 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05fd057-ad42-4de3-864d-a35162415181 None admin] RBAC: Authorizing `identity:get_project(project_id=a2e51b2800f14e7fa67e9bed4cc6498b)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:32:56.288538 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05fd057-ad42-4de3-864d-a35162415181 None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:32:56.290390 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 42/80] 10.222.0.65 () {56 vars in 1186 bytes} [Thu Oct 27 09:32:56 2022] GET /identity/v3/projects/a2e51b2800f14e7fa67e9bed4cc6498b => generated 298 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 09:32:56.291312 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05fd057-ad42-4de3-864d-a35162415181 None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:32:56.311621 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:32:56.319587 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:32:56.331128 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2eff3ac-b78e-4d9f-a903-d485be737c6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:32:56.332153 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2eff3ac-b78e-4d9f-a903-d485be737c6f None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:32:56.332439 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2eff3ac-b78e-4d9f-a903-d485be737c6f None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:32:56.332836 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2eff3ac-b78e-4d9f-a903-d485be737c6f None admin] PATH_INFO: `/v3/projects/a2e51b2800f14e7fa67e9bed4cc6498b` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:32:56.334938 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2eff3ac-b78e-4d9f-a903-d485be737c6f None admin] RBAC: Authorizing `identity:get_project(project_id=a2e51b2800f14e7fa67e9bed4cc6498b)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:32:56.336426 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2eff3ac-b78e-4d9f-a903-d485be737c6f None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:32:56.338469 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 39/81] 10.222.0.65 () {56 vars in 1186 bytes} [Thu Oct 27 09:32:56 2022] GET /identity/v3/projects/a2e51b2800f14e7fa67e9bed4cc6498b => generated 298 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 09:32:56.339049 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2eff3ac-b78e-4d9f-a903-d485be737c6f None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:32:56.424351 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05fd057-ad42-4de3-864d-a35162415181 None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:32:56.471044 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77407bdb-7058-40a3-9dba-42f44f9a10a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:32:56.471713 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77407bdb-7058-40a3-9dba-42f44f9a10a2 None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:32:56.472004 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77407bdb-7058-40a3-9dba-42f44f9a10a2 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:32:56.472297 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77407bdb-7058-40a3-9dba-42f44f9a10a2 None admin] PATH_INFO: `/v3/users/25440275d47c4aacb7bdf0ee93b382f3` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:32:56.473632 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77407bdb-7058-40a3-9dba-42f44f9a10a2 None admin] RBAC: Authorizing `identity:get_user(user_id=25440275d47c4aacb7bdf0ee93b382f3)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:32:56.475127 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77407bdb-7058-40a3-9dba-42f44f9a10a2 None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:32:56.481577 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 43/82] 10.222.0.65 () {56 vars in 1177 bytes} [Thu Oct 27 09:32:56 2022] GET /identity/v3/users/25440275d47c4aacb7bdf0ee93b382f3 => generated 275 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 09:32:56.481577 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77407bdb-7058-40a3-9dba-42f44f9a10a2 None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:32:56.484316 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2eff3ac-b78e-4d9f-a903-d485be737c6f None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:32:56.524524 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0600d99d-739d-41db-a767-a58f0ab0a1ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:32:56.525529 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0600d99d-739d-41db-a767-a58f0ab0a1ba None admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:32:56.526066 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0600d99d-739d-41db-a767-a58f0ab0a1ba None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:32:56.526561 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0600d99d-739d-41db-a767-a58f0ab0a1ba None admin] PATH_INFO: `/v3/projects/a2e51b2800f14e7fa67e9bed4cc6498b/users/b5065084bf664b99bdeac46067cb0f0b/roles/6ad17b9f9dea4b66ab2da3677d7e715d` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:32:56.528747 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0600d99d-739d-41db-a767-a58f0ab0a1ba None admin] RBAC: Authorizing `identity:create_grant(project_id=a2e51b2800f14e7fa67e9bed4cc6498b, user_id=b5065084bf664b99bdeac46067cb0f0b, role_id=6ad17b9f9dea4b66ab2da3677d7e715d)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:32:56.530744 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0600d99d-739d-41db-a767-a58f0ab0a1ba None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:32:56.575204 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:32:56.596368 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77407bdb-7058-40a3-9dba-42f44f9a10a2 None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:32:56.634553 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96917466-ab09-4787-a523-9ba5adf9fe80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:32:56.635243 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96917466-ab09-4787-a523-9ba5adf9fe80 None admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:32:56.635536 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96917466-ab09-4787-a523-9ba5adf9fe80 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:32:56.635931 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96917466-ab09-4787-a523-9ba5adf9fe80 None admin] PATH_INFO: `/v3/projects/a2e51b2800f14e7fa67e9bed4cc6498b/users/25440275d47c4aacb7bdf0ee93b382f3/roles/438ff415f4f644afb2cc60293cc13741` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:32:56.638202 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96917466-ab09-4787-a523-9ba5adf9fe80 None admin] RBAC: Authorizing `identity:create_grant(project_id=a2e51b2800f14e7fa67e9bed4cc6498b, user_id=25440275d47c4aacb7bdf0ee93b382f3, role_id=438ff415f4f644afb2cc60293cc13741)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:32:56.639725 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96917466-ab09-4787-a523-9ba5adf9fe80 None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:32:56.704841 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 40/83] 10.222.0.65 () {58 vars in 1439 bytes} [Thu Oct 27 09:32:56 2022] PUT /identity/v3/projects/a2e51b2800f14e7fa67e9bed4cc6498b/users/b5065084bf664b99bdeac46067cb0f0b/roles/6ad17b9f9dea4b66ab2da3677d7e715d => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 09:32:56.706003 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0600d99d-739d-41db-a767-a58f0ab0a1ba None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:32:56.740153 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 44/84] 10.222.0.65 () {58 vars in 1439 bytes} [Thu Oct 27 09:32:56 2022] PUT /identity/v3/projects/a2e51b2800f14e7fa67e9bed4cc6498b/users/25440275d47c4aacb7bdf0ee93b382f3/roles/438ff415f4f644afb2cc60293cc13741 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 09:32:56.810585 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:32:56.881862 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0600d99d-739d-41db-a767-a58f0ab0a1ba None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:32:56.934148 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f077f8f-cce1-44cd-892a-f048fc000375 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:32:56.935245 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f077f8f-cce1-44cd-892a-f048fc000375 None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:32:56.935769 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f077f8f-cce1-44cd-892a-f048fc000375 None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:32:56.936268 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f077f8f-cce1-44cd-892a-f048fc000375 None admin] PATH_INFO: `/v3/projects/769c98ced9de4755bd4318f3fbee6001` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:32:56.939103 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f077f8f-cce1-44cd-892a-f048fc000375 None admin] RBAC: Authorizing `identity:get_project(project_id=769c98ced9de4755bd4318f3fbee6001)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:32:56.941025 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f077f8f-cce1-44cd-892a-f048fc000375 None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:32:56.943577 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 41/85] 10.222.0.65 () {56 vars in 1186 bytes} [Thu Oct 27 09:32:56 2022] GET /identity/v3/projects/769c98ced9de4755bd4318f3fbee6001 => generated 312 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 09:32:56.949076 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96917466-ab09-4787-a523-9ba5adf9fe80 None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:32:57.072468 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96917466-ab09-4787-a523-9ba5adf9fe80 None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:32:57.112163 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc43102-7e03-4f5d-b7ce-1c91e31f5fb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:32:57.112859 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc43102-7e03-4f5d-b7ce-1c91e31f5fb6 None admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:32:57.113145 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc43102-7e03-4f5d-b7ce-1c91e31f5fb6 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:32:57.113518 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc43102-7e03-4f5d-b7ce-1c91e31f5fb6 None admin] PATH_INFO: `/v3/projects/769c98ced9de4755bd4318f3fbee6001/users/25440275d47c4aacb7bdf0ee93b382f3/roles/43543ce1450245af9661cb017bac17bd` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:32:57.115774 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc43102-7e03-4f5d-b7ce-1c91e31f5fb6 None admin] RBAC: Authorizing `identity:create_grant(project_id=769c98ced9de4755bd4318f3fbee6001, user_id=25440275d47c4aacb7bdf0ee93b382f3, role_id=43543ce1450245af9661cb017bac17bd)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:32:57.117230 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc43102-7e03-4f5d-b7ce-1c91e31f5fb6 None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:32:57.232270 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:32:57.236808 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 45/86] 10.222.0.65 () {58 vars in 1439 bytes} [Thu Oct 27 09:32:56 2022] PUT /identity/v3/projects/769c98ced9de4755bd4318f3fbee6001/users/25440275d47c4aacb7bdf0ee93b382f3/roles/43543ce1450245af9661cb017bac17bd => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 09:32:59.209758 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9886d26c-d291-4f92-b9ec-c5d5e10d40b2 None None] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:32:59.210851 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9886d26c-d291-4f92-b9ec-c5d5e10d40b2 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:32:59.211356 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9886d26c-d291-4f92-b9ec-c5d5e10d40b2 None None] PATH_INFO: `/` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:32:59.212913 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 42/87] 10.222.0.65 () {54 vars in 927 bytes} [Thu Oct 27 09:32:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 09:32:59.218411 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc8e78f-71f4-4030-8909-51cf4405a455 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:32:59.218904 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc8e78f-71f4-4030-8909-51cf4405a455 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:32:59.219264 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc8e78f-71f4-4030-8909-51cf4405a455 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:32:59.248318 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-7bc8e78f-71f4-4030-8909-51cf4405a455 None None] MFA Rules not processed for user `b5065084bf664b99bdeac46067cb0f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:32:59.249514 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-7bc8e78f-71f4-4030-8909-51cf4405a455 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:32:59.330044 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7112dd2-45ae-40a1-9cb1-20177f23cf52 None None] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:32:59.330729 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7112dd2-45ae-40a1-9cb1-20177f23cf52 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:32:59.331225 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7112dd2-45ae-40a1-9cb1-20177f23cf52 None None] PATH_INFO: `/` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:32:59.331473 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 46/88] 10.222.0.65 () {58 vars in 1024 bytes} [Thu Oct 27 09:32:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 27 09:32:59.332948 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 43/89] 10.222.0.65 () {54 vars in 927 bytes} [Thu Oct 27 09:32:59 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 09:32:59.351001 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cc577e-c424-4bd8-b4d8-83bd6ae07c78 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:32:59.351318 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cc577e-c424-4bd8-b4d8-83bd6ae07c78 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:32:59.351565 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cc577e-c424-4bd8-b4d8-83bd6ae07c78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:32:59.382052 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-94cc577e-c424-4bd8-b4d8-83bd6ae07c78 None None] MFA Rules not processed for user `b5065084bf664b99bdeac46067cb0f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:32:59.383341 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-94cc577e-c424-4bd8-b4d8-83bd6ae07c78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:32:59.473775 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 47/90] 10.222.0.65 () {58 vars in 1024 bytes} [Thu Oct 27 09:32:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 27 09:32:59.522768 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a0da3e-ec21-4be4-956c-d09a5ffebf77 None None] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:32:59.523080 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a0da3e-ec21-4be4-956c-d09a5ffebf77 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:32:59.523321 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a0da3e-ec21-4be4-956c-d09a5ffebf77 None None] PATH_INFO: `/` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:32:59.527008 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 44/91] 10.222.0.65 () {54 vars in 927 bytes} [Thu Oct 27 09:32:59 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 09:32:59.530042 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce6d050-503f-4632-883c-ede0453636ce None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:32:59.530336 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce6d050-503f-4632-883c-ede0453636ce None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:32:59.530646 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce6d050-503f-4632-883c-ede0453636ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:32:59.559581 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-4ce6d050-503f-4632-883c-ede0453636ce None None] MFA Rules not processed for user `b5065084bf664b99bdeac46067cb0f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:32:59.560839 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-4ce6d050-503f-4632-883c-ede0453636ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:32:59.612341 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f8669f-2f8e-4367-bff2-ee06c214a8a2 None None] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:32:59.612681 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f8669f-2f8e-4367-bff2-ee06c214a8a2 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:32:59.612894 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f8669f-2f8e-4367-bff2-ee06c214a8a2 None None] PATH_INFO: `/` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:32:59.614477 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 45/92] 10.222.0.65 () {54 vars in 927 bytes} [Thu Oct 27 09:32:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 09:32:59.620139 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c418f09-0a96-4f1e-b78e-88e7f708367e None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:32:59.620425 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c418f09-0a96-4f1e-b78e-88e7f708367e None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:32:59.620704 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c418f09-0a96-4f1e-b78e-88e7f708367e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:32:59.648038 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-2c418f09-0a96-4f1e-b78e-88e7f708367e None None] MFA Rules not processed for user `b5065084bf664b99bdeac46067cb0f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:32:59.649293 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-2c418f09-0a96-4f1e-b78e-88e7f708367e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:32:59.761756 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:32:59.772096 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 46/93] 10.222.0.65 () {58 vars in 1024 bytes} [Thu Oct 27 09:32:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 27 09:32:59.774042 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c418f09-0a96-4f1e-b78e-88e7f708367e None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:32:59.786334 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 48/94] 10.222.0.65 () {58 vars in 1024 bytes} [Thu Oct 27 09:32:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 27 09:32:59.839185 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:32:59.902067 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c418f09-0a96-4f1e-b78e-88e7f708367e None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:32:59.938851 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce6d050-503f-4632-883c-ede0453636ce None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:32:59.964383 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db1a15d-4d06-4f7d-afb0-949f22e779e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:32:59.965039 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db1a15d-4d06-4f7d-afb0-949f22e779e0 None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:32:59.965326 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db1a15d-4d06-4f7d-afb0-949f22e779e0 None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:32:59.965607 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db1a15d-4d06-4f7d-afb0-949f22e779e0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:32:59.966990 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db1a15d-4d06-4f7d-afb0-949f22e779e0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:32:59.971142 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db1a15d-4d06-4f7d-afb0-949f22e779e0 None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:32:59.972778 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 47/95] 10.222.0.65 () {56 vars in 1108 bytes} [Thu Oct 27 09:32:59 2022] GET /identity/v3/domains/default => generated 199 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 09:32:59.978388 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db1a15d-4d06-4f7d-afb0-949f22e779e0 None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:33:00.147598 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db1a15d-4d06-4f7d-afb0-949f22e779e0 None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:33:00.182992 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce6d050-503f-4632-883c-ede0453636ce None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:33:00.194543 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:33:00.206730 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec96d5e-fadf-4b1d-b98b-6449f969ef3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:33:00.207679 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec96d5e-fadf-4b1d-b98b-6449f969ef3d None admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:33:00.208152 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec96d5e-fadf-4b1d-b98b-6449f969ef3d None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:33:00.208634 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec96d5e-fadf-4b1d-b98b-6449f969ef3d None admin] PATH_INFO: `/v3/projects` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:33:00.209510 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec96d5e-fadf-4b1d-b98b-6449f969ef3d None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:33:00.211222 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec96d5e-fadf-4b1d-b98b-6449f969ef3d None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:33:00.253722 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99c190e-b23d-4719-a044-b07cba970a6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:33:00.255394 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99c190e-b23d-4719-a044-b07cba970a6b None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:33:00.255394 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99c190e-b23d-4719-a044-b07cba970a6b None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:33:00.255931 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99c190e-b23d-4719-a044-b07cba970a6b None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:33:00.269541 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99c190e-b23d-4719-a044-b07cba970a6b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 09:33:00.274907 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application [None req-d99c190e-b23d-4719-a044-b07cba970a6b None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 27 09:33:00.274907 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 09:33:00.274907 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 09:33:00.274907 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 09:33:00.274907 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 09:33:00.274907 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 09:33:00.274907 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 09:33:00.274907 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 09:33:00.274907 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 09:33:00.274907 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 09:33:00.274907 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 09:33:00.274907 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 09:33:00.274907 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 27 09:33:00.274907 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 27 09:33:00.274907 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 27 09:33:00.274907 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 27 09:33:00.275759 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 27 09:33:00.275759 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 27 09:33:00.275759 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 27 09:33:00.275759 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 27 09:33:00.275759 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 09:33:00.275759 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 09:33:00.275759 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 09:33:00.275759 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 09:33:00.275759 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 09:33:00.275759 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 09:33:00.275759 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 09:33:00.275759 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application with Lock( Oct 27 09:33:00.275759 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 09:33:00.275759 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._enter() Oct 27 09:33:00.275759 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 09:33:00.275759 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 09:33:00.276506 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 09:33:00.276506 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.creator() Oct 27 09:33:00.276506 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 09:33:00.276506 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application created_value = creator( Oct 27 09:33:00.276506 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 27 09:33:00.276506 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 27 09:33:00.276506 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 27 09:33:00.276506 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 27 09:33:00.276506 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 27 09:33:00.276506 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 27 09:33:00.276506 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 27 09:33:00.276506 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application Oct 27 09:33:00.277782 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 49/96] 10.222.0.65 () {56 vars in 1099 bytes} [Thu Oct 27 09:32:59 2022] GET /identity/v3/roles/reader => generated 84 bytes in 339 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 27 09:33:00.282584 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99c190e-b23d-4719-a044-b07cba970a6b None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:33:00.311903 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 48/97] 10.222.0.65 () {60 vars in 1141 bytes} [Thu Oct 27 09:32:59 2022] POST /identity/v3/projects => generated 302 bytes in 334 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 09:33:00.313388 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec96d5e-fadf-4b1d-b98b-6449f969ef3d None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:33:00.354442 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:33:00.414385 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99c190e-b23d-4719-a044-b07cba970a6b None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:33:00.440613 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec96d5e-fadf-4b1d-b98b-6449f969ef3d None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:33:00.455322 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6950c4-a5ed-4107-8fd7-99cc0c6c34f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:33:00.456325 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6950c4-a5ed-4107-8fd7-99cc0c6c34f4 None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:33:00.456807 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6950c4-a5ed-4107-8fd7-99cc0c6c34f4 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:33:00.457296 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6950c4-a5ed-4107-8fd7-99cc0c6c34f4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:33:00.469964 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6950c4-a5ed-4107-8fd7-99cc0c6c34f4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 09:33:00.475785 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application [None req-4f6950c4-a5ed-4107-8fd7-99cc0c6c34f4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 27 09:33:00.475785 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 09:33:00.475785 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 09:33:00.475785 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 09:33:00.475785 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 09:33:00.475785 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 09:33:00.475785 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 09:33:00.475785 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 09:33:00.475785 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 09:33:00.475785 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 09:33:00.475785 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 09:33:00.475785 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 09:33:00.475785 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 27 09:33:00.475785 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 27 09:33:00.475785 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 27 09:33:00.475785 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 27 09:33:00.476725 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 27 09:33:00.476725 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 27 09:33:00.476725 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 27 09:33:00.476725 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 27 09:33:00.476725 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 09:33:00.476725 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 09:33:00.476725 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 09:33:00.476725 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 09:33:00.476725 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 09:33:00.476725 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 09:33:00.476725 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 09:33:00.476725 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application with Lock( Oct 27 09:33:00.476725 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 09:33:00.476725 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._enter() Oct 27 09:33:00.476725 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 09:33:00.476725 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 09:33:00.477449 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 09:33:00.477449 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.creator() Oct 27 09:33:00.477449 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 09:33:00.477449 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application created_value = creator( Oct 27 09:33:00.477449 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 27 09:33:00.477449 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 27 09:33:00.477449 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 27 09:33:00.477449 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 27 09:33:00.477449 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 27 09:33:00.477449 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 27 09:33:00.477449 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 27 09:33:00.477449 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application Oct 27 09:33:00.479723 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 50/98] 10.222.0.65 () {56 vars in 1096 bytes} [Thu Oct 27 09:33:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 09:33:00.480583 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cb7787-85ba-4307-b331-806c133945d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:33:00.480990 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6950c4-a5ed-4107-8fd7-99cc0c6c34f4 None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:33:00.481392 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cb7787-85ba-4307-b331-806c133945d6 None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:33:00.481711 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cb7787-85ba-4307-b331-806c133945d6 None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:33:00.482102 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cb7787-85ba-4307-b331-806c133945d6 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:33:00.495692 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37cb7787-85ba-4307-b331-806c133945d6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 09:33:00.502469 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application [None req-37cb7787-85ba-4307-b331-806c133945d6 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 27 09:33:00.502469 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 09:33:00.502469 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 09:33:00.502469 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 09:33:00.502469 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 09:33:00.502469 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 09:33:00.502469 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 09:33:00.502469 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 09:33:00.502469 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 09:33:00.502469 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 09:33:00.502469 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 09:33:00.502469 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 09:33:00.502469 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 27 09:33:00.502469 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 27 09:33:00.502469 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 27 09:33:00.502469 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 27 09:33:00.503407 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 27 09:33:00.503407 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 27 09:33:00.503407 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 27 09:33:00.503407 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 27 09:33:00.503407 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 09:33:00.503407 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 09:33:00.503407 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 09:33:00.503407 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 09:33:00.503407 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 09:33:00.503407 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 09:33:00.503407 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 09:33:00.503407 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application with Lock( Oct 27 09:33:00.503407 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 09:33:00.503407 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._enter() Oct 27 09:33:00.503407 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 09:33:00.503407 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 09:33:00.504155 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 09:33:00.504155 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.creator() Oct 27 09:33:00.504155 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 09:33:00.504155 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application created_value = creator( Oct 27 09:33:00.504155 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 27 09:33:00.504155 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 27 09:33:00.504155 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 27 09:33:00.504155 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 27 09:33:00.504155 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 27 09:33:00.504155 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 27 09:33:00.504155 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 27 09:33:00.504155 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application Oct 27 09:33:00.504155 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 49/99] 10.222.0.65 () {56 vars in 1099 bytes} [Thu Oct 27 09:33:00 2022] GET /identity/v3/roles/member => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 09:33:00.509565 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cb7787-85ba-4307-b331-806c133945d6 None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:33:00.551438 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:33:00.607737 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6950c4-a5ed-4107-8fd7-99cc0c6c34f4 None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:33:00.623339 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:33:00.638680 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cb7787-85ba-4307-b331-806c133945d6 None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:33:00.654745 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40aef39a-e509-4215-b939-c059d21b84ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:33:00.655509 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40aef39a-e509-4215-b939-c059d21b84ed None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:33:00.655811 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40aef39a-e509-4215-b939-c059d21b84ed None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:33:00.656834 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40aef39a-e509-4215-b939-c059d21b84ed None admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:33:00.657780 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40aef39a-e509-4215-b939-c059d21b84ed None admin] RBAC: Adding query filter params (name=reader) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 09:33:00.658097 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40aef39a-e509-4215-b939-c059d21b84ed None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:33:00.659791 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40aef39a-e509-4215-b939-c059d21b84ed None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:33:00.677180 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 51/100] 10.222.0.65 () {56 vars in 1101 bytes} [Thu Oct 27 09:33:00 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 09:33:00.677180 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40aef39a-e509-4215-b939-c059d21b84ed None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:33:00.690299 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63deb22b-37e1-4d55-b1c1-5afaf400f891 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:33:00.690955 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63deb22b-37e1-4d55-b1c1-5afaf400f891 None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:33:00.691231 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63deb22b-37e1-4d55-b1c1-5afaf400f891 None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:33:00.691570 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63deb22b-37e1-4d55-b1c1-5afaf400f891 None admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:33:00.692251 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63deb22b-37e1-4d55-b1c1-5afaf400f891 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 09:33:00.692558 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63deb22b-37e1-4d55-b1c1-5afaf400f891 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:33:00.693986 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63deb22b-37e1-4d55-b1c1-5afaf400f891 None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:33:00.706179 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 50/101] 10.222.0.65 () {56 vars in 1099 bytes} [Thu Oct 27 09:33:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 09:33:00.707610 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5b6ed8-1301-4287-8496-14f82599e37d None None] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:33:00.707901 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5b6ed8-1301-4287-8496-14f82599e37d None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:33:00.708179 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5b6ed8-1301-4287-8496-14f82599e37d None None] PATH_INFO: `/` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:33:00.709403 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 51/102] 10.222.0.65 () {54 vars in 927 bytes} [Thu Oct 27 09:33:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 09:33:00.713619 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5b6ed8-1301-4287-8496-14f82599e37d None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:33:00.813793 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40aef39a-e509-4215-b939-c059d21b84ed None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:33:00.818330 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:33:00.824073 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5b6ed8-1301-4287-8496-14f82599e37d None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:33:00.859563 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835c5bba-8c44-486c-b605-f61becc8efe2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:33:00.859827 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb62a12b-b910-4078-8802-ac24396d4c19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:33:00.860193 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb62a12b-b910-4078-8802-ac24396d4c19 None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:33:00.860295 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835c5bba-8c44-486c-b605-f61becc8efe2 None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:33:00.860470 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835c5bba-8c44-486c-b605-f61becc8efe2 None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:33:00.860561 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb62a12b-b910-4078-8802-ac24396d4c19 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:33:00.860743 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835c5bba-8c44-486c-b605-f61becc8efe2 None admin] PATH_INFO: `/v3/users/ae5b3c0bdb524b0dbb69ef17055ab774` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:33:00.860845 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb62a12b-b910-4078-8802-ac24396d4c19 None admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:33:00.861419 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb62a12b-b910-4078-8802-ac24396d4c19 None admin] RBAC: Adding query filter params (name=member) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 09:33:00.861730 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb62a12b-b910-4078-8802-ac24396d4c19 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:33:00.863206 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb62a12b-b910-4078-8802-ac24396d4c19 None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:33:00.872388 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 52/103] 10.222.0.65 () {56 vars in 1101 bytes} [Thu Oct 27 09:33:00 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 09:33:00.875572 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb62a12b-b910-4078-8802-ac24396d4c19 None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:33:00.881007 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835c5bba-8c44-486c-b605-f61becc8efe2 None admin] RBAC: Authorizing `identity:get_user(user_id=ae5b3c0bdb524b0dbb69ef17055ab774)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:33:00.882482 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835c5bba-8c44-486c-b605-f61becc8efe2 None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:33:00.884197 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 52/104] 10.222.0.65 () {56 vars in 1177 bytes} [Thu Oct 27 09:33:00 2022] GET /identity/v3/users/ae5b3c0bdb524b0dbb69ef17055ab774 => generated 289 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 09:33:00.885500 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8984f7a0-74f1-45e0-b556-1ece3dbc81f8 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:33:00.885784 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8984f7a0-74f1-45e0-b556-1ece3dbc81f8 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:33:00.886059 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8984f7a0-74f1-45e0-b556-1ece3dbc81f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:33:00.904677 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-8984f7a0-74f1-45e0-b556-1ece3dbc81f8 None None] MFA Rules not processed for user `b5065084bf664b99bdeac46067cb0f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:33:00.906420 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-8984f7a0-74f1-45e0-b556-1ece3dbc81f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:33:00.920686 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:33:00.978603 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 53/105] 10.222.0.65 () {58 vars in 1024 bytes} [Thu Oct 27 09:33:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 27 09:33:00.989051 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719c0da8-e5c7-44c0-8261-c3cb1a2d24b9 None None] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:33:00.989901 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719c0da8-e5c7-44c0-8261-c3cb1a2d24b9 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:33:00.990419 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719c0da8-e5c7-44c0-8261-c3cb1a2d24b9 None None] PATH_INFO: `/` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:33:00.992078 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 54/106] 10.222.0.65 () {54 vars in 927 bytes} [Thu Oct 27 09:33:00 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 09:33:00.996088 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719c0da8-e5c7-44c0-8261-c3cb1a2d24b9 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:33:00.997432 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb62a12b-b910-4078-8802-ac24396d4c19 None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:33:01.033203 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929a3801-87a5-4f2f-b82a-766fb4a1b8c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:33:01.033912 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929a3801-87a5-4f2f-b82a-766fb4a1b8c1 None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:33:01.034115 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929a3801-87a5-4f2f-b82a-766fb4a1b8c1 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:33:01.034397 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929a3801-87a5-4f2f-b82a-766fb4a1b8c1 None admin] PATH_INFO: `/v3/users/b5065084bf664b99bdeac46067cb0f0b` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:33:01.035559 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929a3801-87a5-4f2f-b82a-766fb4a1b8c1 None admin] RBAC: Authorizing `identity:get_user(user_id=b5065084bf664b99bdeac46067cb0f0b)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:33:01.037006 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929a3801-87a5-4f2f-b82a-766fb4a1b8c1 None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:33:01.042995 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 53/107] 10.222.0.65 () {56 vars in 1177 bytes} [Thu Oct 27 09:33:00 2022] GET /identity/v3/users/b5065084bf664b99bdeac46067cb0f0b => generated 247 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 09:33:01.042995 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929a3801-87a5-4f2f-b82a-766fb4a1b8c1 None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:33:01.105018 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:33:01.129386 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719c0da8-e5c7-44c0-8261-c3cb1a2d24b9 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:33:01.149368 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929a3801-87a5-4f2f-b82a-766fb4a1b8c1 None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:33:01.149368 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:33:01.172384 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b5154b-5bcf-40a8-8d8d-600d3e6503ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:33:01.173429 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b5154b-5bcf-40a8-8d8d-600d3e6503ca None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:33:01.173947 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b5154b-5bcf-40a8-8d8d-600d3e6503ca None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:33:01.174432 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b5154b-5bcf-40a8-8d8d-600d3e6503ca None admin] PATH_INFO: `/v3/users/25440275d47c4aacb7bdf0ee93b382f3` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:33:01.175934 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b5154b-5bcf-40a8-8d8d-600d3e6503ca None admin] RBAC: Authorizing `identity:get_user(user_id=25440275d47c4aacb7bdf0ee93b382f3)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:33:01.178851 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b5154b-5bcf-40a8-8d8d-600d3e6503ca None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:33:01.180800 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 55/108] 10.222.0.65 () {56 vars in 1177 bytes} [Thu Oct 27 09:33:00 2022] GET /identity/v3/users/25440275d47c4aacb7bdf0ee93b382f3 => generated 275 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 09:33:01.182193 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e074ccb-bdb8-4fff-a2c4-a454f69a246c None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:33:01.182706 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e074ccb-bdb8-4fff-a2c4-a454f69a246c None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:33:01.183215 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e074ccb-bdb8-4fff-a2c4-a454f69a246c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:33:01.187511 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593f067e-d220-464d-8d96-08622591dac2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:33:01.188154 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593f067e-d220-464d-8d96-08622591dac2 None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:33:01.188440 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593f067e-d220-464d-8d96-08622591dac2 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:33:01.188733 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593f067e-d220-464d-8d96-08622591dac2 None admin] PATH_INFO: `/v3/projects/a2e51b2800f14e7fa67e9bed4cc6498b` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:33:01.189871 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593f067e-d220-464d-8d96-08622591dac2 None admin] RBAC: Authorizing `identity:get_project(project_id=a2e51b2800f14e7fa67e9bed4cc6498b)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:33:01.191358 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593f067e-d220-464d-8d96-08622591dac2 None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:33:01.193393 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 54/109] 10.222.0.65 () {56 vars in 1186 bytes} [Thu Oct 27 09:33:01 2022] GET /identity/v3/projects/a2e51b2800f14e7fa67e9bed4cc6498b => generated 298 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 09:33:01.193892 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593f067e-d220-464d-8d96-08622591dac2 None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:33:01.206301 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-1e074ccb-bdb8-4fff-a2c4-a454f69a246c None None] MFA Rules not processed for user `b5065084bf664b99bdeac46067cb0f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:33:01.208007 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-1e074ccb-bdb8-4fff-a2c4-a454f69a246c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:33:01.286230 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 56/110] 10.222.0.65 () {58 vars in 1024 bytes} [Thu Oct 27 09:33:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 27 09:33:01.287823 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e074ccb-bdb8-4fff-a2c4-a454f69a246c None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:33:01.302757 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593f067e-d220-464d-8d96-08622591dac2 None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:33:01.340990 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bb76b5-3ffb-4802-8401-28e4c6dd66a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:33:01.341640 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bb76b5-3ffb-4802-8401-28e4c6dd66a6 None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:33:01.341926 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bb76b5-3ffb-4802-8401-28e4c6dd66a6 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:33:01.342209 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bb76b5-3ffb-4802-8401-28e4c6dd66a6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:33:01.385039 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:33:01.386785 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:33:01.404228 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e074ccb-bdb8-4fff-a2c4-a454f69a246c None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:33:01.422628 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4bb76b5-3ffb-4802-8401-28e4c6dd66a6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:33:01.424783 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4bb76b5-3ffb-4802-8401-28e4c6dd66a6 None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:33:01.450925 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fbf915-a6b9-403b-8473-c827d1cbb94a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:33:01.451548 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fbf915-a6b9-403b-8473-c827d1cbb94a None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:33:01.451827 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fbf915-a6b9-403b-8473-c827d1cbb94a None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:33:01.452100 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fbf915-a6b9-403b-8473-c827d1cbb94a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:33:01.533742 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fbf915-a6b9-403b-8473-c827d1cbb94a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:33:01.535429 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fbf915-a6b9-403b-8473-c827d1cbb94a None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:33:01.543288 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 55/111] 10.222.0.65 () {58 vars in 1282 bytes} [Thu Oct 27 09:33:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 27 09:33:01.548720 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bb76b5-3ffb-4802-8401-28e4c6dd66a6 None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:33:01.621084 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:33:01.628235 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:33:01.645396 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 57/112] 10.222.0.65 () {58 vars in 1282 bytes} [Thu Oct 27 09:33:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 27 09:33:01.650703 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fbf915-a6b9-403b-8473-c827d1cbb94a None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:33:01.653349 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bb76b5-3ffb-4802-8401-28e4c6dd66a6 None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:33:01.692745 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b40b67-cd1c-4dff-848c-e0bcc77d5d99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:33:01.693422 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b40b67-cd1c-4dff-848c-e0bcc77d5d99 None admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:33:01.693712 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b40b67-cd1c-4dff-848c-e0bcc77d5d99 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:33:01.693994 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b40b67-cd1c-4dff-848c-e0bcc77d5d99 None admin] PATH_INFO: `/v3/projects/a2e51b2800f14e7fa67e9bed4cc6498b/users/ae5b3c0bdb524b0dbb69ef17055ab774/roles/4d4811302e664f5fac66b7229e5c1b8f` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:33:01.696039 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b40b67-cd1c-4dff-848c-e0bcc77d5d99 None admin] RBAC: Authorizing `identity:create_grant(project_id=a2e51b2800f14e7fa67e9bed4cc6498b, user_id=ae5b3c0bdb524b0dbb69ef17055ab774, role_id=4d4811302e664f5fac66b7229e5c1b8f)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:33:01.697516 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b40b67-cd1c-4dff-848c-e0bcc77d5d99 None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:33:01.756533 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fbf915-a6b9-403b-8473-c827d1cbb94a None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:33:01.760898 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 56/113] 10.222.0.65 () {58 vars in 1439 bytes} [Thu Oct 27 09:33:01 2022] PUT /identity/v3/projects/a2e51b2800f14e7fa67e9bed4cc6498b/users/ae5b3c0bdb524b0dbb69ef17055ab774/roles/4d4811302e664f5fac66b7229e5c1b8f => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 09:33:01.771939 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b40b67-cd1c-4dff-848c-e0bcc77d5d99 None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:33:01.811170 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9354e19-b3ca-4f66-9544-98fe5ba65676 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:33:01.812680 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9354e19-b3ca-4f66-9544-98fe5ba65676 None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:33:01.813188 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9354e19-b3ca-4f66-9544-98fe5ba65676 None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:33:01.814052 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9354e19-b3ca-4f66-9544-98fe5ba65676 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:33:01.829654 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9354e19-b3ca-4f66-9544-98fe5ba65676 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 09:33:01.836978 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application [None req-c9354e19-b3ca-4f66-9544-98fe5ba65676 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 27 09:33:01.836978 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 09:33:01.836978 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 09:33:01.836978 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 09:33:01.836978 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 09:33:01.836978 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 09:33:01.836978 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 09:33:01.836978 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 09:33:01.836978 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 09:33:01.836978 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 09:33:01.836978 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 09:33:01.836978 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 09:33:01.836978 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 27 09:33:01.836978 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 27 09:33:01.836978 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 27 09:33:01.836978 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 27 09:33:01.837937 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 27 09:33:01.837937 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 27 09:33:01.837937 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 27 09:33:01.837937 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 27 09:33:01.837937 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 09:33:01.837937 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 09:33:01.837937 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 09:33:01.837937 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 09:33:01.837937 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 09:33:01.837937 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 09:33:01.837937 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 09:33:01.837937 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application with Lock( Oct 27 09:33:01.837937 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 09:33:01.837937 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._enter() Oct 27 09:33:01.837937 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 09:33:01.837937 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 09:33:01.838776 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 09:33:01.838776 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.creator() Oct 27 09:33:01.838776 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 09:33:01.838776 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application created_value = creator( Oct 27 09:33:01.838776 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 27 09:33:01.838776 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 27 09:33:01.838776 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 27 09:33:01.838776 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 27 09:33:01.838776 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 27 09:33:01.838776 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 27 09:33:01.838776 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 27 09:33:01.838776 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application Oct 27 09:33:01.841792 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 58/114] 10.222.0.65 () {56 vars in 1114 bytes} [Thu Oct 27 09:33:01 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 09:33:01.843086 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9354e19-b3ca-4f66-9544-98fe5ba65676 None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:33:01.901072 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:33:01.918432 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b40b67-cd1c-4dff-848c-e0bcc77d5d99 None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:33:01.954467 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:33:01.964343 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f0031d-773a-4034-8cbc-a5d096c02294 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:33:01.965110 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f0031d-773a-4034-8cbc-a5d096c02294 None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:33:01.965414 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f0031d-773a-4034-8cbc-a5d096c02294 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:33:01.965696 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f0031d-773a-4034-8cbc-a5d096c02294 None admin] PATH_INFO: `/v3/projects/a2e51b2800f14e7fa67e9bed4cc6498b` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:33:01.967602 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f0031d-773a-4034-8cbc-a5d096c02294 None admin] RBAC: Authorizing `identity:get_project(project_id=a2e51b2800f14e7fa67e9bed4cc6498b)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:33:01.969854 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f0031d-773a-4034-8cbc-a5d096c02294 None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:33:01.971775 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 57/115] 10.222.0.65 () {56 vars in 1186 bytes} [Thu Oct 27 09:33:01 2022] GET /identity/v3/projects/a2e51b2800f14e7fa67e9bed4cc6498b => generated 298 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 09:33:01.973105 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f0031d-773a-4034-8cbc-a5d096c02294 None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:33:01.977124 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9354e19-b3ca-4f66-9544-98fe5ba65676 None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:33:02.022478 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813a7f13-96a2-4e71-ae75-abd02c9da0a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:33:02.023538 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813a7f13-96a2-4e71-ae75-abd02c9da0a2 None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:33:02.024053 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813a7f13-96a2-4e71-ae75-abd02c9da0a2 None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:33:02.025127 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813a7f13-96a2-4e71-ae75-abd02c9da0a2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:33:02.040169 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813a7f13-96a2-4e71-ae75-abd02c9da0a2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 09:33:02.048350 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application [None req-813a7f13-96a2-4e71-ae75-abd02c9da0a2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 27 09:33:02.048350 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 09:33:02.048350 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 09:33:02.048350 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 09:33:02.048350 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 09:33:02.048350 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 09:33:02.048350 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 09:33:02.048350 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 09:33:02.048350 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 09:33:02.048350 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 09:33:02.048350 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 09:33:02.048350 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 09:33:02.048350 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 27 09:33:02.048350 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 27 09:33:02.048350 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 27 09:33:02.048350 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 27 09:33:02.049215 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 27 09:33:02.049215 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 27 09:33:02.049215 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 27 09:33:02.049215 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 27 09:33:02.049215 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 09:33:02.049215 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 09:33:02.049215 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 09:33:02.049215 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 09:33:02.049215 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 09:33:02.049215 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 09:33:02.049215 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 09:33:02.049215 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application with Lock( Oct 27 09:33:02.049215 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 09:33:02.049215 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._enter() Oct 27 09:33:02.049215 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 09:33:02.049215 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 09:33:02.050022 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 09:33:02.050022 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.creator() Oct 27 09:33:02.050022 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 09:33:02.050022 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application created_value = creator( Oct 27 09:33:02.050022 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 27 09:33:02.050022 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 27 09:33:02.050022 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 27 09:33:02.050022 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 27 09:33:02.050022 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 27 09:33:02.050022 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 27 09:33:02.050022 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 27 09:33:02.050022 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application Oct 27 09:33:02.058621 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 59/116] 10.222.0.65 () {56 vars in 1099 bytes} [Thu Oct 27 09:33:01 2022] GET /identity/v3/roles/member => generated 84 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 09:33:02.058621 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813a7f13-96a2-4e71-ae75-abd02c9da0a2 None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:33:02.112734 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f0031d-773a-4034-8cbc-a5d096c02294 None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:33:02.152201 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8881d907-98b4-4c3b-98d6-f11f8d8ac3fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:33:02.153214 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8881d907-98b4-4c3b-98d6-f11f8d8ac3fd None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:33:02.153724 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8881d907-98b4-4c3b-98d6-f11f8d8ac3fd None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:33:02.154208 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8881d907-98b4-4c3b-98d6-f11f8d8ac3fd None admin] PATH_INFO: `/v3/projects/a2e51b2800f14e7fa67e9bed4cc6498b` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:33:02.155722 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8881d907-98b4-4c3b-98d6-f11f8d8ac3fd None admin] RBAC: Authorizing `identity:get_project(project_id=a2e51b2800f14e7fa67e9bed4cc6498b)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:33:02.157477 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8881d907-98b4-4c3b-98d6-f11f8d8ac3fd None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:33:02.159811 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 58/117] 10.222.0.65 () {56 vars in 1186 bytes} [Thu Oct 27 09:33:01 2022] GET /identity/v3/projects/a2e51b2800f14e7fa67e9bed4cc6498b => generated 298 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 09:33:02.160814 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8881d907-98b4-4c3b-98d6-f11f8d8ac3fd None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:33:02.185029 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813a7f13-96a2-4e71-ae75-abd02c9da0a2 None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:33:02.189472 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:33:02.236643 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5255fc-9f63-4a8b-b25e-9670aac146f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:33:02.237666 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5255fc-9f63-4a8b-b25e-9670aac146f4 None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:33:02.238071 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5255fc-9f63-4a8b-b25e-9670aac146f4 None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:33:02.238890 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5255fc-9f63-4a8b-b25e-9670aac146f4 None admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:33:02.239914 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5255fc-9f63-4a8b-b25e-9670aac146f4 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 09:33:02.240301 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5255fc-9f63-4a8b-b25e-9670aac146f4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:33:02.242479 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5255fc-9f63-4a8b-b25e-9670aac146f4 None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:33:02.250152 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:33:02.257082 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 60/118] 10.222.0.65 () {56 vars in 1111 bytes} [Thu Oct 27 09:33:02 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 09:33:02.263159 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5255fc-9f63-4a8b-b25e-9670aac146f4 None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:33:02.298854 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8881d907-98b4-4c3b-98d6-f11f8d8ac3fd None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:33:02.338155 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7bf883-2252-4718-9af5-70b13c961595 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:33:02.339583 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7bf883-2252-4718-9af5-70b13c961595 None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:33:02.340071 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7bf883-2252-4718-9af5-70b13c961595 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:33:02.340570 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7bf883-2252-4718-9af5-70b13c961595 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:33:02.341516 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7bf883-2252-4718-9af5-70b13c961595 None admin] RBAC: Adding query filter params (role.id=6ad17b9f9dea4b66ab2da3677d7e715d, scope.project.id=a2e51b2800f14e7fa67e9bed4cc6498b, user.id=b5065084bf664b99bdeac46067cb0f0b) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 09:33:02.342050 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7bf883-2252-4718-9af5-70b13c961595 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:33:02.344267 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7bf883-2252-4718-9af5-70b13c961595 None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:33:02.352696 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 59/119] 10.222.0.65 () {56 vars in 1374 bytes} [Thu Oct 27 09:33:02 2022] GET /identity/v3/role_assignments?user.id=b5065084bf664b99bdeac46067cb0f0b&scope.project.id=a2e51b2800f14e7fa67e9bed4cc6498b&role.id=6ad17b9f9dea4b66ab2da3677d7e715d => generated 608 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 09:33:02.360448 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7bf883-2252-4718-9af5-70b13c961595 None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:33:02.403227 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5255fc-9f63-4a8b-b25e-9670aac146f4 None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:33:02.450067 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec0a171-e4a0-4800-859e-3ec833616d50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:33:02.450803 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec0a171-e4a0-4800-859e-3ec833616d50 None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:33:02.451093 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec0a171-e4a0-4800-859e-3ec833616d50 None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:33:02.451933 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec0a171-e4a0-4800-859e-3ec833616d50 None admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:33:02.452664 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec0a171-e4a0-4800-859e-3ec833616d50 None admin] RBAC: Adding query filter params (name=member) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 09:33:02.453701 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec0a171-e4a0-4800-859e-3ec833616d50 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:33:02.455188 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec0a171-e4a0-4800-859e-3ec833616d50 None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:33:02.466241 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 61/120] 10.222.0.65 () {56 vars in 1101 bytes} [Thu Oct 27 09:33:02 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 09:33:02.467255 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec0a171-e4a0-4800-859e-3ec833616d50 None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:33:02.506670 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:33:02.603793 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec0a171-e4a0-4800-859e-3ec833616d50 None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:33:02.642577 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7bf883-2252-4718-9af5-70b13c961595 None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:33:02.673072 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb802c33-b289-490f-90b1-fc715b7e9757 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:33:02.673974 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb802c33-b289-490f-90b1-fc715b7e9757 None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:33:02.674240 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb802c33-b289-490f-90b1-fc715b7e9757 None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:33:02.674643 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb802c33-b289-490f-90b1-fc715b7e9757 None admin] PATH_INFO: `/v3/users/25440275d47c4aacb7bdf0ee93b382f3` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:33:02.676249 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb802c33-b289-490f-90b1-fc715b7e9757 None admin] RBAC: Authorizing `identity:get_user(user_id=25440275d47c4aacb7bdf0ee93b382f3)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:33:02.677935 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb802c33-b289-490f-90b1-fc715b7e9757 None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:33:02.680273 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 62/121] 10.222.0.65 () {56 vars in 1177 bytes} [Thu Oct 27 09:33:02 2022] GET /identity/v3/users/25440275d47c4aacb7bdf0ee93b382f3 => generated 275 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 09:33:02.681320 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb802c33-b289-490f-90b1-fc715b7e9757 None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:33:02.684729 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:33:02.692131 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665cea47-f64f-406d-86c1-52fdc771b3e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:33:02.692959 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665cea47-f64f-406d-86c1-52fdc771b3e2 None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:33:02.693387 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665cea47-f64f-406d-86c1-52fdc771b3e2 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:33:02.693974 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665cea47-f64f-406d-86c1-52fdc771b3e2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:33:02.694976 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665cea47-f64f-406d-86c1-52fdc771b3e2 None admin] RBAC: Adding query filter params (role.id=43543ce1450245af9661cb017bac17bd, scope.project.id=a2e51b2800f14e7fa67e9bed4cc6498b, user.id=25440275d47c4aacb7bdf0ee93b382f3) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 09:33:02.695532 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665cea47-f64f-406d-86c1-52fdc771b3e2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:33:02.697309 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665cea47-f64f-406d-86c1-52fdc771b3e2 None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:33:02.710677 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 60/122] 10.222.0.65 () {56 vars in 1374 bytes} [Thu Oct 27 09:33:02 2022] GET /identity/v3/role_assignments?user.id=25440275d47c4aacb7bdf0ee93b382f3&scope.project.id=a2e51b2800f14e7fa67e9bed4cc6498b&role.id=43543ce1450245af9661cb017bac17bd => generated 608 bytes in 346 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 09:33:02.712117 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665cea47-f64f-406d-86c1-52fdc771b3e2 None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:33:02.805770 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:33:02.813421 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb802c33-b289-490f-90b1-fc715b7e9757 None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:33:02.866640 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c853af6-5075-4e9c-a0f6-87f49ee57c99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:33:02.867312 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c853af6-5075-4e9c-a0f6-87f49ee57c99 None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:33:02.867861 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c853af6-5075-4e9c-a0f6-87f49ee57c99 None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:33:02.868145 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c853af6-5075-4e9c-a0f6-87f49ee57c99 None admin] PATH_INFO: `/v3/users/25440275d47c4aacb7bdf0ee93b382f3` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:33:02.870966 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c853af6-5075-4e9c-a0f6-87f49ee57c99 None admin] RBAC: Authorizing `identity:get_user(user_id=25440275d47c4aacb7bdf0ee93b382f3)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:33:02.872451 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c853af6-5075-4e9c-a0f6-87f49ee57c99 None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:33:02.874168 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 63/123] 10.222.0.65 () {56 vars in 1177 bytes} [Thu Oct 27 09:33:02 2022] GET /identity/v3/users/25440275d47c4aacb7bdf0ee93b382f3 => generated 275 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 09:33:02.880272 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d1703b-4e3f-449e-a87b-47c6acc00a13 None None] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:33:02.880488 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d1703b-4e3f-449e-a87b-47c6acc00a13 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:33:02.880738 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d1703b-4e3f-449e-a87b-47c6acc00a13 None None] PATH_INFO: `/` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:33:02.882113 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 64/124] 10.222.0.65 () {54 vars in 927 bytes} [Thu Oct 27 09:33:02 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 09:33:02.884442 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d1703b-4e3f-449e-a87b-47c6acc00a13 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:33:02.885006 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665cea47-f64f-406d-86c1-52fdc771b3e2 None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:33:02.928571 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ba7c40-0f88-41a6-83d6-2faa5676bbbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:33:02.929489 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ba7c40-0f88-41a6-83d6-2faa5676bbbc None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:33:02.929966 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ba7c40-0f88-41a6-83d6-2faa5676bbbc None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:33:02.930432 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ba7c40-0f88-41a6-83d6-2faa5676bbbc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:33:03.005113 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d1703b-4e3f-449e-a87b-47c6acc00a13 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:33:03.006675 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:33:03.014063 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ba7c40-0f88-41a6-83d6-2faa5676bbbc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:33:03.016649 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ba7c40-0f88-41a6-83d6-2faa5676bbbc None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:33:03.041325 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df622b5e-c777-4e75-b486-42fddc7288e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:33:03.041950 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df622b5e-c777-4e75-b486-42fddc7288e0 None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:33:03.042304 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df622b5e-c777-4e75-b486-42fddc7288e0 None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:33:03.042510 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df622b5e-c777-4e75-b486-42fddc7288e0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:33:03.076396 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:33:03.118538 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df622b5e-c777-4e75-b486-42fddc7288e0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:33:03.120034 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df622b5e-c777-4e75-b486-42fddc7288e0 None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:33:03.128271 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 61/125] 10.222.0.65 () {58 vars in 1282 bytes} [Thu Oct 27 09:33:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 27 09:33:03.133968 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25701c70-1716-4fe9-9734-b5bb687e5682 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:33:03.134254 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25701c70-1716-4fe9-9734-b5bb687e5682 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:33:03.134572 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25701c70-1716-4fe9-9734-b5bb687e5682 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:33:03.153251 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-25701c70-1716-4fe9-9734-b5bb687e5682 None None] MFA Rules not processed for user `b5065084bf664b99bdeac46067cb0f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:33:03.154436 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-25701c70-1716-4fe9-9734-b5bb687e5682 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:33:03.227424 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 62/126] 10.222.0.65 () {58 vars in 1024 bytes} [Thu Oct 27 09:33:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 27 09:33:03.228199 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25701c70-1716-4fe9-9734-b5bb687e5682 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:33:03.229902 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 65/127] 10.222.0.65 () {58 vars in 1282 bytes} [Thu Oct 27 09:33:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Oct 27 09:33:03.235776 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df622b5e-c777-4e75-b486-42fddc7288e0 None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:33:03.272452 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:33:03.318903 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:33:03.351947 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df622b5e-c777-4e75-b486-42fddc7288e0 None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:33:03.365162 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25701c70-1716-4fe9-9734-b5bb687e5682 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:33:03.401961 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34381941-da63-474d-9297-043a477b84ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:33:03.403035 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34381941-da63-474d-9297-043a477b84ac None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:33:03.403147 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ca154d-889e-41a7-bf2b-7148cb7e81c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:33:03.403577 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34381941-da63-474d-9297-043a477b84ac None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:33:03.404015 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ca154d-889e-41a7-bf2b-7148cb7e81c2 None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:33:03.404221 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ca154d-889e-41a7-bf2b-7148cb7e81c2 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:33:03.404565 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ca154d-889e-41a7-bf2b-7148cb7e81c2 None admin] PATH_INFO: `/v3/projects/a2e51b2800f14e7fa67e9bed4cc6498b` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:33:03.404678 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34381941-da63-474d-9297-043a477b84ac None admin] PATH_INFO: `/v3/projects/769c98ced9de4755bd4318f3fbee6001` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:33:03.406384 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ca154d-889e-41a7-bf2b-7148cb7e81c2 None admin] RBAC: Authorizing `identity:get_project(project_id=a2e51b2800f14e7fa67e9bed4cc6498b)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:33:03.406899 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34381941-da63-474d-9297-043a477b84ac None admin] RBAC: Authorizing `identity:get_project(project_id=769c98ced9de4755bd4318f3fbee6001)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:33:03.407990 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ca154d-889e-41a7-bf2b-7148cb7e81c2 None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:33:03.408635 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34381941-da63-474d-9297-043a477b84ac None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:33:03.409843 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 63/128] 10.222.0.65 () {56 vars in 1186 bytes} [Thu Oct 27 09:33:03 2022] GET /identity/v3/projects/a2e51b2800f14e7fa67e9bed4cc6498b => generated 298 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 09:33:03.410828 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 66/129] 10.222.0.65 () {56 vars in 1186 bytes} [Thu Oct 27 09:33:03 2022] GET /identity/v3/projects/769c98ced9de4755bd4318f3fbee6001 => generated 312 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 09:33:03.415949 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ca154d-889e-41a7-bf2b-7148cb7e81c2 None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:33:03.417184 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34381941-da63-474d-9297-043a477b84ac None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:33:03.528288 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34381941-da63-474d-9297-043a477b84ac None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:33:03.538640 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:33:03.548017 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ca154d-889e-41a7-bf2b-7148cb7e81c2 None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:33:03.562393 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:33:03.567281 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d464315-5319-4ac2-bc27-128e73e9a981 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:33:03.567967 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d464315-5319-4ac2-bc27-128e73e9a981 None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:33:03.568185 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d464315-5319-4ac2-bc27-128e73e9a981 None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:33:03.571943 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d464315-5319-4ac2-bc27-128e73e9a981 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:33:03.571943 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d464315-5319-4ac2-bc27-128e73e9a981 None admin] RBAC: Adding query filter params (role.id=43543ce1450245af9661cb017bac17bd, scope.project.id=769c98ced9de4755bd4318f3fbee6001, user.id=25440275d47c4aacb7bdf0ee93b382f3) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 09:33:03.571943 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d464315-5319-4ac2-bc27-128e73e9a981 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:33:03.571943 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d464315-5319-4ac2-bc27-128e73e9a981 None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:33:03.586852 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 67/130] 10.222.0.65 () {56 vars in 1374 bytes} [Thu Oct 27 09:33:03 2022] GET /identity/v3/role_assignments?user.id=25440275d47c4aacb7bdf0ee93b382f3&scope.project.id=769c98ced9de4755bd4318f3fbee6001&role.id=43543ce1450245af9661cb017bac17bd => generated 608 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 09:33:03.586852 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d464315-5319-4ac2-bc27-128e73e9a981 None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:33:03.598609 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87766db2-b257-4e16-b045-7a6df7d7daaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:33:03.599246 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87766db2-b257-4e16-b045-7a6df7d7daaa None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:33:03.599532 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87766db2-b257-4e16-b045-7a6df7d7daaa None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:33:03.599812 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87766db2-b257-4e16-b045-7a6df7d7daaa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:33:03.600577 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87766db2-b257-4e16-b045-7a6df7d7daaa None admin] RBAC: Adding query filter params (role.id=438ff415f4f644afb2cc60293cc13741, scope.project.id=a2e51b2800f14e7fa67e9bed4cc6498b, user.id=25440275d47c4aacb7bdf0ee93b382f3) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 09:33:03.600963 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87766db2-b257-4e16-b045-7a6df7d7daaa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:33:03.602477 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87766db2-b257-4e16-b045-7a6df7d7daaa None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:33:03.617132 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 64/131] 10.222.0.65 () {56 vars in 1374 bytes} [Thu Oct 27 09:33:03 2022] GET /identity/v3/role_assignments?user.id=25440275d47c4aacb7bdf0ee93b382f3&scope.project.id=a2e51b2800f14e7fa67e9bed4cc6498b&role.id=438ff415f4f644afb2cc60293cc13741 => generated 608 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 09:33:03.706930 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d464315-5319-4ac2-bc27-128e73e9a981 None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:33:03.748924 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a3d958-61f7-43e3-bce3-dcd5f90af5ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:33:03.749868 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a3d958-61f7-43e3-bce3-dcd5f90af5ed None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:33:03.750217 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a3d958-61f7-43e3-bce3-dcd5f90af5ed None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:33:03.750636 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a3d958-61f7-43e3-bce3-dcd5f90af5ed None admin] PATH_INFO: `/v3/domains/default` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:33:03.752009 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a3d958-61f7-43e3-bce3-dcd5f90af5ed None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:33:03.753551 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a3d958-61f7-43e3-bce3-dcd5f90af5ed None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:33:03.755739 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 68/132] 10.222.0.65 () {56 vars in 1108 bytes} [Thu Oct 27 09:33:03 2022] GET /identity/v3/domains/default => generated 199 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 09:33:03.763702 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87766db2-b257-4e16-b045-7a6df7d7daaa None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:33:03.883381 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87766db2-b257-4e16-b045-7a6df7d7daaa None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:33:03.923836 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decbaa3a-4e13-4fcc-be53-fd65e90e0f76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:33:03.924464 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decbaa3a-4e13-4fcc-be53-fd65e90e0f76 None admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:33:03.924753 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decbaa3a-4e13-4fcc-be53-fd65e90e0f76 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:33:03.925034 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decbaa3a-4e13-4fcc-be53-fd65e90e0f76 None admin] PATH_INFO: `/v3/users` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:33:03.925706 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-decbaa3a-4e13-4fcc-be53-fd65e90e0f76 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:33:03.927206 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-decbaa3a-4e13-4fcc-be53-fd65e90e0f76 None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:33:04.032562 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 65/133] 10.222.0.65 () {60 vars in 1132 bytes} [Thu Oct 27 09:33:03 2022] POST /identity/v3/users => generated 283 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 09:33:04.100956 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc18796-5ad8-4ce5-9c2b-5325fa947ba5 None None] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:33:04.101227 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc18796-5ad8-4ce5-9c2b-5325fa947ba5 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:33:04.101520 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc18796-5ad8-4ce5-9c2b-5325fa947ba5 None None] PATH_INFO: `/` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:33:04.102987 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 69/134] 10.222.0.65 () {54 vars in 927 bytes} [Thu Oct 27 09:33:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 09:33:04.109091 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518a0ab7-9218-4a8b-8743-aaa03937ec34 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:33:04.109379 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518a0ab7-9218-4a8b-8743-aaa03937ec34 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:33:04.109719 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518a0ab7-9218-4a8b-8743-aaa03937ec34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:33:04.130238 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-518a0ab7-9218-4a8b-8743-aaa03937ec34 None None] MFA Rules not processed for user `b5065084bf664b99bdeac46067cb0f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:33:04.131141 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-518a0ab7-9218-4a8b-8743-aaa03937ec34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:33:04.139838 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:33:04.204504 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 66/135] 10.222.0.65 () {58 vars in 1024 bytes} [Thu Oct 27 09:33:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 27 09:33:04.478805 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc18796-5ad8-4ce5-9c2b-5325fa947ba5 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:33:04.548284 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:33:04.589533 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc18796-5ad8-4ce5-9c2b-5325fa947ba5 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:33:04.639020 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704aac4a-9475-472e-9e73-30f9c9c6cd3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:33:04.640854 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704aac4a-9475-472e-9e73-30f9c9c6cd3d None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:33:04.641149 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704aac4a-9475-472e-9e73-30f9c9c6cd3d None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:33:04.641432 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704aac4a-9475-472e-9e73-30f9c9c6cd3d None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:33:04.653131 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704aac4a-9475-472e-9e73-30f9c9c6cd3d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 09:33:04.658562 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application [None req-704aac4a-9475-472e-9e73-30f9c9c6cd3d None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 27 09:33:04.658562 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 09:33:04.658562 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 09:33:04.658562 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 09:33:04.658562 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 09:33:04.658562 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 09:33:04.658562 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 09:33:04.658562 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 09:33:04.658562 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 09:33:04.658562 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 09:33:04.658562 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 09:33:04.658562 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 09:33:04.658562 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 27 09:33:04.658562 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 27 09:33:04.658562 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 27 09:33:04.658562 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 27 09:33:04.659373 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 27 09:33:04.659373 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 27 09:33:04.659373 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 27 09:33:04.659373 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 27 09:33:04.659373 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 09:33:04.659373 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 09:33:04.659373 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 09:33:04.659373 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 09:33:04.659373 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 09:33:04.659373 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 09:33:04.659373 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 09:33:04.659373 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application with Lock( Oct 27 09:33:04.659373 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 09:33:04.659373 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._enter() Oct 27 09:33:04.659373 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 09:33:04.659373 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 09:33:04.660107 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 09:33:04.660107 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.creator() Oct 27 09:33:04.660107 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 09:33:04.660107 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application created_value = creator( Oct 27 09:33:04.660107 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 27 09:33:04.660107 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 27 09:33:04.660107 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 27 09:33:04.660107 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 27 09:33:04.660107 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 27 09:33:04.660107 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 27 09:33:04.660107 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 27 09:33:04.660107 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application Oct 27 09:33:04.664723 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 70/136] 10.222.0.65 () {56 vars in 1099 bytes} [Thu Oct 27 09:33:04 2022] GET /identity/v3/roles/reader => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 09:33:04.666186 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518a0ab7-9218-4a8b-8743-aaa03937ec34 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:33:04.775902 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518a0ab7-9218-4a8b-8743-aaa03937ec34 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:33:04.817283 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49dcc5c3-6e5d-43a9-8260-1ae0e9b0fbbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:33:04.817907 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dcc5c3-6e5d-43a9-8260-1ae0e9b0fbbe None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:33:04.818191 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dcc5c3-6e5d-43a9-8260-1ae0e9b0fbbe None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:33:04.818473 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dcc5c3-6e5d-43a9-8260-1ae0e9b0fbbe None admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:33:04.819187 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49dcc5c3-6e5d-43a9-8260-1ae0e9b0fbbe None admin] RBAC: Adding query filter params (name=reader) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 09:33:04.819486 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49dcc5c3-6e5d-43a9-8260-1ae0e9b0fbbe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:33:04.820958 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49dcc5c3-6e5d-43a9-8260-1ae0e9b0fbbe None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:33:04.832239 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 67/137] 10.222.0.65 () {56 vars in 1101 bytes} [Thu Oct 27 09:33:04 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 09:33:04.837899 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704aac4a-9475-472e-9e73-30f9c9c6cd3d None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:33:04.950880 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704aac4a-9475-472e-9e73-30f9c9c6cd3d None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:33:04.975737 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:33:04.988355 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d7de46-d138-4b04-ae3b-1de0aab9fc45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:33:04.989299 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d7de46-d138-4b04-ae3b-1de0aab9fc45 None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:33:04.989778 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d7de46-d138-4b04-ae3b-1de0aab9fc45 None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:33:04.990243 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d7de46-d138-4b04-ae3b-1de0aab9fc45 None admin] PATH_INFO: `/v3/users/ae5b3c0bdb524b0dbb69ef17055ab774` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:33:04.991754 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d7de46-d138-4b04-ae3b-1de0aab9fc45 None admin] RBAC: Authorizing `identity:get_user(user_id=ae5b3c0bdb524b0dbb69ef17055ab774)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:33:04.993676 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d7de46-d138-4b04-ae3b-1de0aab9fc45 None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:33:04.995872 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 71/138] 10.222.0.65 () {56 vars in 1177 bytes} [Thu Oct 27 09:33:04 2022] GET /identity/v3/users/ae5b3c0bdb524b0dbb69ef17055ab774 => generated 289 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 09:33:05.002028 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49dcc5c3-6e5d-43a9-8260-1ae0e9b0fbbe None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:33:05.006708 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:33:05.123839 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49dcc5c3-6e5d-43a9-8260-1ae0e9b0fbbe None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:33:05.160296 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe43370c-39bb-428c-a322-9439953e5ef2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:33:05.160922 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe43370c-39bb-428c-a322-9439953e5ef2 None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:33:05.161209 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe43370c-39bb-428c-a322-9439953e5ef2 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:33:05.161493 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe43370c-39bb-428c-a322-9439953e5ef2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:33:05.234786 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe43370c-39bb-428c-a322-9439953e5ef2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:33:05.236286 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe43370c-39bb-428c-a322-9439953e5ef2 None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:33:05.238978 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:33:05.342145 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 68/139] 10.222.0.65 () {58 vars in 1282 bytes} [Thu Oct 27 09:33:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 27 09:33:05.348512 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d7de46-d138-4b04-ae3b-1de0aab9fc45 None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:33:05.456876 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d7de46-d138-4b04-ae3b-1de0aab9fc45 None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:33:05.492274 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541e5cd9-d082-4b8b-90d5-fbd522ef2b35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:33:05.493253 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541e5cd9-d082-4b8b-90d5-fbd522ef2b35 None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:33:05.493472 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541e5cd9-d082-4b8b-90d5-fbd522ef2b35 None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:33:05.493722 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541e5cd9-d082-4b8b-90d5-fbd522ef2b35 None admin] PATH_INFO: `/v3/projects/a2e51b2800f14e7fa67e9bed4cc6498b` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:33:05.494885 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541e5cd9-d082-4b8b-90d5-fbd522ef2b35 None admin] RBAC: Authorizing `identity:get_project(project_id=a2e51b2800f14e7fa67e9bed4cc6498b)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:33:05.496342 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541e5cd9-d082-4b8b-90d5-fbd522ef2b35 None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:33:05.497978 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 72/140] 10.222.0.65 () {56 vars in 1186 bytes} [Thu Oct 27 09:33:05 2022] GET /identity/v3/projects/a2e51b2800f14e7fa67e9bed4cc6498b => generated 298 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 09:33:05.504144 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe43370c-39bb-428c-a322-9439953e5ef2 None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:33:05.608249 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe43370c-39bb-428c-a322-9439953e5ef2 None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:33:05.611254 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:33:05.644827 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2fc82a-5e32-4a8f-87ff-1efc205cc3e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:33:05.645445 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2fc82a-5e32-4a8f-87ff-1efc205cc3e8 None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:33:05.645736 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2fc82a-5e32-4a8f-87ff-1efc205cc3e8 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:33:05.646030 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2fc82a-5e32-4a8f-87ff-1efc205cc3e8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:33:05.646808 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2fc82a-5e32-4a8f-87ff-1efc205cc3e8 None admin] RBAC: Adding query filter params (role.id=4d4811302e664f5fac66b7229e5c1b8f, scope.project.id=a2e51b2800f14e7fa67e9bed4cc6498b, user.id=ae5b3c0bdb524b0dbb69ef17055ab774) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 09:33:05.647532 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2fc82a-5e32-4a8f-87ff-1efc205cc3e8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:33:05.648997 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2fc82a-5e32-4a8f-87ff-1efc205cc3e8 None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:33:05.658862 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 69/141] 10.222.0.65 () {56 vars in 1374 bytes} [Thu Oct 27 09:33:05 2022] GET /identity/v3/role_assignments?user.id=ae5b3c0bdb524b0dbb69ef17055ab774&scope.project.id=a2e51b2800f14e7fa67e9bed4cc6498b&role.id=4d4811302e664f5fac66b7229e5c1b8f => generated 608 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 09:33:06.392395 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29adc20-b525-402e-b1e8-1de9952f7732 None None] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:33:06.392674 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29adc20-b525-402e-b1e8-1de9952f7732 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:33:06.393149 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29adc20-b525-402e-b1e8-1de9952f7732 None None] PATH_INFO: `/` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:33:06.394812 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 73/142] 10.222.0.65 () {54 vars in 927 bytes} [Thu Oct 27 09:33:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 09:33:06.400458 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83f987a-8a7e-4c10-9a5a-5493539b76fe None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:33:06.400975 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83f987a-8a7e-4c10-9a5a-5493539b76fe None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:33:06.401048 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83f987a-8a7e-4c10-9a5a-5493539b76fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:33:06.419957 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-a83f987a-8a7e-4c10-9a5a-5493539b76fe None None] MFA Rules not processed for user `b5065084bf664b99bdeac46067cb0f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:33:06.421170 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-a83f987a-8a7e-4c10-9a5a-5493539b76fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:33:06.490385 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e21ca50-1319-4073-bbe7-1541a41950d4 None None] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:33:06.490700 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e21ca50-1319-4073-bbe7-1541a41950d4 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:33:06.490983 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e21ca50-1319-4073-bbe7-1541a41950d4 None None] PATH_INFO: `/` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:33:06.492579 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 74/143] 10.222.0.65 () {54 vars in 927 bytes} [Thu Oct 27 09:33:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 09:33:06.496451 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 70/144] 10.222.0.65 () {58 vars in 1024 bytes} [Thu Oct 27 09:33:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 27 09:33:06.498215 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdcc83e-266f-4603-8d6e-1eab228f9bc7 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:33:06.498501 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdcc83e-266f-4603-8d6e-1eab228f9bc7 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:33:06.498813 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdcc83e-266f-4603-8d6e-1eab228f9bc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:33:06.519900 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-dcdcc83e-266f-4603-8d6e-1eab228f9bc7 None None] MFA Rules not processed for user `b5065084bf664b99bdeac46067cb0f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:33:06.521146 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-dcdcc83e-266f-4603-8d6e-1eab228f9bc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:33:06.582562 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:33:06.594779 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 75/145] 10.222.0.65 () {58 vars in 1024 bytes} [Thu Oct 27 09:33:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 27 09:33:06.629040 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a2ef7e-3195-414c-9417-87f4d7f0a249 None None] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:33:06.629330 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a2ef7e-3195-414c-9417-87f4d7f0a249 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:33:06.629609 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a2ef7e-3195-414c-9417-87f4d7f0a249 None None] PATH_INFO: `/` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:33:06.631150 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 71/146] 10.222.0.65 () {54 vars in 927 bytes} [Thu Oct 27 09:33:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 09:33:06.636145 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544c4d10-fe35-4853-ab22-515a5e3b3e3a None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:33:06.636437 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544c4d10-fe35-4853-ab22-515a5e3b3e3a None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:33:06.636727 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544c4d10-fe35-4853-ab22-515a5e3b3e3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:33:06.659204 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-544c4d10-fe35-4853-ab22-515a5e3b3e3a None None] MFA Rules not processed for user `b5065084bf664b99bdeac46067cb0f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:33:06.660475 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-544c4d10-fe35-4853-ab22-515a5e3b3e3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:33:06.728503 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 76/147] 10.222.0.65 () {58 vars in 1024 bytes} [Thu Oct 27 09:33:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 27 09:33:06.779517 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a2ef7e-3195-414c-9417-87f4d7f0a249 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:33:06.860742 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544c4d10-fe35-4853-ab22-515a5e3b3e3a None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:33:06.891808 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:33:06.897903 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a2ef7e-3195-414c-9417-87f4d7f0a249 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:33:06.936157 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31e04ba-26a4-43c2-aaee-26ae2c267b71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:33:06.937052 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31e04ba-26a4-43c2-aaee-26ae2c267b71 None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:33:06.937342 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31e04ba-26a4-43c2-aaee-26ae2c267b71 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:33:06.937614 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31e04ba-26a4-43c2-aaee-26ae2c267b71 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:33:06.948219 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31e04ba-26a4-43c2-aaee-26ae2c267b71 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 09:33:06.953106 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application [None req-b31e04ba-26a4-43c2-aaee-26ae2c267b71 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 27 09:33:06.953106 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 09:33:06.953106 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 09:33:06.953106 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 09:33:06.953106 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 09:33:06.953106 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 09:33:06.953106 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 09:33:06.953106 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 09:33:06.953106 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 09:33:06.953106 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 09:33:06.953106 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 09:33:06.953106 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 09:33:06.953106 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 27 09:33:06.953106 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 27 09:33:06.953106 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 27 09:33:06.953106 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 27 09:33:06.954081 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 27 09:33:06.954081 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 27 09:33:06.954081 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 27 09:33:06.954081 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 27 09:33:06.954081 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 09:33:06.954081 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 09:33:06.954081 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 09:33:06.954081 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 09:33:06.954081 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 09:33:06.954081 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 09:33:06.954081 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 09:33:06.954081 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application with Lock( Oct 27 09:33:06.954081 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 09:33:06.954081 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._enter() Oct 27 09:33:06.954081 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 09:33:06.954081 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 09:33:06.954883 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 09:33:06.954883 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.creator() Oct 27 09:33:06.954883 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 09:33:06.954883 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application created_value = creator( Oct 27 09:33:06.954883 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 27 09:33:06.954883 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 27 09:33:06.954883 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 27 09:33:06.954883 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 27 09:33:06.954883 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 27 09:33:06.954883 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 27 09:33:06.954883 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 27 09:33:06.954883 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application Oct 27 09:33:06.954883 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 72/148] 10.222.0.65 () {56 vars in 1096 bytes} [Thu Oct 27 09:33:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 09:33:06.959792 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31e04ba-26a4-43c2-aaee-26ae2c267b71 None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:33:06.976557 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544c4d10-fe35-4853-ab22-515a5e3b3e3a None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:33:06.998840 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:33:07.012631 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecc04a6-9145-4861-b0b8-c7ff7cb95434 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:33:07.013229 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecc04a6-9145-4861-b0b8-c7ff7cb95434 None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:33:07.013509 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecc04a6-9145-4861-b0b8-c7ff7cb95434 None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:33:07.013780 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecc04a6-9145-4861-b0b8-c7ff7cb95434 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:33:07.024777 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cecc04a6-9145-4861-b0b8-c7ff7cb95434 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 09:33:07.029706 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application [None req-cecc04a6-9145-4861-b0b8-c7ff7cb95434 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 27 09:33:07.029706 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 09:33:07.029706 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 09:33:07.029706 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 09:33:07.029706 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 09:33:07.029706 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 09:33:07.029706 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 09:33:07.029706 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 09:33:07.029706 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 09:33:07.029706 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 09:33:07.029706 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 09:33:07.029706 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 09:33:07.029706 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 27 09:33:07.029706 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 27 09:33:07.029706 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 27 09:33:07.029706 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 27 09:33:07.031554 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 27 09:33:07.031554 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 27 09:33:07.031554 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 27 09:33:07.031554 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 27 09:33:07.031554 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 09:33:07.031554 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 09:33:07.031554 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 09:33:07.031554 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 09:33:07.031554 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 09:33:07.031554 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 09:33:07.031554 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 09:33:07.031554 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application with Lock( Oct 27 09:33:07.031554 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 09:33:07.031554 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._enter() Oct 27 09:33:07.031554 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 09:33:07.031554 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 09:33:07.032576 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 09:33:07.032576 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.creator() Oct 27 09:33:07.032576 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 09:33:07.032576 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application created_value = creator( Oct 27 09:33:07.032576 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 27 09:33:07.032576 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 27 09:33:07.032576 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 27 09:33:07.032576 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 27 09:33:07.032576 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 27 09:33:07.032576 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 27 09:33:07.032576 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 27 09:33:07.032576 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application Oct 27 09:33:07.032576 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 77/149] 10.222.0.65 () {56 vars in 1114 bytes} [Thu Oct 27 09:33:06 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 27 09:33:07.033410 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecc04a6-9145-4861-b0b8-c7ff7cb95434 None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:33:07.079239 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31e04ba-26a4-43c2-aaee-26ae2c267b71 None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:33:07.119447 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd63178a-9ac3-4d71-a12a-70bf7c9e5cdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:33:07.120058 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd63178a-9ac3-4d71-a12a-70bf7c9e5cdf None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:33:07.120346 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd63178a-9ac3-4d71-a12a-70bf7c9e5cdf None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:33:07.120624 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd63178a-9ac3-4d71-a12a-70bf7c9e5cdf None admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:33:07.121296 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd63178a-9ac3-4d71-a12a-70bf7c9e5cdf None admin] RBAC: Adding query filter params (name=admin) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 09:33:07.121602 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd63178a-9ac3-4d71-a12a-70bf7c9e5cdf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:33:07.123045 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd63178a-9ac3-4d71-a12a-70bf7c9e5cdf None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:33:07.136995 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 73/150] 10.222.0.65 () {56 vars in 1099 bytes} [Thu Oct 27 09:33:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 09:33:07.136995 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd63178a-9ac3-4d71-a12a-70bf7c9e5cdf None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:33:07.142651 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecc04a6-9145-4861-b0b8-c7ff7cb95434 None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:33:07.157013 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:33:07.179010 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d913a70-21c3-414f-b798-1fa36841b637 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:33:07.179636 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d913a70-21c3-414f-b798-1fa36841b637 None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:33:07.179916 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d913a70-21c3-414f-b798-1fa36841b637 None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:33:07.180187 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d913a70-21c3-414f-b798-1fa36841b637 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:33:07.181281 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d913a70-21c3-414f-b798-1fa36841b637 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:33:07.182861 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d913a70-21c3-414f-b798-1fa36841b637 None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:33:07.184424 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 78/151] 10.222.0.65 () {56 vars in 1108 bytes} [Thu Oct 27 09:33:07 2022] GET /identity/v3/domains/default => generated 199 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 09:33:07.187514 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d913a70-21c3-414f-b798-1fa36841b637 None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:33:07.239980 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd63178a-9ac3-4d71-a12a-70bf7c9e5cdf None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:33:07.240554 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:33:07.275178 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69814b2e-7e61-402a-8b66-0603bc81697c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:33:07.275780 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69814b2e-7e61-402a-8b66-0603bc81697c None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:33:07.276060 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69814b2e-7e61-402a-8b66-0603bc81697c None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:33:07.276334 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69814b2e-7e61-402a-8b66-0603bc81697c None admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:33:07.276993 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69814b2e-7e61-402a-8b66-0603bc81697c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 09:33:07.277297 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69814b2e-7e61-402a-8b66-0603bc81697c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:33:07.278707 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69814b2e-7e61-402a-8b66-0603bc81697c None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:33:07.287820 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 74/152] 10.222.0.65 () {56 vars in 1111 bytes} [Thu Oct 27 09:33:07 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 09:33:07.288694 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69814b2e-7e61-402a-8b66-0603bc81697c None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:33:07.293185 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d913a70-21c3-414f-b798-1fa36841b637 None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:33:07.328515 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f240ecdd-0238-439f-8061-5769a2866f6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:33:07.329406 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f240ecdd-0238-439f-8061-5769a2866f6d None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:33:07.329683 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f240ecdd-0238-439f-8061-5769a2866f6d None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:33:07.329956 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f240ecdd-0238-439f-8061-5769a2866f6d None admin] PATH_INFO: `/v3/users/e35642496dd14bbdb8525dcbe532dc84` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:33:07.343400 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f240ecdd-0238-439f-8061-5769a2866f6d None admin] RBAC: Authorizing `identity:get_user(user_id=e35642496dd14bbdb8525dcbe532dc84)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:33:07.345354 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f240ecdd-0238-439f-8061-5769a2866f6d None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:33:07.347319 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 79/153] 10.222.0.65 () {56 vars in 1177 bytes} [Thu Oct 27 09:33:07 2022] GET /identity/v3/users/e35642496dd14bbdb8525dcbe532dc84 => generated 283 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 09:33:07.348131 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f240ecdd-0238-439f-8061-5769a2866f6d None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:33:07.388575 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:33:07.406974 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69814b2e-7e61-402a-8b66-0603bc81697c None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:33:07.443467 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cb87a5-4a1a-454a-a8a3-cb1533f8aef5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:33:07.443995 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cb87a5-4a1a-454a-a8a3-cb1533f8aef5 None admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:33:07.444275 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cb87a5-4a1a-454a-a8a3-cb1533f8aef5 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:33:07.444550 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cb87a5-4a1a-454a-a8a3-cb1533f8aef5 None admin] PATH_INFO: `/v3/users` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:33:07.445193 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2cb87a5-4a1a-454a-a8a3-cb1533f8aef5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:33:07.446668 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2cb87a5-4a1a-454a-a8a3-cb1533f8aef5 None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:33:07.459777 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f240ecdd-0238-439f-8061-5769a2866f6d None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:33:07.467199 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:33:07.493689 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c185ea-883a-484d-b4ec-f865088f314c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:33:07.494317 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c185ea-883a-484d-b4ec-f865088f314c None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:33:07.494634 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c185ea-883a-484d-b4ec-f865088f314c None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:33:07.494911 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c185ea-883a-484d-b4ec-f865088f314c None admin] PATH_INFO: `/v3/users/e35642496dd14bbdb8525dcbe532dc84` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:33:07.496050 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c185ea-883a-484d-b4ec-f865088f314c None admin] RBAC: Authorizing `identity:get_user(user_id=e35642496dd14bbdb8525dcbe532dc84)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:33:07.497526 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c185ea-883a-484d-b4ec-f865088f314c None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:33:07.499271 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 80/154] 10.222.0.65 () {56 vars in 1177 bytes} [Thu Oct 27 09:33:07 2022] GET /identity/v3/users/e35642496dd14bbdb8525dcbe532dc84 => generated 283 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 09:33:07.500115 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c185ea-883a-484d-b4ec-f865088f314c None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:33:07.558588 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 75/155] 10.222.0.65 () {60 vars in 1132 bytes} [Thu Oct 27 09:33:07 2022] POST /identity/v3/users => generated 297 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 09:33:07.558588 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cb87a5-4a1a-454a-a8a3-cb1533f8aef5 None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:33:07.636224 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c185ea-883a-484d-b4ec-f865088f314c None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:33:07.679682 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562f6b48-ab4e-440f-be1e-7e5ac7e72dfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:33:07.680331 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562f6b48-ab4e-440f-be1e-7e5ac7e72dfd None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:33:07.680615 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562f6b48-ab4e-440f-be1e-7e5ac7e72dfd None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:33:07.680956 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562f6b48-ab4e-440f-be1e-7e5ac7e72dfd None admin] PATH_INFO: `/v3/projects/b86df928a9974a6993ae75bd68b27098` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:33:07.682177 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562f6b48-ab4e-440f-be1e-7e5ac7e72dfd None admin] RBAC: Authorizing `identity:get_project(project_id=b86df928a9974a6993ae75bd68b27098)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:33:07.683772 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562f6b48-ab4e-440f-be1e-7e5ac7e72dfd None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:33:07.685514 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 81/156] 10.222.0.65 () {56 vars in 1186 bytes} [Thu Oct 27 09:33:07 2022] GET /identity/v3/projects/b86df928a9974a6993ae75bd68b27098 => generated 302 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 09:33:07.691998 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cb87a5-4a1a-454a-a8a3-cb1533f8aef5 None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:33:07.692237 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562f6b48-ab4e-440f-be1e-7e5ac7e72dfd None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:33:07.732214 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5de4bcb-4f9b-4ac5-b7ef-a873bdc97b96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:33:07.732824 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5de4bcb-4f9b-4ac5-b7ef-a873bdc97b96 None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:33:07.733104 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5de4bcb-4f9b-4ac5-b7ef-a873bdc97b96 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:33:07.733397 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5de4bcb-4f9b-4ac5-b7ef-a873bdc97b96 None admin] PATH_INFO: `/v3/projects/b86df928a9974a6993ae75bd68b27098` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:33:07.734714 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5de4bcb-4f9b-4ac5-b7ef-a873bdc97b96 None admin] RBAC: Authorizing `identity:get_project(project_id=b86df928a9974a6993ae75bd68b27098)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:33:07.736203 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5de4bcb-4f9b-4ac5-b7ef-a873bdc97b96 None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:33:07.742818 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 76/157] 10.222.0.65 () {56 vars in 1186 bytes} [Thu Oct 27 09:33:07 2022] GET /identity/v3/projects/b86df928a9974a6993ae75bd68b27098 => generated 302 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 09:33:07.743725 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5de4bcb-4f9b-4ac5-b7ef-a873bdc97b96 None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:33:07.745196 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:33:07.756539 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:33:07.819082 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562f6b48-ab4e-440f-be1e-7e5ac7e72dfd None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:33:07.869872 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328a4fd3-b8f1-4d0c-9295-d89c037b8ad5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:33:07.870572 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328a4fd3-b8f1-4d0c-9295-d89c037b8ad5 None admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:33:07.870859 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328a4fd3-b8f1-4d0c-9295-d89c037b8ad5 None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:33:07.871134 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328a4fd3-b8f1-4d0c-9295-d89c037b8ad5 None admin] PATH_INFO: `/v3/projects/b86df928a9974a6993ae75bd68b27098/users/e35642496dd14bbdb8525dcbe532dc84/roles/6ad17b9f9dea4b66ab2da3677d7e715d` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:33:07.873521 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328a4fd3-b8f1-4d0c-9295-d89c037b8ad5 None admin] RBAC: Authorizing `identity:create_grant(project_id=b86df928a9974a6993ae75bd68b27098, user_id=e35642496dd14bbdb8525dcbe532dc84, role_id=6ad17b9f9dea4b66ab2da3677d7e715d)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:33:07.875577 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328a4fd3-b8f1-4d0c-9295-d89c037b8ad5 None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:33:07.878775 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5de4bcb-4f9b-4ac5-b7ef-a873bdc97b96 None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:33:07.916600 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf1f33b-ef6a-4519-9a03-076b6a70ff57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:33:07.917181 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf1f33b-ef6a-4519-9a03-076b6a70ff57 None admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:33:07.917466 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf1f33b-ef6a-4519-9a03-076b6a70ff57 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:33:07.917766 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf1f33b-ef6a-4519-9a03-076b6a70ff57 None admin] PATH_INFO: `/v3/projects/b86df928a9974a6993ae75bd68b27098/users/e35642496dd14bbdb8525dcbe532dc84/roles/438ff415f4f644afb2cc60293cc13741` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:33:07.919981 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf1f33b-ef6a-4519-9a03-076b6a70ff57 None admin] RBAC: Authorizing `identity:create_grant(project_id=b86df928a9974a6993ae75bd68b27098, user_id=e35642496dd14bbdb8525dcbe532dc84, role_id=438ff415f4f644afb2cc60293cc13741)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:33:07.922670 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf1f33b-ef6a-4519-9a03-076b6a70ff57 None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:33:07.956088 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 82/158] 10.222.0.65 () {58 vars in 1439 bytes} [Thu Oct 27 09:33:07 2022] PUT /identity/v3/projects/b86df928a9974a6993ae75bd68b27098/users/e35642496dd14bbdb8525dcbe532dc84/roles/6ad17b9f9dea4b66ab2da3677d7e715d => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 09:33:08.037517 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 77/159] 10.222.0.65 () {58 vars in 1439 bytes} [Thu Oct 27 09:33:07 2022] PUT /identity/v3/projects/b86df928a9974a6993ae75bd68b27098/users/e35642496dd14bbdb8525dcbe532dc84/roles/438ff415f4f644afb2cc60293cc13741 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 09:33:09.939575 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b70d53-099e-47ca-b10f-5a9a15ae7f2b None None] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:33:09.940547 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b70d53-099e-47ca-b10f-5a9a15ae7f2b None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:33:09.941023 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b70d53-099e-47ca-b10f-5a9a15ae7f2b None None] PATH_INFO: `/` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:33:09.942744 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 83/160] 10.222.0.65 () {54 vars in 927 bytes} [Thu Oct 27 09:33:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 09:33:09.948342 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600f0782-cfd6-4562-b483-5df96e1a395f None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:33:09.948793 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600f0782-cfd6-4562-b483-5df96e1a395f None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:33:09.948981 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600f0782-cfd6-4562-b483-5df96e1a395f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:33:09.958282 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7723cf0b-f882-45f3-b21c-04f5b4ec9c67 None None] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:33:09.958626 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7723cf0b-f882-45f3-b21c-04f5b4ec9c67 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:33:09.958868 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7723cf0b-f882-45f3-b21c-04f5b4ec9c67 None None] PATH_INFO: `/` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:33:09.960475 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 84/161] 10.222.0.65 () {54 vars in 927 bytes} [Thu Oct 27 09:33:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 27 09:33:09.965528 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f144afa-6ac7-46fd-8051-e4eaea2fa9b9 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:33:09.965812 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f144afa-6ac7-46fd-8051-e4eaea2fa9b9 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:33:09.966090 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f144afa-6ac7-46fd-8051-e4eaea2fa9b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:33:09.970372 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-600f0782-cfd6-4562-b483-5df96e1a395f None None] MFA Rules not processed for user `b5065084bf664b99bdeac46067cb0f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:33:09.971620 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-600f0782-cfd6-4562-b483-5df96e1a395f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:33:09.985668 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-0f144afa-6ac7-46fd-8051-e4eaea2fa9b9 None None] MFA Rules not processed for user `b5065084bf664b99bdeac46067cb0f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:33:09.986905 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-0f144afa-6ac7-46fd-8051-e4eaea2fa9b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:33:10.045009 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:33:10.054688 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 78/162] 10.222.0.65 () {58 vars in 1024 bytes} [Thu Oct 27 09:33:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 27 09:33:10.064041 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 85/163] 10.222.0.65 () {58 vars in 1024 bytes} [Thu Oct 27 09:33:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 27 09:33:10.200139 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd92c06-0f86-42c1-bcac-692d0d40ff2e None None] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:33:10.200434 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd92c06-0f86-42c1-bcac-692d0d40ff2e None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:33:10.200850 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd92c06-0f86-42c1-bcac-692d0d40ff2e None None] PATH_INFO: `/` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:33:10.202903 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 79/164] 10.222.0.65 () {54 vars in 927 bytes} [Thu Oct 27 09:33:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 09:33:10.209340 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fcf526-446b-471d-8120-6ed57360f152 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:33:10.209654 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fcf526-446b-471d-8120-6ed57360f152 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:33:10.209901 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fcf526-446b-471d-8120-6ed57360f152 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:33:10.229243 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-c2fcf526-446b-471d-8120-6ed57360f152 None None] MFA Rules not processed for user `b5065084bf664b99bdeac46067cb0f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:33:10.230440 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-c2fcf526-446b-471d-8120-6ed57360f152 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:33:10.258049 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:33:10.301738 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 86/165] 10.222.0.65 () {58 vars in 1024 bytes} [Thu Oct 27 09:33:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 27 09:33:10.303162 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e118c10-1686-4f73-9da3-f3833f61a2bb None None] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:33:10.303653 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e118c10-1686-4f73-9da3-f3833f61a2bb None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:33:10.304159 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e118c10-1686-4f73-9da3-f3833f61a2bb None None] PATH_INFO: `/` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:33:10.305693 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 80/166] 10.222.0.65 () {54 vars in 927 bytes} [Thu Oct 27 09:33:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 27 09:33:10.311103 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dce8d4-b50e-4251-b1b3-a6d073b54a84 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:33:10.311452 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dce8d4-b50e-4251-b1b3-a6d073b54a84 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:33:10.311734 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dce8d4-b50e-4251-b1b3-a6d073b54a84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:33:10.330913 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-91dce8d4-b50e-4251-b1b3-a6d073b54a84 None None] MFA Rules not processed for user `b5065084bf664b99bdeac46067cb0f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:33:10.332106 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-91dce8d4-b50e-4251-b1b3-a6d073b54a84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:33:10.345012 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e118c10-1686-4f73-9da3-f3833f61a2bb None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:33:10.410677 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 87/167] 10.222.0.65 () {58 vars in 1024 bytes} [Thu Oct 27 09:33:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 27 09:33:10.415328 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91dce8d4-b50e-4251-b1b3-a6d073b54a84 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:33:10.467048 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e118c10-1686-4f73-9da3-f3833f61a2bb None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:33:10.505028 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693f44f6-b3b0-4479-b8bc-4c8edb23f3d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:33:10.505666 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693f44f6-b3b0-4479-b8bc-4c8edb23f3d0 None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:33:10.505951 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693f44f6-b3b0-4479-b8bc-4c8edb23f3d0 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:33:10.506227 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693f44f6-b3b0-4479-b8bc-4c8edb23f3d0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:33:10.517073 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693f44f6-b3b0-4479-b8bc-4c8edb23f3d0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 09:33:10.521918 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application [None req-693f44f6-b3b0-4479-b8bc-4c8edb23f3d0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 27 09:33:10.521918 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 09:33:10.521918 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 09:33:10.521918 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 09:33:10.521918 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 09:33:10.521918 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 09:33:10.521918 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 09:33:10.521918 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 09:33:10.521918 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 09:33:10.521918 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 09:33:10.521918 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 09:33:10.521918 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 09:33:10.521918 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 27 09:33:10.521918 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 27 09:33:10.521918 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 27 09:33:10.521918 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 27 09:33:10.522922 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 27 09:33:10.522922 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 27 09:33:10.522922 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 27 09:33:10.522922 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 27 09:33:10.522922 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 09:33:10.522922 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 09:33:10.522922 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 09:33:10.522922 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 09:33:10.522922 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 09:33:10.522922 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 09:33:10.522922 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 09:33:10.522922 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application with Lock( Oct 27 09:33:10.522922 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 09:33:10.522922 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._enter() Oct 27 09:33:10.522922 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 09:33:10.522922 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 09:33:10.523677 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 09:33:10.523677 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.creator() Oct 27 09:33:10.523677 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 09:33:10.523677 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application created_value = creator( Oct 27 09:33:10.523677 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 27 09:33:10.523677 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 27 09:33:10.523677 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 27 09:33:10.523677 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 27 09:33:10.523677 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 27 09:33:10.523677 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 27 09:33:10.523677 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 27 09:33:10.523677 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application Oct 27 09:33:10.523677 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 81/168] 10.222.0.65 () {56 vars in 1099 bytes} [Thu Oct 27 09:33:10 2022] GET /identity/v3/roles/member => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 27 09:33:10.532104 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693f44f6-b3b0-4479-b8bc-4c8edb23f3d0 None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:33:10.550791 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:33:10.561163 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91dce8d4-b50e-4251-b1b3-a6d073b54a84 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:33:10.597965 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88ae87e-87e8-401c-b073-97a38dc76c04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:33:10.598624 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88ae87e-87e8-401c-b073-97a38dc76c04 None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:33:10.598912 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88ae87e-87e8-401c-b073-97a38dc76c04 None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:33:10.599189 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88ae87e-87e8-401c-b073-97a38dc76c04 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:33:10.600365 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88ae87e-87e8-401c-b073-97a38dc76c04 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:33:10.601884 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88ae87e-87e8-401c-b073-97a38dc76c04 None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:33:10.605451 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:33:10.609843 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 88/169] 10.222.0.65 () {56 vars in 1108 bytes} [Thu Oct 27 09:33:10 2022] GET /identity/v3/domains/default => generated 199 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 09:33:10.610748 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88ae87e-87e8-401c-b073-97a38dc76c04 None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:33:10.653808 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693f44f6-b3b0-4479-b8bc-4c8edb23f3d0 None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:33:10.693923 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690e5c5c-17d0-48d0-acd5-e9c9c8bab898 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:33:10.694588 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690e5c5c-17d0-48d0-acd5-e9c9c8bab898 None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:33:10.694878 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690e5c5c-17d0-48d0-acd5-e9c9c8bab898 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:33:10.695296 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690e5c5c-17d0-48d0-acd5-e9c9c8bab898 None admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:33:10.695994 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690e5c5c-17d0-48d0-acd5-e9c9c8bab898 None admin] RBAC: Adding query filter params (name=member) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 09:33:10.696297 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690e5c5c-17d0-48d0-acd5-e9c9c8bab898 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:33:10.697796 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690e5c5c-17d0-48d0-acd5-e9c9c8bab898 None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:33:10.707424 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 82/170] 10.222.0.65 () {56 vars in 1101 bytes} [Thu Oct 27 09:33:10 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 09:33:10.708541 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690e5c5c-17d0-48d0-acd5-e9c9c8bab898 None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:33:10.725105 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88ae87e-87e8-401c-b073-97a38dc76c04 None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:33:10.759737 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d59c1c1-cab6-4f47-9442-bd6387094897 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:33:10.760356 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d59c1c1-cab6-4f47-9442-bd6387094897 None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:33:10.760632 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d59c1c1-cab6-4f47-9442-bd6387094897 None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:33:10.760929 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d59c1c1-cab6-4f47-9442-bd6387094897 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:33:10.771099 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d59c1c1-cab6-4f47-9442-bd6387094897 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 09:33:10.775930 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application [None req-2d59c1c1-cab6-4f47-9442-bd6387094897 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 27 09:33:10.775930 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 09:33:10.775930 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 09:33:10.775930 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 09:33:10.775930 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 09:33:10.775930 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 09:33:10.775930 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 09:33:10.775930 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 09:33:10.775930 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 09:33:10.775930 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 09:33:10.775930 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 09:33:10.775930 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 09:33:10.775930 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 27 09:33:10.775930 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 27 09:33:10.775930 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 27 09:33:10.775930 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 27 09:33:10.776773 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 27 09:33:10.776773 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 27 09:33:10.776773 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 27 09:33:10.776773 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 27 09:33:10.776773 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 09:33:10.776773 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 09:33:10.776773 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 09:33:10.776773 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 09:33:10.776773 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 09:33:10.776773 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 09:33:10.776773 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 09:33:10.776773 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application with Lock( Oct 27 09:33:10.776773 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 09:33:10.776773 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._enter() Oct 27 09:33:10.776773 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 09:33:10.776773 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 09:33:10.777519 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 09:33:10.777519 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.creator() Oct 27 09:33:10.777519 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 09:33:10.777519 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application created_value = creator( Oct 27 09:33:10.777519 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 27 09:33:10.777519 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 27 09:33:10.777519 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 27 09:33:10.777519 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 27 09:33:10.777519 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 27 09:33:10.777519 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 27 09:33:10.777519 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 27 09:33:10.777519 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application Oct 27 09:33:10.777519 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 89/171] 10.222.0.65 () {56 vars in 1096 bytes} [Thu Oct 27 09:33:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 09:33:10.778169 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d59c1c1-cab6-4f47-9442-bd6387094897 None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:33:10.801354 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:33:10.816335 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690e5c5c-17d0-48d0-acd5-e9c9c8bab898 None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:33:10.833833 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:33:10.853346 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee9f8f7-1f25-436d-86aa-fdedc52a7d70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:33:10.853346 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee9f8f7-1f25-436d-86aa-fdedc52a7d70 None admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:33:10.853346 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee9f8f7-1f25-436d-86aa-fdedc52a7d70 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:33:10.853346 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee9f8f7-1f25-436d-86aa-fdedc52a7d70 None admin] PATH_INFO: `/v3/users` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:33:10.853675 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee9f8f7-1f25-436d-86aa-fdedc52a7d70 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:33:10.854784 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee9f8f7-1f25-436d-86aa-fdedc52a7d70 None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:33:10.883063 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d59c1c1-cab6-4f47-9442-bd6387094897 None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:33:10.918112 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6710a77b-0007-478a-933b-dd6945e13121 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:33:10.918770 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6710a77b-0007-478a-933b-dd6945e13121 None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:33:10.919056 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6710a77b-0007-478a-933b-dd6945e13121 None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:33:10.919335 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6710a77b-0007-478a-933b-dd6945e13121 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:33:10.926975 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 83/172] 10.222.0.65 () {60 vars in 1132 bytes} [Thu Oct 27 09:33:10 2022] POST /identity/v3/users => generated 297 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 09:33:10.927704 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee9f8f7-1f25-436d-86aa-fdedc52a7d70 None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:33:10.944563 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6710a77b-0007-478a-933b-dd6945e13121 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 09:33:10.951332 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application [None req-6710a77b-0007-478a-933b-dd6945e13121 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 27 09:33:10.951332 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 09:33:10.951332 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 09:33:10.951332 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 09:33:10.951332 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 09:33:10.951332 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 09:33:10.951332 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 09:33:10.951332 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 09:33:10.951332 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 09:33:10.951332 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 09:33:10.951332 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 09:33:10.951332 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 09:33:10.951332 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 27 09:33:10.951332 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 27 09:33:10.951332 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 27 09:33:10.951332 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 27 09:33:10.956517 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 27 09:33:10.956517 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 27 09:33:10.956517 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 27 09:33:10.956517 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 27 09:33:10.956517 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 09:33:10.956517 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 09:33:10.956517 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 09:33:10.956517 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 09:33:10.956517 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 09:33:10.956517 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 09:33:10.956517 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 09:33:10.956517 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application with Lock( Oct 27 09:33:10.956517 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 09:33:10.956517 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._enter() Oct 27 09:33:10.956517 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 09:33:10.956517 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 09:33:10.957748 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 09:33:10.957748 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.creator() Oct 27 09:33:10.957748 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 09:33:10.957748 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application created_value = creator( Oct 27 09:33:10.957748 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 27 09:33:10.957748 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 27 09:33:10.957748 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 27 09:33:10.957748 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 27 09:33:10.957748 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 27 09:33:10.957748 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 27 09:33:10.957748 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 27 09:33:10.957748 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application Oct 27 09:33:10.957748 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 90/173] 10.222.0.65 () {56 vars in 1114 bytes} [Thu Oct 27 09:33:10 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 09:33:10.957748 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6710a77b-0007-478a-933b-dd6945e13121 None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:33:11.052412 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:33:11.055549 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee9f8f7-1f25-436d-86aa-fdedc52a7d70 None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:33:11.074238 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6710a77b-0007-478a-933b-dd6945e13121 None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:33:11.097268 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5712cb1d-abc5-4442-a3e9-de938f309bdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:33:11.097916 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5712cb1d-abc5-4442-a3e9-de938f309bdc None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:33:11.098204 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5712cb1d-abc5-4442-a3e9-de938f309bdc None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:33:11.098481 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5712cb1d-abc5-4442-a3e9-de938f309bdc None admin] PATH_INFO: `/v3/users/a2319175b9524b90940c4eeb30e100d1` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:33:11.115595 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed4a5cd-953b-4d46-9377-0cbafe5f1fe4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:33:11.116347 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed4a5cd-953b-4d46-9377-0cbafe5f1fe4 None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:33:11.116768 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed4a5cd-953b-4d46-9377-0cbafe5f1fe4 None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:33:11.118022 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed4a5cd-953b-4d46-9377-0cbafe5f1fe4 None admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:33:11.118022 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed4a5cd-953b-4d46-9377-0cbafe5f1fe4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 09:33:11.118269 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed4a5cd-953b-4d46-9377-0cbafe5f1fe4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:33:11.118996 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5712cb1d-abc5-4442-a3e9-de938f309bdc None admin] RBAC: Authorizing `identity:get_user(user_id=a2319175b9524b90940c4eeb30e100d1)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:33:11.120452 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed4a5cd-953b-4d46-9377-0cbafe5f1fe4 None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:33:11.120553 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5712cb1d-abc5-4442-a3e9-de938f309bdc None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:33:11.121925 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 84/174] 10.222.0.65 () {56 vars in 1177 bytes} [Thu Oct 27 09:33:10 2022] GET /identity/v3/users/a2319175b9524b90940c4eeb30e100d1 => generated 297 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 09:33:11.122820 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5712cb1d-abc5-4442-a3e9-de938f309bdc None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:33:11.134605 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 91/175] 10.222.0.65 () {56 vars in 1099 bytes} [Thu Oct 27 09:33:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 09:33:11.135393 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed4a5cd-953b-4d46-9377-0cbafe5f1fe4 None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:33:11.163985 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:33:11.250264 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5712cb1d-abc5-4442-a3e9-de938f309bdc None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:33:11.294046 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed4a5cd-953b-4d46-9377-0cbafe5f1fe4 None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:33:11.296951 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdf252d-56df-4d8d-a8da-809c9ea22d19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:33:11.297106 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdf252d-56df-4d8d-a8da-809c9ea22d19 None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:33:11.297361 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdf252d-56df-4d8d-a8da-809c9ea22d19 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:33:11.297638 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdf252d-56df-4d8d-a8da-809c9ea22d19 None admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:33:11.298315 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bdf252d-56df-4d8d-a8da-809c9ea22d19 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 09:33:11.298651 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bdf252d-56df-4d8d-a8da-809c9ea22d19 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:33:11.300041 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bdf252d-56df-4d8d-a8da-809c9ea22d19 None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:33:11.309757 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 85/176] 10.222.0.65 () {56 vars in 1111 bytes} [Thu Oct 27 09:33:11 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 09:33:11.310549 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdf252d-56df-4d8d-a8da-809c9ea22d19 None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:33:11.342350 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e1c69f-b202-4c3e-b81c-45d0c3973430 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:33:11.349845 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e1c69f-b202-4c3e-b81c-45d0c3973430 None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:33:11.349845 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e1c69f-b202-4c3e-b81c-45d0c3973430 None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:33:11.349845 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e1c69f-b202-4c3e-b81c-45d0c3973430 None admin] PATH_INFO: `/v3/projects/b86df928a9974a6993ae75bd68b27098` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:33:11.349845 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e1c69f-b202-4c3e-b81c-45d0c3973430 None admin] RBAC: Authorizing `identity:get_project(project_id=b86df928a9974a6993ae75bd68b27098)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:33:11.349845 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e1c69f-b202-4c3e-b81c-45d0c3973430 None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:33:11.351648 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 92/177] 10.222.0.65 () {56 vars in 1186 bytes} [Thu Oct 27 09:33:11 2022] GET /identity/v3/projects/b86df928a9974a6993ae75bd68b27098 => generated 302 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 09:33:11.352434 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e1c69f-b202-4c3e-b81c-45d0c3973430 None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:33:11.373308 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:33:11.444780 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:33:11.453418 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdf252d-56df-4d8d-a8da-809c9ea22d19 None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:33:11.487205 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e1c69f-b202-4c3e-b81c-45d0c3973430 None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:33:11.497704 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706ede83-31c8-450e-ac15-972658b8a82b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:33:11.498348 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706ede83-31c8-450e-ac15-972658b8a82b None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:33:11.498660 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706ede83-31c8-450e-ac15-972658b8a82b None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:33:11.499873 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706ede83-31c8-450e-ac15-972658b8a82b None admin] PATH_INFO: `/v3/users/e35642496dd14bbdb8525dcbe532dc84` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:33:11.501340 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706ede83-31c8-450e-ac15-972658b8a82b None admin] RBAC: Authorizing `identity:get_user(user_id=e35642496dd14bbdb8525dcbe532dc84)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:33:11.503005 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706ede83-31c8-450e-ac15-972658b8a82b None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:33:11.505625 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 86/178] 10.222.0.65 () {56 vars in 1177 bytes} [Thu Oct 27 09:33:11 2022] GET /identity/v3/users/e35642496dd14bbdb8525dcbe532dc84 => generated 283 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 09:33:11.506395 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706ede83-31c8-450e-ac15-972658b8a82b None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:33:11.540437 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223bce2f-0233-42ee-b613-7d0330bb76d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:33:11.541172 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223bce2f-0233-42ee-b613-7d0330bb76d9 None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:33:11.541585 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223bce2f-0233-42ee-b613-7d0330bb76d9 None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:33:11.542202 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223bce2f-0233-42ee-b613-7d0330bb76d9 None admin] PATH_INFO: `/v3/users/e35642496dd14bbdb8525dcbe532dc84` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:33:11.544004 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223bce2f-0233-42ee-b613-7d0330bb76d9 None admin] RBAC: Authorizing `identity:get_user(user_id=e35642496dd14bbdb8525dcbe532dc84)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:33:11.546755 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223bce2f-0233-42ee-b613-7d0330bb76d9 None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:33:11.548751 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 93/179] 10.222.0.65 () {56 vars in 1177 bytes} [Thu Oct 27 09:33:11 2022] GET /identity/v3/users/e35642496dd14bbdb8525dcbe532dc84 => generated 283 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 09:33:11.550823 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223bce2f-0233-42ee-b613-7d0330bb76d9 None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:33:11.651114 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:33:11.680772 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223bce2f-0233-42ee-b613-7d0330bb76d9 None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:33:11.695428 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706ede83-31c8-450e-ac15-972658b8a82b None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:33:11.731488 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c351b79-fbcc-45b9-b88e-1d033919efb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:33:11.732539 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c351b79-fbcc-45b9-b88e-1d033919efb3 None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:33:11.732833 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c351b79-fbcc-45b9-b88e-1d033919efb3 None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:33:11.733688 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c351b79-fbcc-45b9-b88e-1d033919efb3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:33:11.743312 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b47525-0e1e-46a9-9c00-7118f29f8110 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:33:11.744273 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b47525-0e1e-46a9-9c00-7118f29f8110 None admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:33:11.744747 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b47525-0e1e-46a9-9c00-7118f29f8110 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:33:11.745167 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b47525-0e1e-46a9-9c00-7118f29f8110 None admin] PATH_INFO: `/v3/projects/b86df928a9974a6993ae75bd68b27098/users/a2319175b9524b90940c4eeb30e100d1/roles/43543ce1450245af9661cb017bac17bd` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:33:11.748160 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b47525-0e1e-46a9-9c00-7118f29f8110 None admin] RBAC: Authorizing `identity:create_grant(project_id=b86df928a9974a6993ae75bd68b27098, user_id=a2319175b9524b90940c4eeb30e100d1, role_id=43543ce1450245af9661cb017bac17bd)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:33:11.750416 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b47525-0e1e-46a9-9c00-7118f29f8110 None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:33:11.820971 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c351b79-fbcc-45b9-b88e-1d033919efb3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:33:11.822508 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c351b79-fbcc-45b9-b88e-1d033919efb3 None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:33:11.823046 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 87/180] 10.222.0.65 () {58 vars in 1439 bytes} [Thu Oct 27 09:33:11 2022] PUT /identity/v3/projects/b86df928a9974a6993ae75bd68b27098/users/a2319175b9524b90940c4eeb30e100d1/roles/43543ce1450245af9661cb017bac17bd => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 09:33:11.824133 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b47525-0e1e-46a9-9c00-7118f29f8110 None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:33:11.872736 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:33:12.020862 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:33:12.022643 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b47525-0e1e-46a9-9c00-7118f29f8110 None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:33:12.082480 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 94/181] 10.222.0.65 () {58 vars in 1282 bytes} [Thu Oct 27 09:33:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 532 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 27 09:33:12.086778 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c3c0dd-022a-4c9c-bd1b-91a3120c364b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:33:12.086778 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c3c0dd-022a-4c9c-bd1b-91a3120c364b None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:33:12.086778 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c3c0dd-022a-4c9c-bd1b-91a3120c364b None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:33:12.086778 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c3c0dd-022a-4c9c-bd1b-91a3120c364b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:33:12.090907 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c351b79-fbcc-45b9-b88e-1d033919efb3 None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:33:12.210660 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c351b79-fbcc-45b9-b88e-1d033919efb3 None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:33:12.242643 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c3c0dd-022a-4c9c-bd1b-91a3120c364b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:33:12.244128 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c3c0dd-022a-4c9c-bd1b-91a3120c364b None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:33:12.265406 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1696306-0900-4656-9df7-8adefeafe117 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:33:12.266425 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1696306-0900-4656-9df7-8adefeafe117 None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:33:12.266932 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1696306-0900-4656-9df7-8adefeafe117 None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:33:12.267426 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1696306-0900-4656-9df7-8adefeafe117 None admin] PATH_INFO: `/v3/projects/b86df928a9974a6993ae75bd68b27098` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:33:12.275048 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:33:12.276629 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1696306-0900-4656-9df7-8adefeafe117 None admin] RBAC: Authorizing `identity:get_project(project_id=b86df928a9974a6993ae75bd68b27098)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:33:12.278500 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1696306-0900-4656-9df7-8adefeafe117 None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:33:12.281014 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 95/182] 10.222.0.65 () {56 vars in 1186 bytes} [Thu Oct 27 09:33:12 2022] GET /identity/v3/projects/b86df928a9974a6993ae75bd68b27098 => generated 302 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 09:33:12.290463 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1696306-0900-4656-9df7-8adefeafe117 None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:33:12.360535 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 88/183] 10.222.0.65 () {58 vars in 1282 bytes} [Thu Oct 27 09:33:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 529 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 27 09:33:12.360535 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c3c0dd-022a-4c9c-bd1b-91a3120c364b None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:33:12.404241 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:33:12.486549 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c3c0dd-022a-4c9c-bd1b-91a3120c364b None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:33:12.507477 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:33:12.521857 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b2a58b-b2a1-4f40-952b-beda8a4582a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:33:12.522648 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b2a58b-b2a1-4f40-952b-beda8a4582a7 None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:33:12.522936 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b2a58b-b2a1-4f40-952b-beda8a4582a7 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:33:12.523215 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b2a58b-b2a1-4f40-952b-beda8a4582a7 None admin] PATH_INFO: `/v3/projects/b86df928a9974a6993ae75bd68b27098` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:33:12.524379 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b2a58b-b2a1-4f40-952b-beda8a4582a7 None admin] RBAC: Authorizing `identity:get_project(project_id=b86df928a9974a6993ae75bd68b27098)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:33:12.526249 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b2a58b-b2a1-4f40-952b-beda8a4582a7 None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:33:12.528466 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 89/184] 10.222.0.65 () {56 vars in 1186 bytes} [Thu Oct 27 09:33:12 2022] GET /identity/v3/projects/b86df928a9974a6993ae75bd68b27098 => generated 302 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 09:33:12.536408 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b2a58b-b2a1-4f40-952b-beda8a4582a7 None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:33:12.552527 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1696306-0900-4656-9df7-8adefeafe117 None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:33:12.636344 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67f6db2-1f67-422a-9bf3-cf4778afe11e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:33:12.638298 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67f6db2-1f67-422a-9bf3-cf4778afe11e None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:33:12.638298 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67f6db2-1f67-422a-9bf3-cf4778afe11e None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:33:12.638298 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67f6db2-1f67-422a-9bf3-cf4778afe11e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:33:12.638298 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67f6db2-1f67-422a-9bf3-cf4778afe11e None admin] RBAC: Adding query filter params (role.id=6ad17b9f9dea4b66ab2da3677d7e715d, scope.project.id=b86df928a9974a6993ae75bd68b27098, user.id=e35642496dd14bbdb8525dcbe532dc84) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 09:33:12.638631 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67f6db2-1f67-422a-9bf3-cf4778afe11e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:33:12.640772 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67f6db2-1f67-422a-9bf3-cf4778afe11e None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:33:12.647783 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 96/185] 10.222.0.65 () {56 vars in 1374 bytes} [Thu Oct 27 09:33:12 2022] GET /identity/v3/role_assignments?user.id=e35642496dd14bbdb8525dcbe532dc84&scope.project.id=b86df928a9974a6993ae75bd68b27098&role.id=6ad17b9f9dea4b66ab2da3677d7e715d => generated 608 bytes in 358 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 09:33:12.727627 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b2a58b-b2a1-4f40-952b-beda8a4582a7 None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:33:12.798941 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8c9f6a-6dd4-4226-893c-4573db0ee884 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:33:12.798941 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8c9f6a-6dd4-4226-893c-4573db0ee884 None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:33:12.798941 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8c9f6a-6dd4-4226-893c-4573db0ee884 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:33:12.798941 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8c9f6a-6dd4-4226-893c-4573db0ee884 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:33:12.799300 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8c9f6a-6dd4-4226-893c-4573db0ee884 None admin] RBAC: Adding query filter params (role.id=438ff415f4f644afb2cc60293cc13741, scope.project.id=b86df928a9974a6993ae75bd68b27098, user.id=e35642496dd14bbdb8525dcbe532dc84) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 09:33:12.799573 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8c9f6a-6dd4-4226-893c-4573db0ee884 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:33:12.801407 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8c9f6a-6dd4-4226-893c-4573db0ee884 None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:33:12.818552 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 90/186] 10.222.0.65 () {56 vars in 1374 bytes} [Thu Oct 27 09:33:12 2022] GET /identity/v3/role_assignments?user.id=e35642496dd14bbdb8525dcbe532dc84&scope.project.id=b86df928a9974a6993ae75bd68b27098&role.id=438ff415f4f644afb2cc60293cc13741 => generated 608 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 09:33:13.502678 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64a66c6-cbeb-404e-b2b4-cd1b8df6e985 None None] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:33:13.503201 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64a66c6-cbeb-404e-b2b4-cd1b8df6e985 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:33:13.503201 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64a66c6-cbeb-404e-b2b4-cd1b8df6e985 None None] PATH_INFO: `/` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:33:13.504695 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 97/187] 10.222.0.65 () {54 vars in 927 bytes} [Thu Oct 27 09:33:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 09:33:13.509899 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2cf094-bc14-4eaa-ba37-e8a2383761b6 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:33:13.510670 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2cf094-bc14-4eaa-ba37-e8a2383761b6 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:33:13.510965 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2cf094-bc14-4eaa-ba37-e8a2383761b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:33:13.532232 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-ab2cf094-bc14-4eaa-ba37-e8a2383761b6 None None] MFA Rules not processed for user `b5065084bf664b99bdeac46067cb0f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:33:13.533486 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-ab2cf094-bc14-4eaa-ba37-e8a2383761b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:33:13.651050 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:33:13.657059 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b3082d-6177-4a4a-8ad1-75ba1787cbbf None None] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:33:13.657350 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b3082d-6177-4a4a-8ad1-75ba1787cbbf None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:33:13.657630 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b3082d-6177-4a4a-8ad1-75ba1787cbbf None None] PATH_INFO: `/` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:33:13.659209 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 98/188] 10.222.0.65 () {54 vars in 927 bytes} [Thu Oct 27 09:33:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 09:33:13.664352 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07349ef1-0b36-4490-8851-955aaab5b980 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:33:13.664639 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07349ef1-0b36-4490-8851-955aaab5b980 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:33:13.664945 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07349ef1-0b36-4490-8851-955aaab5b980 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:33:13.669900 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 91/189] 10.222.0.65 () {58 vars in 1024 bytes} [Thu Oct 27 09:33:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 27 09:33:13.682653 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-07349ef1-0b36-4490-8851-955aaab5b980 None None] MFA Rules not processed for user `b5065084bf664b99bdeac46067cb0f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:33:13.683831 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-07349ef1-0b36-4490-8851-955aaab5b980 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:33:13.754101 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 99/190] 10.222.0.65 () {58 vars in 1024 bytes} [Thu Oct 27 09:33:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 27 09:33:13.948670 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2cf094-bc14-4eaa-ba37-e8a2383761b6 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:33:14.029604 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07349ef1-0b36-4490-8851-955aaab5b980 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:33:14.063690 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2cf094-bc14-4eaa-ba37-e8a2383761b6 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:33:14.073227 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:33:14.108977 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd8535a-5a8e-49b1-ab0b-b0f49cd44f42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:33:14.109999 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd8535a-5a8e-49b1-ab0b-b0f49cd44f42 None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:33:14.110434 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd8535a-5a8e-49b1-ab0b-b0f49cd44f42 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:33:14.110891 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd8535a-5a8e-49b1-ab0b-b0f49cd44f42 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:33:14.122507 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd8535a-5a8e-49b1-ab0b-b0f49cd44f42 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 09:33:14.128411 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application [None req-fdd8535a-5a8e-49b1-ab0b-b0f49cd44f42 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 27 09:33:14.128411 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 09:33:14.128411 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 09:33:14.128411 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 09:33:14.128411 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 09:33:14.128411 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 09:33:14.128411 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 09:33:14.128411 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 09:33:14.128411 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 09:33:14.128411 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 09:33:14.128411 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 09:33:14.128411 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 09:33:14.128411 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 27 09:33:14.128411 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 27 09:33:14.128411 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 27 09:33:14.128411 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 27 09:33:14.129310 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 27 09:33:14.129310 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 27 09:33:14.129310 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 27 09:33:14.129310 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 27 09:33:14.129310 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 09:33:14.129310 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 09:33:14.129310 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 09:33:14.129310 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 09:33:14.129310 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 09:33:14.129310 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 09:33:14.129310 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 09:33:14.129310 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application with Lock( Oct 27 09:33:14.129310 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 09:33:14.129310 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._enter() Oct 27 09:33:14.129310 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 09:33:14.129310 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 09:33:14.130097 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 09:33:14.130097 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.creator() Oct 27 09:33:14.130097 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 09:33:14.130097 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application created_value = creator( Oct 27 09:33:14.130097 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 27 09:33:14.130097 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 27 09:33:14.130097 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 27 09:33:14.130097 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 27 09:33:14.130097 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 27 09:33:14.130097 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 27 09:33:14.130097 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 27 09:33:14.130097 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application Oct 27 09:33:14.130097 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 92/191] 10.222.0.65 () {56 vars in 1099 bytes} [Thu Oct 27 09:33:13 2022] GET /identity/v3/roles/reader => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 09:33:14.136873 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd8535a-5a8e-49b1-ab0b-b0f49cd44f42 None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:33:14.139897 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07349ef1-0b36-4490-8851-955aaab5b980 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:33:14.179275 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40338278-2902-4d24-88ab-1289d01a5ee3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:33:14.180211 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40338278-2902-4d24-88ab-1289d01a5ee3 None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:33:14.180747 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40338278-2902-4d24-88ab-1289d01a5ee3 None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:33:14.181222 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40338278-2902-4d24-88ab-1289d01a5ee3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:33:14.182588 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40338278-2902-4d24-88ab-1289d01a5ee3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:33:14.184051 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40338278-2902-4d24-88ab-1289d01a5ee3 None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:33:14.185652 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 100/192] 10.222.0.65 () {56 vars in 1108 bytes} [Thu Oct 27 09:33:14 2022] GET /identity/v3/domains/default => generated 199 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 09:33:14.192152 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40338278-2902-4d24-88ab-1289d01a5ee3 None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:33:14.193784 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:33:14.260718 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd8535a-5a8e-49b1-ab0b-b0f49cd44f42 None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:33:14.301778 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f818d9-a8ca-40fc-9e7e-3943e16b0c3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:33:14.302304 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f818d9-a8ca-40fc-9e7e-3943e16b0c3d None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:33:14.302669 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f818d9-a8ca-40fc-9e7e-3943e16b0c3d None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:33:14.302919 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f818d9-a8ca-40fc-9e7e-3943e16b0c3d None admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:33:14.303586 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f818d9-a8ca-40fc-9e7e-3943e16b0c3d None admin] RBAC: Adding query filter params (name=reader) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 09:33:14.303889 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f818d9-a8ca-40fc-9e7e-3943e16b0c3d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:33:14.305724 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f818d9-a8ca-40fc-9e7e-3943e16b0c3d None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:33:14.309028 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40338278-2902-4d24-88ab-1289d01a5ee3 None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:33:14.315087 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 93/193] 10.222.0.65 () {56 vars in 1101 bytes} [Thu Oct 27 09:33:14 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 09:33:14.319799 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:33:14.320518 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f818d9-a8ca-40fc-9e7e-3943e16b0c3d None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:33:14.348330 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07044a3-f8b8-46c8-8176-0a550f2614c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:33:14.349107 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07044a3-f8b8-46c8-8176-0a550f2614c4 None admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:33:14.349388 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07044a3-f8b8-46c8-8176-0a550f2614c4 None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:33:14.349768 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07044a3-f8b8-46c8-8176-0a550f2614c4 None admin] PATH_INFO: `/v3/users` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:33:14.350495 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07044a3-f8b8-46c8-8176-0a550f2614c4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:33:14.352594 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07044a3-f8b8-46c8-8176-0a550f2614c4 None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:33:14.431966 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f818d9-a8ca-40fc-9e7e-3943e16b0c3d None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:33:14.439228 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:33:14.458560 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 101/194] 10.222.0.65 () {60 vars in 1132 bytes} [Thu Oct 27 09:33:14 2022] POST /identity/v3/users => generated 293 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 09:33:14.472365 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f3c70f-a477-43b0-84e4-18f2fcc50219 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:33:14.473027 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f3c70f-a477-43b0-84e4-18f2fcc50219 None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:33:14.473315 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f3c70f-a477-43b0-84e4-18f2fcc50219 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:33:14.473595 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f3c70f-a477-43b0-84e4-18f2fcc50219 None admin] PATH_INFO: `/v3/users/bbf26d3533794af8a4b275110c6297f0` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:33:14.487578 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0de396e-b8a2-42ba-9834-e36f914762a7 None None] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:33:14.487931 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0de396e-b8a2-42ba-9834-e36f914762a7 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:33:14.488212 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0de396e-b8a2-42ba-9834-e36f914762a7 None None] PATH_INFO: `/` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:33:14.489915 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 102/195] 10.222.0.65 () {54 vars in 927 bytes} [Thu Oct 27 09:33:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 27 09:33:14.492119 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f3c70f-a477-43b0-84e4-18f2fcc50219 None admin] RBAC: Authorizing `identity:get_user(user_id=bbf26d3533794af8a4b275110c6297f0)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:33:14.493688 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f3c70f-a477-43b0-84e4-18f2fcc50219 None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:33:14.500058 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 94/196] 10.222.0.65 () {56 vars in 1177 bytes} [Thu Oct 27 09:33:14 2022] GET /identity/v3/users/bbf26d3533794af8a4b275110c6297f0 => generated 297 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 09:33:14.500850 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2a1d95-e732-4d6d-8be0-16925f8cfbc4 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:33:14.501043 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2a1d95-e732-4d6d-8be0-16925f8cfbc4 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:33:14.501326 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2a1d95-e732-4d6d-8be0-16925f8cfbc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:33:14.501609 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f3c70f-a477-43b0-84e4-18f2fcc50219 None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:33:14.521645 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-3d2a1d95-e732-4d6d-8be0-16925f8cfbc4 None None] MFA Rules not processed for user `b5065084bf664b99bdeac46067cb0f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:33:14.522928 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-3d2a1d95-e732-4d6d-8be0-16925f8cfbc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:33:14.597587 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 103/197] 10.222.0.65 () {58 vars in 1024 bytes} [Thu Oct 27 09:33:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 27 09:33:14.630937 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f3c70f-a477-43b0-84e4-18f2fcc50219 None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:33:14.671352 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44c5219-a802-484d-ba2c-0820ba4152f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:33:14.671990 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44c5219-a802-484d-ba2c-0820ba4152f3 None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:33:14.672296 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44c5219-a802-484d-ba2c-0820ba4152f3 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:33:14.672567 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44c5219-a802-484d-ba2c-0820ba4152f3 None admin] PATH_INFO: `/v3/projects/b86df928a9974a6993ae75bd68b27098` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:33:14.673696 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44c5219-a802-484d-ba2c-0820ba4152f3 None admin] RBAC: Authorizing `identity:get_project(project_id=b86df928a9974a6993ae75bd68b27098)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:33:14.675174 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44c5219-a802-484d-ba2c-0820ba4152f3 None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:33:14.676810 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 95/198] 10.222.0.65 () {56 vars in 1186 bytes} [Thu Oct 27 09:33:14 2022] GET /identity/v3/projects/b86df928a9974a6993ae75bd68b27098 => generated 302 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 09:33:14.683063 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2a1d95-e732-4d6d-8be0-16925f8cfbc4 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:33:14.794721 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:33:14.802859 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2a1d95-e732-4d6d-8be0-16925f8cfbc4 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:33:14.862645 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b530af9-4f9c-4a92-a2f4-535f2b34e22b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:33:14.862645 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b530af9-4f9c-4a92-a2f4-535f2b34e22b None admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:33:14.862645 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b530af9-4f9c-4a92-a2f4-535f2b34e22b None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:33:14.862645 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b530af9-4f9c-4a92-a2f4-535f2b34e22b None admin] PATH_INFO: `/v3/projects/b86df928a9974a6993ae75bd68b27098/users/bbf26d3533794af8a4b275110c6297f0/roles/4d4811302e664f5fac66b7229e5c1b8f` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:33:14.863075 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b530af9-4f9c-4a92-a2f4-535f2b34e22b None admin] RBAC: Authorizing `identity:create_grant(project_id=b86df928a9974a6993ae75bd68b27098, user_id=bbf26d3533794af8a4b275110c6297f0, role_id=4d4811302e664f5fac66b7229e5c1b8f)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:33:14.863851 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b530af9-4f9c-4a92-a2f4-535f2b34e22b None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:33:14.872606 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44c5219-a802-484d-ba2c-0820ba4152f3 None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:33:14.912126 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:33:14.971745 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 104/199] 10.222.0.65 () {58 vars in 1439 bytes} [Thu Oct 27 09:33:14 2022] PUT /identity/v3/projects/b86df928a9974a6993ae75bd68b27098/users/bbf26d3533794af8a4b275110c6297f0/roles/4d4811302e664f5fac66b7229e5c1b8f => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 09:33:14.993033 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44c5219-a802-484d-ba2c-0820ba4152f3 None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:33:15.035438 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffb39c3-f606-41e0-ba62-a9d7557c92e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:33:15.036183 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffb39c3-f606-41e0-ba62-a9d7557c92e3 None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:33:15.036466 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffb39c3-f606-41e0-ba62-a9d7557c92e3 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:33:15.036738 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffb39c3-f606-41e0-ba62-a9d7557c92e3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:33:15.049430 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fffb39c3-f606-41e0-ba62-a9d7557c92e3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 09:33:15.054729 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application [None req-fffb39c3-f606-41e0-ba62-a9d7557c92e3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 27 09:33:15.054729 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 09:33:15.054729 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 09:33:15.054729 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 09:33:15.054729 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 09:33:15.054729 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 09:33:15.054729 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 09:33:15.054729 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 09:33:15.054729 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 09:33:15.054729 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 09:33:15.054729 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 09:33:15.054729 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 09:33:15.054729 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 27 09:33:15.054729 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 27 09:33:15.054729 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 27 09:33:15.054729 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 27 09:33:15.055652 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 27 09:33:15.055652 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 27 09:33:15.055652 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 27 09:33:15.055652 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 27 09:33:15.055652 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 09:33:15.055652 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 09:33:15.055652 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 09:33:15.055652 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 09:33:15.055652 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 09:33:15.055652 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 09:33:15.055652 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 09:33:15.055652 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application with Lock( Oct 27 09:33:15.055652 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 09:33:15.055652 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._enter() Oct 27 09:33:15.055652 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 09:33:15.055652 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 09:33:15.056437 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 09:33:15.056437 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.creator() Oct 27 09:33:15.056437 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 09:33:15.056437 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application created_value = creator( Oct 27 09:33:15.056437 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 27 09:33:15.056437 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 27 09:33:15.056437 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 27 09:33:15.056437 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 27 09:33:15.056437 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 27 09:33:15.056437 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 27 09:33:15.056437 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 27 09:33:15.056437 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application Oct 27 09:33:15.061635 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 96/200] 10.222.0.65 () {56 vars in 1099 bytes} [Thu Oct 27 09:33:14 2022] GET /identity/v3/roles/member => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 27 09:33:15.063711 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b530af9-4f9c-4a92-a2f4-535f2b34e22b None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:33:15.181475 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b530af9-4f9c-4a92-a2f4-535f2b34e22b None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:33:15.220331 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235020ac-db3d-4eb6-b2d9-4fc330cab699 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:33:15.220941 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235020ac-db3d-4eb6-b2d9-4fc330cab699 None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:33:15.221219 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235020ac-db3d-4eb6-b2d9-4fc330cab699 None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:33:15.221487 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235020ac-db3d-4eb6-b2d9-4fc330cab699 None admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:33:15.222202 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235020ac-db3d-4eb6-b2d9-4fc330cab699 None admin] RBAC: Adding query filter params (name=member) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 09:33:15.222511 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235020ac-db3d-4eb6-b2d9-4fc330cab699 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:33:15.224003 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235020ac-db3d-4eb6-b2d9-4fc330cab699 None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:33:15.238326 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 105/201] 10.222.0.65 () {56 vars in 1101 bytes} [Thu Oct 27 09:33:15 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 09:33:15.239698 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffb39c3-f606-41e0-ba62-a9d7557c92e3 None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:33:15.339635 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:33:15.348861 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffb39c3-f606-41e0-ba62-a9d7557c92e3 None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:33:15.387561 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8084ba05-d304-49c5-bdfc-af7112f28d00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:33:15.388206 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8084ba05-d304-49c5-bdfc-af7112f28d00 None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:33:15.388487 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8084ba05-d304-49c5-bdfc-af7112f28d00 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:33:15.388767 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8084ba05-d304-49c5-bdfc-af7112f28d00 None admin] PATH_INFO: `/v3/users/a2319175b9524b90940c4eeb30e100d1` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:33:15.390015 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8084ba05-d304-49c5-bdfc-af7112f28d00 None admin] RBAC: Authorizing `identity:get_user(user_id=a2319175b9524b90940c4eeb30e100d1)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:33:15.391501 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8084ba05-d304-49c5-bdfc-af7112f28d00 None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:33:15.393465 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 97/202] 10.222.0.65 () {56 vars in 1177 bytes} [Thu Oct 27 09:33:15 2022] GET /identity/v3/users/a2319175b9524b90940c4eeb30e100d1 => generated 297 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 09:33:15.398906 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235020ac-db3d-4eb6-b2d9-4fc330cab699 None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:33:15.422577 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:33:15.516873 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235020ac-db3d-4eb6-b2d9-4fc330cab699 None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:33:15.554058 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbb6249-23a3-4422-9f29-5deeec26cbb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:33:15.555636 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbb6249-23a3-4422-9f29-5deeec26cbb5 None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:33:15.556134 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbb6249-23a3-4422-9f29-5deeec26cbb5 None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:33:15.556664 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbb6249-23a3-4422-9f29-5deeec26cbb5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:33:15.648916 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbb6249-23a3-4422-9f29-5deeec26cbb5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:33:15.650398 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbb6249-23a3-4422-9f29-5deeec26cbb5 None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:33:15.668826 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:33:15.754492 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 106/203] 10.222.0.65 () {58 vars in 1282 bytes} [Thu Oct 27 09:33:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 27 09:33:15.760231 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8084ba05-d304-49c5-bdfc-af7112f28d00 None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:33:15.871133 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8084ba05-d304-49c5-bdfc-af7112f28d00 None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:33:15.909204 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6aa0aa-daab-494d-a7b7-dc92cdb4fe6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:33:15.909836 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6aa0aa-daab-494d-a7b7-dc92cdb4fe6f None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:33:15.910188 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6aa0aa-daab-494d-a7b7-dc92cdb4fe6f None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:33:15.910474 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6aa0aa-daab-494d-a7b7-dc92cdb4fe6f None admin] PATH_INFO: `/v3/projects/b86df928a9974a6993ae75bd68b27098` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:33:15.911641 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6aa0aa-daab-494d-a7b7-dc92cdb4fe6f None admin] RBAC: Authorizing `identity:get_project(project_id=b86df928a9974a6993ae75bd68b27098)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:33:15.913116 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6aa0aa-daab-494d-a7b7-dc92cdb4fe6f None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:33:15.914800 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 98/204] 10.222.0.65 () {56 vars in 1186 bytes} [Thu Oct 27 09:33:15 2022] GET /identity/v3/projects/b86df928a9974a6993ae75bd68b27098 => generated 302 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 09:33:15.921586 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbb6249-23a3-4422-9f29-5deeec26cbb5 None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:33:16.032350 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbb6249-23a3-4422-9f29-5deeec26cbb5 None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:33:16.049957 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:33:16.068824 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77410999-0a8b-432a-bd25-c7fe361fea29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:33:16.069433 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77410999-0a8b-432a-bd25-c7fe361fea29 None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:33:16.069717 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77410999-0a8b-432a-bd25-c7fe361fea29 None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:33:16.069996 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77410999-0a8b-432a-bd25-c7fe361fea29 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:33:16.070743 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77410999-0a8b-432a-bd25-c7fe361fea29 None admin] RBAC: Adding query filter params (role.id=43543ce1450245af9661cb017bac17bd, scope.project.id=b86df928a9974a6993ae75bd68b27098, user.id=a2319175b9524b90940c4eeb30e100d1) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 09:33:16.071053 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77410999-0a8b-432a-bd25-c7fe361fea29 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:33:16.072556 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77410999-0a8b-432a-bd25-c7fe361fea29 None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:33:16.091067 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 107/205] 10.222.0.65 () {56 vars in 1374 bytes} [Thu Oct 27 09:33:15 2022] GET /identity/v3/role_assignments?user.id=a2319175b9524b90940c4eeb30e100d1&scope.project.id=b86df928a9974a6993ae75bd68b27098&role.id=43543ce1450245af9661cb017bac17bd => generated 608 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 09:33:16.916580 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc507d9-20dc-4e0d-bb28-bcdb32e0585f None None] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:33:16.917089 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc507d9-20dc-4e0d-bb28-bcdb32e0585f None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:33:16.917162 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc507d9-20dc-4e0d-bb28-bcdb32e0585f None None] PATH_INFO: `/` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:33:16.918492 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 99/206] 10.222.0.65 () {54 vars in 927 bytes} [Thu Oct 27 09:33:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 09:33:16.924946 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92099e92-7a94-4ab1-8c39-1a0a1a2fcba7 None None] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:33:16.925237 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92099e92-7a94-4ab1-8c39-1a0a1a2fcba7 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:33:16.925517 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92099e92-7a94-4ab1-8c39-1a0a1a2fcba7 None None] PATH_INFO: `/` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:33:16.926278 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadc5b97-223d-44ea-b9b4-3c5d21eddf89 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:33:16.926712 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadc5b97-223d-44ea-b9b4-3c5d21eddf89 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:33:16.926867 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadc5b97-223d-44ea-b9b4-3c5d21eddf89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:33:16.927076 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 100/207] 10.222.0.65 () {54 vars in 927 bytes} [Thu Oct 27 09:33:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 27 09:33:16.932172 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7e9536-9d88-4926-84a4-dad98dde0794 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:33:16.932461 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7e9536-9d88-4926-84a4-dad98dde0794 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:33:16.932738 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7e9536-9d88-4926-84a4-dad98dde0794 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:33:16.946113 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-fadc5b97-223d-44ea-b9b4-3c5d21eddf89 None None] MFA Rules not processed for user `b5065084bf664b99bdeac46067cb0f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:33:16.947359 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-fadc5b97-223d-44ea-b9b4-3c5d21eddf89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:33:16.951971 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-5d7e9536-9d88-4926-84a4-dad98dde0794 None None] MFA Rules not processed for user `b5065084bf664b99bdeac46067cb0f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:33:16.953323 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-5d7e9536-9d88-4926-84a4-dad98dde0794 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:33:16.978757 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:33:17.025615 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 108/208] 10.222.0.65 () {58 vars in 1024 bytes} [Thu Oct 27 09:33:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 27 09:33:17.030751 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 101/209] 10.222.0.65 () {58 vars in 1024 bytes} [Thu Oct 27 09:33:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 27 09:33:17.300824 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadc5b97-223d-44ea-b9b4-3c5d21eddf89 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:33:17.303585 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7e9536-9d88-4926-84a4-dad98dde0794 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:33:17.412420 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7e9536-9d88-4926-84a4-dad98dde0794 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:33:17.412782 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadc5b97-223d-44ea-b9b4-3c5d21eddf89 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:33:17.423974 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:33:17.446911 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b82173-8ec1-41be-9bd9-f84607db520e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:33:17.447166 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe215bd-6295-4acc-a392-2de3ea9be8b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:33:17.447583 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b82173-8ec1-41be-9bd9-f84607db520e None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:33:17.447798 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe215bd-6295-4acc-a392-2de3ea9be8b4 None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:33:17.447888 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b82173-8ec1-41be-9bd9-f84607db520e None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:33:17.448080 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe215bd-6295-4acc-a392-2de3ea9be8b4 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:33:17.448169 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b82173-8ec1-41be-9bd9-f84607db520e None admin] PATH_INFO: `/v3/domains/default` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:33:17.448354 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe215bd-6295-4acc-a392-2de3ea9be8b4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:33:17.449197 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b82173-8ec1-41be-9bd9-f84607db520e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:33:17.450871 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b82173-8ec1-41be-9bd9-f84607db520e None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:33:17.454005 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 109/210] 10.222.0.65 () {56 vars in 1108 bytes} [Thu Oct 27 09:33:17 2022] GET /identity/v3/domains/default => generated 199 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 09:33:17.455174 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f78a038-7847-452c-aed9-b0e6d22f0f07 None None] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:33:17.455451 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f78a038-7847-452c-aed9-b0e6d22f0f07 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:33:17.455763 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f78a038-7847-452c-aed9-b0e6d22f0f07 None None] PATH_INFO: `/` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:33:17.457055 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 110/211] 10.222.0.65 () {54 vars in 927 bytes} [Thu Oct 27 09:33:17 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 09:33:17.459566 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f78a038-7847-452c-aed9-b0e6d22f0f07 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:33:17.461212 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe215bd-6295-4acc-a392-2de3ea9be8b4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 09:33:17.465908 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application [None req-2fe215bd-6295-4acc-a392-2de3ea9be8b4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 27 09:33:17.465908 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 09:33:17.465908 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 09:33:17.465908 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 09:33:17.465908 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 09:33:17.465908 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 09:33:17.465908 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 09:33:17.465908 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 09:33:17.465908 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 09:33:17.465908 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 09:33:17.465908 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 09:33:17.465908 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 09:33:17.465908 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 27 09:33:17.465908 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 27 09:33:17.465908 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 27 09:33:17.465908 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 27 09:33:17.466988 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 27 09:33:17.466988 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 27 09:33:17.466988 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 27 09:33:17.466988 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 27 09:33:17.466988 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 09:33:17.466988 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 09:33:17.466988 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 09:33:17.466988 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 09:33:17.466988 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 09:33:17.466988 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 09:33:17.466988 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 09:33:17.466988 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application with Lock( Oct 27 09:33:17.466988 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 09:33:17.466988 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._enter() Oct 27 09:33:17.466988 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 09:33:17.466988 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 09:33:17.467958 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 09:33:17.467958 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.creator() Oct 27 09:33:17.467958 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 09:33:17.467958 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application created_value = creator( Oct 27 09:33:17.467958 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 27 09:33:17.467958 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 27 09:33:17.467958 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 27 09:33:17.467958 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 27 09:33:17.467958 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 27 09:33:17.467958 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 27 09:33:17.467958 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 27 09:33:17.467958 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application Oct 27 09:33:17.471988 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 102/212] 10.222.0.65 () {56 vars in 1099 bytes} [Thu Oct 27 09:33:17 2022] GET /identity/v3/roles/member => generated 84 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 09:33:17.473133 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25989625-9b07-427a-9982-1a42bd73ded4 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:33:17.473416 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25989625-9b07-427a-9982-1a42bd73ded4 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:33:17.473690 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25989625-9b07-427a-9982-1a42bd73ded4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:33:17.491342 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-25989625-9b07-427a-9982-1a42bd73ded4 None None] MFA Rules not processed for user `b5065084bf664b99bdeac46067cb0f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:33:17.492785 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-25989625-9b07-427a-9982-1a42bd73ded4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:33:17.510887 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:33:17.565516 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f78a038-7847-452c-aed9-b0e6d22f0f07 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:33:17.567402 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 103/213] 10.222.0.65 () {58 vars in 1024 bytes} [Thu Oct 27 09:33:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 27 09:33:17.568243 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25989625-9b07-427a-9982-1a42bd73ded4 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:33:17.603900 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2427728-5473-4355-b0f6-c764e2c221e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:33:17.604840 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2427728-5473-4355-b0f6-c764e2c221e4 None admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:33:17.605121 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2427728-5473-4355-b0f6-c764e2c221e4 None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:33:17.605391 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2427728-5473-4355-b0f6-c764e2c221e4 None admin] PATH_INFO: `/v3/users` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:33:17.606039 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2427728-5473-4355-b0f6-c764e2c221e4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:33:17.607591 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2427728-5473-4355-b0f6-c764e2c221e4 None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:33:17.681084 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25989625-9b07-427a-9982-1a42bd73ded4 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:33:17.709181 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 111/214] 10.222.0.65 () {60 vars in 1132 bytes} [Thu Oct 27 09:33:17 2022] POST /identity/v3/users => generated 293 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 09:33:17.715234 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc5b1f4-fa59-443b-80d5-d5e1e5124872 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:33:17.715869 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc5b1f4-fa59-443b-80d5-d5e1e5124872 None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:33:17.716150 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc5b1f4-fa59-443b-80d5-d5e1e5124872 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:33:17.716421 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc5b1f4-fa59-443b-80d5-d5e1e5124872 None admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:33:17.717802 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc5b1f4-fa59-443b-80d5-d5e1e5124872 None admin] RBAC: Adding query filter params (name=member) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 09:33:17.718110 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc5b1f4-fa59-443b-80d5-d5e1e5124872 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:33:17.719577 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc5b1f4-fa59-443b-80d5-d5e1e5124872 None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:33:17.730758 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 104/215] 10.222.0.65 () {56 vars in 1101 bytes} [Thu Oct 27 09:33:17 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 09:33:17.736974 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2427728-5473-4355-b0f6-c764e2c221e4 None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:33:17.776997 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:33:17.847792 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc5b1f4-fa59-443b-80d5-d5e1e5124872 None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:33:17.862497 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:33:17.865470 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2427728-5473-4355-b0f6-c764e2c221e4 None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:33:17.911102 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373f12a2-2c53-476b-b0f7-8a27912a6720 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:33:17.911750 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373f12a2-2c53-476b-b0f7-8a27912a6720 None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:33:17.912091 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373f12a2-2c53-476b-b0f7-8a27912a6720 None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:33:17.912366 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373f12a2-2c53-476b-b0f7-8a27912a6720 None admin] PATH_INFO: `/v3/users/aa6e38ded8fe41bb9f726525bd161643` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:33:17.927694 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373f12a2-2c53-476b-b0f7-8a27912a6720 None admin] RBAC: Authorizing `identity:get_user(user_id=aa6e38ded8fe41bb9f726525bd161643)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:33:17.929164 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373f12a2-2c53-476b-b0f7-8a27912a6720 None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:33:17.931039 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 112/216] 10.222.0.65 () {56 vars in 1177 bytes} [Thu Oct 27 09:33:17 2022] GET /identity/v3/users/aa6e38ded8fe41bb9f726525bd161643 => generated 293 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 09:33:17.937784 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373f12a2-2c53-476b-b0f7-8a27912a6720 None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:33:17.979280 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc5b1f4-fa59-443b-80d5-d5e1e5124872 None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:33:18.027852 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f48c6b-b5e1-4ab9-b425-25a157c4749e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:33:18.028826 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f48c6b-b5e1-4ab9-b425-25a157c4749e None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:33:18.029318 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f48c6b-b5e1-4ab9-b425-25a157c4749e None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:33:18.030397 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f48c6b-b5e1-4ab9-b425-25a157c4749e None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:33:18.046327 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f48c6b-b5e1-4ab9-b425-25a157c4749e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 09:33:18.051297 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application [None req-91f48c6b-b5e1-4ab9-b425-25a157c4749e None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 27 09:33:18.051297 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 09:33:18.051297 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 09:33:18.051297 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 09:33:18.051297 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 09:33:18.051297 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 09:33:18.051297 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 09:33:18.051297 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 09:33:18.051297 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 09:33:18.051297 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 09:33:18.051297 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 09:33:18.051297 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 09:33:18.051297 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 27 09:33:18.051297 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 27 09:33:18.051297 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 27 09:33:18.051297 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 27 09:33:18.052197 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 27 09:33:18.052197 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 27 09:33:18.052197 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 27 09:33:18.052197 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 27 09:33:18.052197 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 09:33:18.052197 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 09:33:18.052197 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 09:33:18.052197 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 09:33:18.052197 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 09:33:18.052197 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 09:33:18.052197 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 09:33:18.052197 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application with Lock( Oct 27 09:33:18.052197 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 09:33:18.052197 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._enter() Oct 27 09:33:18.052197 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 09:33:18.052197 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 09:33:18.052950 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 09:33:18.052950 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.creator() Oct 27 09:33:18.052950 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 09:33:18.052950 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application created_value = creator( Oct 27 09:33:18.052950 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 27 09:33:18.052950 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 27 09:33:18.052950 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 27 09:33:18.052950 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 27 09:33:18.052950 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 27 09:33:18.052950 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 27 09:33:18.052950 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 27 09:33:18.052950 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application Oct 27 09:33:18.052950 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 105/217] 10.222.0.65 () {56 vars in 1099 bytes} [Thu Oct 27 09:33:17 2022] GET /identity/v3/roles/reader => generated 84 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 27 09:33:18.053585 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:33:18.058275 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f48c6b-b5e1-4ab9-b425-25a157c4749e None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:33:18.060847 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373f12a2-2c53-476b-b0f7-8a27912a6720 None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:33:18.115950 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0360e2fa-ef72-4892-b6c8-07c01918aafe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:33:18.117019 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0360e2fa-ef72-4892-b6c8-07c01918aafe None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:33:18.130501 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0360e2fa-ef72-4892-b6c8-07c01918aafe None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:33:18.130501 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0360e2fa-ef72-4892-b6c8-07c01918aafe None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:33:18.130501 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0360e2fa-ef72-4892-b6c8-07c01918aafe None admin] RBAC: Adding query filter params (role.id=43543ce1450245af9661cb017bac17bd, user.id=aa6e38ded8fe41bb9f726525bd161643, scope.system=all) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 09:33:18.130501 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0360e2fa-ef72-4892-b6c8-07c01918aafe None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:33:18.130501 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0360e2fa-ef72-4892-b6c8-07c01918aafe None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:33:18.130501 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 113/218] 10.222.0.65 () {56 vars in 1308 bytes} [Thu Oct 27 09:33:17 2022] GET /identity/v3/role_assignments?user.id=aa6e38ded8fe41bb9f726525bd161643&scope.system=all&role.id=43543ce1450245af9661cb017bac17bd => generated 226 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 09:33:18.152377 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:33:18.189875 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f48c6b-b5e1-4ab9-b425-25a157c4749e None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:33:18.233234 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c25a8f8-8f84-47dc-860a-f6d505d626eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:33:18.234281 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c25a8f8-8f84-47dc-860a-f6d505d626eb None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:33:18.234883 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c25a8f8-8f84-47dc-860a-f6d505d626eb None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:33:18.235365 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c25a8f8-8f84-47dc-860a-f6d505d626eb None admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:33:18.236263 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c25a8f8-8f84-47dc-860a-f6d505d626eb None admin] RBAC: Adding query filter params (name=reader) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 09:33:18.236780 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c25a8f8-8f84-47dc-860a-f6d505d626eb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:33:18.238499 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c25a8f8-8f84-47dc-860a-f6d505d626eb None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:33:18.250027 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 106/219] 10.222.0.65 () {56 vars in 1101 bytes} [Thu Oct 27 09:33:18 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 09:33:18.255420 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0360e2fa-ef72-4892-b6c8-07c01918aafe None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:33:18.377403 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0360e2fa-ef72-4892-b6c8-07c01918aafe None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:33:18.414584 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6aeb00-6a6a-4fcf-bf9e-79d93712a96f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:33:18.415228 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6aeb00-6a6a-4fcf-bf9e-79d93712a96f None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:33:18.415510 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6aeb00-6a6a-4fcf-bf9e-79d93712a96f None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:33:18.415786 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6aeb00-6a6a-4fcf-bf9e-79d93712a96f None admin] PATH_INFO: `/v3/users/bbf26d3533794af8a4b275110c6297f0` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:33:18.416943 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6aeb00-6a6a-4fcf-bf9e-79d93712a96f None admin] RBAC: Authorizing `identity:get_user(user_id=bbf26d3533794af8a4b275110c6297f0)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:33:18.418547 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6aeb00-6a6a-4fcf-bf9e-79d93712a96f None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:33:18.421075 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 114/220] 10.222.0.65 () {56 vars in 1177 bytes} [Thu Oct 27 09:33:18 2022] GET /identity/v3/users/bbf26d3533794af8a4b275110c6297f0 => generated 297 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 09:33:18.426341 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c25a8f8-8f84-47dc-860a-f6d505d626eb None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:33:18.535856 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c25a8f8-8f84-47dc-860a-f6d505d626eb None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:33:18.566176 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:33:18.571189 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13550838-b3a1-4c1c-8c00-04625472c4a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:33:18.571799 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13550838-b3a1-4c1c-8c00-04625472c4a3 None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:33:18.572079 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13550838-b3a1-4c1c-8c00-04625472c4a3 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:33:18.572352 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13550838-b3a1-4c1c-8c00-04625472c4a3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:33:18.646153 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13550838-b3a1-4c1c-8c00-04625472c4a3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:33:18.647683 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13550838-b3a1-4c1c-8c00-04625472c4a3 None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:33:18.751557 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 107/221] 10.222.0.65 () {58 vars in 1282 bytes} [Thu Oct 27 09:33:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 27 09:33:18.757111 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6aeb00-6a6a-4fcf-bf9e-79d93712a96f None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:33:18.784884 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:33:18.869198 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6aeb00-6a6a-4fcf-bf9e-79d93712a96f None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:33:18.911567 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a813b86d-a527-4512-af0a-c20899e97b4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:33:18.912122 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a813b86d-a527-4512-af0a-c20899e97b4c None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:33:18.912401 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a813b86d-a527-4512-af0a-c20899e97b4c None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:33:18.912677 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a813b86d-a527-4512-af0a-c20899e97b4c None admin] PATH_INFO: `/v3/projects/b86df928a9974a6993ae75bd68b27098` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:33:18.913811 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a813b86d-a527-4512-af0a-c20899e97b4c None admin] RBAC: Authorizing `identity:get_project(project_id=b86df928a9974a6993ae75bd68b27098)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:33:18.915300 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a813b86d-a527-4512-af0a-c20899e97b4c None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:33:18.917255 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 115/222] 10.222.0.65 () {56 vars in 1186 bytes} [Thu Oct 27 09:33:18 2022] GET /identity/v3/projects/b86df928a9974a6993ae75bd68b27098 => generated 302 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 09:33:18.923090 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13550838-b3a1-4c1c-8c00-04625472c4a3 None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:33:18.956227 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:33:19.028862 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13550838-b3a1-4c1c-8c00-04625472c4a3 None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:33:19.064674 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a207d25-794a-41e5-9a02-92a82779930e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:33:19.065290 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a207d25-794a-41e5-9a02-92a82779930e None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:33:19.065571 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a207d25-794a-41e5-9a02-92a82779930e None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:33:19.065845 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a207d25-794a-41e5-9a02-92a82779930e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:33:19.066604 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a207d25-794a-41e5-9a02-92a82779930e None admin] RBAC: Adding query filter params (role.id=4d4811302e664f5fac66b7229e5c1b8f, scope.project.id=b86df928a9974a6993ae75bd68b27098, user.id=bbf26d3533794af8a4b275110c6297f0) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 09:33:19.066918 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a207d25-794a-41e5-9a02-92a82779930e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:33:19.068364 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a207d25-794a-41e5-9a02-92a82779930e None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:33:19.074902 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 108/223] 10.222.0.65 () {56 vars in 1374 bytes} [Thu Oct 27 09:33:18 2022] GET /identity/v3/role_assignments?user.id=bbf26d3533794af8a4b275110c6297f0&scope.project.id=b86df928a9974a6993ae75bd68b27098&role.id=4d4811302e664f5fac66b7229e5c1b8f => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 09:33:20.140889 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1caa6825-7871-4fc2-b446-f345ed5b11ac None None] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:33:20.141395 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1caa6825-7871-4fc2-b446-f345ed5b11ac None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:33:20.141395 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1caa6825-7871-4fc2-b446-f345ed5b11ac None None] PATH_INFO: `/` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:33:20.143510 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 116/224] 10.222.0.65 () {54 vars in 927 bytes} [Thu Oct 27 09:33:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 09:33:20.149618 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da95d3c-4922-4f6e-86b0-6b27b704f4fb None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:33:20.150163 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da95d3c-4922-4f6e-86b0-6b27b704f4fb None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:33:20.150163 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da95d3c-4922-4f6e-86b0-6b27b704f4fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:33:20.169069 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-1da95d3c-4922-4f6e-86b0-6b27b704f4fb None None] MFA Rules not processed for user `b5065084bf664b99bdeac46067cb0f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:33:20.171060 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-1da95d3c-4922-4f6e-86b0-6b27b704f4fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:33:20.240239 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 109/225] 10.222.0.65 () {58 vars in 1024 bytes} [Thu Oct 27 09:33:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 27 09:33:20.243827 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec90b91d-f590-43ae-b691-1d7ac875cd64 None None] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:33:20.244117 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec90b91d-f590-43ae-b691-1d7ac875cd64 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:33:20.244393 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec90b91d-f590-43ae-b691-1d7ac875cd64 None None] PATH_INFO: `/` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:33:20.245745 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 117/226] 10.222.0.65 () {54 vars in 927 bytes} [Thu Oct 27 09:33:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 09:33:20.252135 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044ca099-b150-482f-8609-9a73ec0da5ba None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:33:20.252429 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044ca099-b150-482f-8609-9a73ec0da5ba None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:33:20.252710 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044ca099-b150-482f-8609-9a73ec0da5ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:33:20.271276 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-044ca099-b150-482f-8609-9a73ec0da5ba None None] MFA Rules not processed for user `b5065084bf664b99bdeac46067cb0f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:33:20.272462 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-044ca099-b150-482f-8609-9a73ec0da5ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:33:20.296316 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:33:20.349875 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 110/227] 10.222.0.65 () {58 vars in 1024 bytes} [Thu Oct 27 09:33:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 27 09:33:20.413307 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157aa306-601f-4746-963e-b9c3e7173b70 None None] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:33:20.413616 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157aa306-601f-4746-963e-b9c3e7173b70 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:33:20.413851 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157aa306-601f-4746-963e-b9c3e7173b70 None None] PATH_INFO: `/` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:33:20.415351 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 118/228] 10.222.0.65 () {54 vars in 927 bytes} [Thu Oct 27 09:33:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 09:33:20.420463 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b160e3ed-46d7-401a-9c63-94e19bb58350 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:33:20.420749 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b160e3ed-46d7-401a-9c63-94e19bb58350 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:33:20.421028 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b160e3ed-46d7-401a-9c63-94e19bb58350 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:33:20.440656 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-b160e3ed-46d7-401a-9c63-94e19bb58350 None None] MFA Rules not processed for user `b5065084bf664b99bdeac46067cb0f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:33:20.441821 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-b160e3ed-46d7-401a-9c63-94e19bb58350 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:33:20.509576 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 111/229] 10.222.0.65 () {58 vars in 1024 bytes} [Thu Oct 27 09:33:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 27 09:33:20.510231 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157aa306-601f-4746-963e-b9c3e7173b70 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:33:20.608131 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:33:20.618087 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157aa306-601f-4746-963e-b9c3e7173b70 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:33:20.628883 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b160e3ed-46d7-401a-9c63-94e19bb58350 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:33:20.657924 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49595b2b-a8b5-45fd-ad9c-b98f0657361e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:33:20.658584 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49595b2b-a8b5-45fd-ad9c-b98f0657361e None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:33:20.658902 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49595b2b-a8b5-45fd-ad9c-b98f0657361e None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:33:20.659173 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49595b2b-a8b5-45fd-ad9c-b98f0657361e None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:33:20.669668 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49595b2b-a8b5-45fd-ad9c-b98f0657361e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 09:33:20.675161 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application [None req-49595b2b-a8b5-45fd-ad9c-b98f0657361e None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 27 09:33:20.675161 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 09:33:20.675161 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 09:33:20.675161 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 09:33:20.675161 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 09:33:20.675161 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 09:33:20.675161 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 09:33:20.675161 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 09:33:20.675161 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 09:33:20.675161 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 09:33:20.675161 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 09:33:20.675161 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 09:33:20.675161 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 27 09:33:20.675161 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 27 09:33:20.675161 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 27 09:33:20.675161 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 27 09:33:20.676207 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 27 09:33:20.676207 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 27 09:33:20.676207 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 27 09:33:20.676207 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 27 09:33:20.676207 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 09:33:20.676207 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 09:33:20.676207 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 09:33:20.676207 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 09:33:20.676207 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 09:33:20.676207 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 09:33:20.676207 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 09:33:20.676207 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application with Lock( Oct 27 09:33:20.676207 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 09:33:20.676207 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._enter() Oct 27 09:33:20.676207 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 09:33:20.676207 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 09:33:20.677005 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 09:33:20.677005 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.creator() Oct 27 09:33:20.677005 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 09:33:20.677005 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application created_value = creator( Oct 27 09:33:20.677005 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 27 09:33:20.677005 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 27 09:33:20.677005 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 27 09:33:20.677005 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 27 09:33:20.677005 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 27 09:33:20.677005 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 27 09:33:20.677005 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 27 09:33:20.677005 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application Oct 27 09:33:20.677005 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 119/230] 10.222.0.65 () {56 vars in 1099 bytes} [Thu Oct 27 09:33:20 2022] GET /identity/v3/roles/reader => generated 84 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 27 09:33:20.681986 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49595b2b-a8b5-45fd-ad9c-b98f0657361e None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:33:20.734081 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:33:20.750465 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b160e3ed-46d7-401a-9c63-94e19bb58350 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:33:20.787192 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8d84ab-f7dd-4300-92f6-7d5c444d71f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:33:20.788118 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8d84ab-f7dd-4300-92f6-7d5c444d71f8 None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:33:20.788400 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8d84ab-f7dd-4300-92f6-7d5c444d71f8 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:33:20.788670 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8d84ab-f7dd-4300-92f6-7d5c444d71f8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:33:20.789039 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49595b2b-a8b5-45fd-ad9c-b98f0657361e None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:33:20.789789 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8d84ab-f7dd-4300-92f6-7d5c444d71f8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:33:20.791280 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8d84ab-f7dd-4300-92f6-7d5c444d71f8 None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:33:20.792851 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 112/231] 10.222.0.65 () {56 vars in 1108 bytes} [Thu Oct 27 09:33:20 2022] GET /identity/v3/domains/default => generated 199 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 09:33:20.798192 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8d84ab-f7dd-4300-92f6-7d5c444d71f8 None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:33:20.835036 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893c396a-aa24-4cf4-83a4-305719b4cc24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:33:20.835641 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893c396a-aa24-4cf4-83a4-305719b4cc24 None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:33:20.835925 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893c396a-aa24-4cf4-83a4-305719b4cc24 None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:33:20.836203 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893c396a-aa24-4cf4-83a4-305719b4cc24 None admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:33:20.836868 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893c396a-aa24-4cf4-83a4-305719b4cc24 None admin] RBAC: Adding query filter params (name=reader) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 09:33:20.837175 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893c396a-aa24-4cf4-83a4-305719b4cc24 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:33:20.838575 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893c396a-aa24-4cf4-83a4-305719b4cc24 None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:33:20.847456 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 120/232] 10.222.0.65 () {56 vars in 1101 bytes} [Thu Oct 27 09:33:20 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 09:33:20.852962 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893c396a-aa24-4cf4-83a4-305719b4cc24 None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:33:20.869777 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:33:20.913088 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8d84ab-f7dd-4300-92f6-7d5c444d71f8 None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:33:20.949235 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46992ba-c0c3-4cf0-9e30-34ebb4c98f10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:33:20.949783 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46992ba-c0c3-4cf0-9e30-34ebb4c98f10 None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:33:20.950061 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46992ba-c0c3-4cf0-9e30-34ebb4c98f10 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:33:20.950331 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46992ba-c0c3-4cf0-9e30-34ebb4c98f10 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:33:20.960396 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893c396a-aa24-4cf4-83a4-305719b4cc24 None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:33:20.961100 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46992ba-c0c3-4cf0-9e30-34ebb4c98f10 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 09:33:20.965936 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application [None req-c46992ba-c0c3-4cf0-9e30-34ebb4c98f10 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 27 09:33:20.965936 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 09:33:20.965936 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 09:33:20.965936 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 09:33:20.965936 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 09:33:20.965936 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 09:33:20.965936 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 09:33:20.965936 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 09:33:20.965936 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 09:33:20.965936 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 09:33:20.965936 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 09:33:20.965936 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 09:33:20.965936 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 27 09:33:20.965936 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 27 09:33:20.965936 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 27 09:33:20.965936 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 27 09:33:20.966942 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 27 09:33:20.966942 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 27 09:33:20.966942 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 27 09:33:20.966942 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 27 09:33:20.966942 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 09:33:20.966942 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 09:33:20.966942 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 09:33:20.966942 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 09:33:20.966942 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 09:33:20.966942 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 09:33:20.966942 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 09:33:20.966942 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application with Lock( Oct 27 09:33:20.966942 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 09:33:20.966942 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._enter() Oct 27 09:33:20.966942 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 09:33:20.966942 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 09:33:20.967911 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 09:33:20.967911 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.creator() Oct 27 09:33:20.967911 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 09:33:20.967911 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application created_value = creator( Oct 27 09:33:20.967911 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 27 09:33:20.967911 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 27 09:33:20.967911 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 27 09:33:20.967911 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 27 09:33:20.967911 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 27 09:33:20.967911 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 27 09:33:20.967911 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 27 09:33:20.967911 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application Oct 27 09:33:20.967911 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 113/233] 10.222.0.65 () {56 vars in 1099 bytes} [Thu Oct 27 09:33:20 2022] GET /identity/v3/roles/member => generated 84 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 09:33:20.967911 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46992ba-c0c3-4cf0-9e30-34ebb4c98f10 None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:33:20.984398 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:33:20.999487 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0613d546-bd07-47d2-82f0-5973eb11c39d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:33:21.000081 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0613d546-bd07-47d2-82f0-5973eb11c39d None admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:33:21.000368 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0613d546-bd07-47d2-82f0-5973eb11c39d None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:33:21.000642 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0613d546-bd07-47d2-82f0-5973eb11c39d None admin] PATH_INFO: `/v3/groups` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:33:21.001277 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0613d546-bd07-47d2-82f0-5973eb11c39d None admin] RBAC: Authorizing `identity:create_group()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:33:21.002763 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0613d546-bd07-47d2-82f0-5973eb11c39d None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:33:21.069891 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46992ba-c0c3-4cf0-9e30-34ebb4c98f10 None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:33:21.071045 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 121/234] 10.222.0.65 () {60 vars in 1134 bytes} [Thu Oct 27 09:33:20 2022] POST /identity/v3/groups => generated 229 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 09:33:21.071884 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0613d546-bd07-47d2-82f0-5973eb11c39d None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:33:21.114360 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33c61bb-9139-4640-9ca2-34ef417f4e83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:33:21.115116 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33c61bb-9139-4640-9ca2-34ef417f4e83 None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:33:21.115398 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33c61bb-9139-4640-9ca2-34ef417f4e83 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:33:21.115935 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33c61bb-9139-4640-9ca2-34ef417f4e83 None admin] PATH_INFO: `/v3/users/0a16d54516144c68b71a10fc3bdcad55` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:33:21.134465 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33c61bb-9139-4640-9ca2-34ef417f4e83 None admin] RBAC: Authorizing `identity:get_user(user_id=0a16d54516144c68b71a10fc3bdcad55)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:33:21.136016 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33c61bb-9139-4640-9ca2-34ef417f4e83 None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:33:21.138009 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 114/235] 10.222.0.65 () {56 vars in 1177 bytes} [Thu Oct 27 09:33:20 2022] GET /identity/v3/users/0a16d54516144c68b71a10fc3bdcad55 => generated 293 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 09:33:21.143912 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33c61bb-9139-4640-9ca2-34ef417f4e83 None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:33:21.171135 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:33:21.199130 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0613d546-bd07-47d2-82f0-5973eb11c39d None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:33:21.231639 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:33:21.239855 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fc9af7-8268-4d1b-b723-5e817e14a70a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:33:21.240980 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fc9af7-8268-4d1b-b723-5e817e14a70a None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:33:21.241522 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fc9af7-8268-4d1b-b723-5e817e14a70a None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:33:21.241803 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fc9af7-8268-4d1b-b723-5e817e14a70a None admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:33:21.242483 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fc9af7-8268-4d1b-b723-5e817e14a70a None admin] RBAC: Adding query filter params (name=member) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 09:33:21.242826 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fc9af7-8268-4d1b-b723-5e817e14a70a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:33:21.244251 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fc9af7-8268-4d1b-b723-5e817e14a70a None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:33:21.254044 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 122/236] 10.222.0.65 () {56 vars in 1101 bytes} [Thu Oct 27 09:33:21 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 09:33:21.259638 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fc9af7-8268-4d1b-b723-5e817e14a70a None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:33:21.273148 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33c61bb-9139-4640-9ca2-34ef417f4e83 None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:33:21.318066 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58537b3-b7fb-4e61-9865-0e3d5f2f6021 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:33:21.318752 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58537b3-b7fb-4e61-9865-0e3d5f2f6021 None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:33:21.319179 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58537b3-b7fb-4e61-9865-0e3d5f2f6021 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:33:21.319457 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58537b3-b7fb-4e61-9865-0e3d5f2f6021 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:33:21.320196 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58537b3-b7fb-4e61-9865-0e3d5f2f6021 None admin] RBAC: Adding query filter params (role.id=4d4811302e664f5fac66b7229e5c1b8f, user.id=0a16d54516144c68b71a10fc3bdcad55, scope.system=all) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 09:33:21.320499 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58537b3-b7fb-4e61-9865-0e3d5f2f6021 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:33:21.321943 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58537b3-b7fb-4e61-9865-0e3d5f2f6021 None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:33:21.328552 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 115/237] 10.222.0.65 () {56 vars in 1308 bytes} [Thu Oct 27 09:33:21 2022] GET /identity/v3/role_assignments?user.id=0a16d54516144c68b71a10fc3bdcad55&scope.system=all&role.id=4d4811302e664f5fac66b7229e5c1b8f => generated 226 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 09:33:21.383519 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fc9af7-8268-4d1b-b723-5e817e14a70a None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:33:21.427034 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b212630-331a-4599-b38f-619a67335399 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:33:21.427703 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b212630-331a-4599-b38f-619a67335399 None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:33:21.427966 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b212630-331a-4599-b38f-619a67335399 None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:33:21.428238 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b212630-331a-4599-b38f-619a67335399 None admin] PATH_INFO: `/v3/users/aa6e38ded8fe41bb9f726525bd161643` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:33:21.429531 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b212630-331a-4599-b38f-619a67335399 None admin] RBAC: Authorizing `identity:get_user(user_id=aa6e38ded8fe41bb9f726525bd161643)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:33:21.431045 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b212630-331a-4599-b38f-619a67335399 None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:33:21.432941 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 123/238] 10.222.0.65 () {56 vars in 1177 bytes} [Thu Oct 27 09:33:21 2022] GET /identity/v3/users/aa6e38ded8fe41bb9f726525bd161643 => generated 293 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 09:33:21.439261 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58537b3-b7fb-4e61-9865-0e3d5f2f6021 None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:33:21.554015 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58537b3-b7fb-4e61-9865-0e3d5f2f6021 None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:33:21.589499 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff68477-916b-4b84-98a0-f4a0275737fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:33:21.590159 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff68477-916b-4b84-98a0-f4a0275737fd None admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:33:21.590436 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff68477-916b-4b84-98a0-f4a0275737fd None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:33:21.590739 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff68477-916b-4b84-98a0-f4a0275737fd None admin] PATH_INFO: `/v3/system/users/aa6e38ded8fe41bb9f726525bd161643/roles/43543ce1450245af9661cb017bac17bd` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:33:21.593778 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff68477-916b-4b84-98a0-f4a0275737fd None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=aa6e38ded8fe41bb9f726525bd161643, role_id=43543ce1450245af9661cb017bac17bd)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:33:21.593903 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff68477-916b-4b84-98a0-f4a0275737fd None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:33:21.597535 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:33:21.683242 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 116/239] 10.222.0.65 () {58 vars in 1334 bytes} [Thu Oct 27 09:33:21 2022] PUT /identity/v3/system/users/aa6e38ded8fe41bb9f726525bd161643/roles/43543ce1450245af9661cb017bac17bd => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 09:33:23.300681 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97785199-c183-4b7a-aac5-91e43f834bb6 None None] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:33:23.301198 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97785199-c183-4b7a-aac5-91e43f834bb6 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:33:23.301272 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97785199-c183-4b7a-aac5-91e43f834bb6 None None] PATH_INFO: `/` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:33:23.302635 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 124/240] 10.222.0.65 () {54 vars in 927 bytes} [Thu Oct 27 09:33:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 09:33:23.307822 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2697782f-9b7e-429e-804d-51c2bdca14c5 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:33:23.308232 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2697782f-9b7e-429e-804d-51c2bdca14c5 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:33:23.308485 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2697782f-9b7e-429e-804d-51c2bdca14c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:33:23.326790 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-2697782f-9b7e-429e-804d-51c2bdca14c5 None None] MFA Rules not processed for user `b5065084bf664b99bdeac46067cb0f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:33:23.327977 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-2697782f-9b7e-429e-804d-51c2bdca14c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:33:23.406354 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 117/241] 10.222.0.65 () {58 vars in 1024 bytes} [Thu Oct 27 09:33:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 27 09:33:23.502712 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aad969f-f105-4620-ad85-380fa84a156a None None] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:33:23.503026 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aad969f-f105-4620-ad85-380fa84a156a None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:33:23.503307 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aad969f-f105-4620-ad85-380fa84a156a None None] PATH_INFO: `/` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:33:23.505505 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 125/242] 10.222.0.65 () {54 vars in 927 bytes} [Thu Oct 27 09:33:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 09:33:23.510673 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e02ee8-7d67-405c-9e24-02bbfd2ab91f None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:33:23.510961 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e02ee8-7d67-405c-9e24-02bbfd2ab91f None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:33:23.511237 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e02ee8-7d67-405c-9e24-02bbfd2ab91f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:33:23.530336 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-42e02ee8-7d67-405c-9e24-02bbfd2ab91f None None] MFA Rules not processed for user `b5065084bf664b99bdeac46067cb0f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:33:23.531545 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-42e02ee8-7d67-405c-9e24-02bbfd2ab91f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:33:23.601170 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 118/243] 10.222.0.65 () {58 vars in 1024 bytes} [Thu Oct 27 09:33:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 27 09:33:23.679471 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aad969f-f105-4620-ad85-380fa84a156a None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:33:23.683683 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:33:23.792937 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aad969f-f105-4620-ad85-380fa84a156a None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:33:23.830043 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a9b3ae-ba80-49b9-90f3-3731ae059c3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:33:23.831101 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a9b3ae-ba80-49b9-90f3-3731ae059c3c None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:33:23.831101 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a9b3ae-ba80-49b9-90f3-3731ae059c3c None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:33:23.831287 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a9b3ae-ba80-49b9-90f3-3731ae059c3c None admin] PATH_INFO: `/v3/domains/default` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:33:23.832316 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a9b3ae-ba80-49b9-90f3-3731ae059c3c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:33:23.833768 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a9b3ae-ba80-49b9-90f3-3731ae059c3c None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:33:23.835613 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 126/244] 10.222.0.65 () {56 vars in 1108 bytes} [Thu Oct 27 09:33:23 2022] GET /identity/v3/domains/default => generated 199 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 09:33:23.840914 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e02ee8-7d67-405c-9e24-02bbfd2ab91f None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:33:23.877252 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a9b3ae-ba80-49b9-90f3-3731ae059c3c None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:33:23.913716 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:33:23.950352 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:33:23.956489 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e02ee8-7d67-405c-9e24-02bbfd2ab91f None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:33:23.979972 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a9b3ae-ba80-49b9-90f3-3731ae059c3c None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:33:23.990451 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efb1741-b137-497c-8df5-d078d553ddb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:33:23.991332 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efb1741-b137-497c-8df5-d078d553ddb3 None admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:33:23.991619 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efb1741-b137-497c-8df5-d078d553ddb3 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:33:23.991893 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efb1741-b137-497c-8df5-d078d553ddb3 None admin] PATH_INFO: `/v3/groups` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:33:23.992514 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efb1741-b137-497c-8df5-d078d553ddb3 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:33:23.993958 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efb1741-b137-497c-8df5-d078d553ddb3 None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:33:24.014698 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180b7dc3-19a3-4d78-bdba-f7988fc3221c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:33:24.015357 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180b7dc3-19a3-4d78-bdba-f7988fc3221c None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:33:24.015637 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180b7dc3-19a3-4d78-bdba-f7988fc3221c None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:33:24.015908 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180b7dc3-19a3-4d78-bdba-f7988fc3221c None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:33:24.025972 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180b7dc3-19a3-4d78-bdba-f7988fc3221c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 09:33:24.032041 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application [None req-180b7dc3-19a3-4d78-bdba-f7988fc3221c None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 27 09:33:24.032041 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 09:33:24.032041 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 09:33:24.032041 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 09:33:24.032041 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 09:33:24.032041 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 09:33:24.032041 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 09:33:24.032041 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 09:33:24.032041 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 09:33:24.032041 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 09:33:24.032041 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 09:33:24.032041 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 09:33:24.032041 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 27 09:33:24.032041 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 27 09:33:24.032041 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 27 09:33:24.032041 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 27 09:33:24.033072 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 27 09:33:24.033072 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 27 09:33:24.033072 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 27 09:33:24.033072 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 27 09:33:24.033072 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 09:33:24.033072 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 09:33:24.033072 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 09:33:24.033072 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 09:33:24.033072 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 09:33:24.033072 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 09:33:24.033072 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 09:33:24.033072 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application with Lock( Oct 27 09:33:24.033072 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 09:33:24.033072 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._enter() Oct 27 09:33:24.033072 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 09:33:24.033072 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 09:33:24.033874 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 09:33:24.033874 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.creator() Oct 27 09:33:24.033874 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 09:33:24.033874 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application created_value = creator( Oct 27 09:33:24.033874 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 27 09:33:24.033874 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 27 09:33:24.033874 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 27 09:33:24.033874 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 27 09:33:24.033874 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 27 09:33:24.033874 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 27 09:33:24.033874 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 27 09:33:24.033874 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application Oct 27 09:33:24.033874 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 127/245] 10.222.0.65 () {56 vars in 1099 bytes} [Thu Oct 27 09:33:23 2022] GET /identity/v3/roles/reader => generated 84 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 27 09:33:24.034495 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0832576e-dc62-4dbd-ab21-d999833d40e7 None None] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:33:24.034707 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0832576e-dc62-4dbd-ab21-d999833d40e7 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:33:24.034975 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0832576e-dc62-4dbd-ab21-d999833d40e7 None None] PATH_INFO: `/` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:33:24.036322 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 128/246] 10.222.0.65 () {54 vars in 927 bytes} [Thu Oct 27 09:33:24 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 09:33:24.038878 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0832576e-dc62-4dbd-ab21-d999833d40e7 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:33:24.077132 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 119/247] 10.222.0.65 () {60 vars in 1134 bytes} [Thu Oct 27 09:33:23 2022] POST /identity/v3/groups => generated 226 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 09:33:24.079593 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be803d4c-6a53-4156-807d-27e447d243d3 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:33:24.080388 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be803d4c-6a53-4156-807d-27e447d243d3 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:33:24.080672 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be803d4c-6a53-4156-807d-27e447d243d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:33:24.108827 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-be803d4c-6a53-4156-807d-27e447d243d3 None None] MFA Rules not processed for user `b5065084bf664b99bdeac46067cb0f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:33:24.110089 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-be803d4c-6a53-4156-807d-27e447d243d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:33:24.153548 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0832576e-dc62-4dbd-ab21-d999833d40e7 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:33:24.194822 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:33:24.197557 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 120/248] 10.222.0.65 () {58 vars in 1024 bytes} [Thu Oct 27 09:33:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 27 09:33:24.200857 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0f93b8-de11-445a-b79a-96b003c3cf5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:33:24.202321 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0f93b8-de11-445a-b79a-96b003c3cf5e None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:33:24.202696 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0f93b8-de11-445a-b79a-96b003c3cf5e None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:33:24.202981 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0f93b8-de11-445a-b79a-96b003c3cf5e None admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:33:24.203658 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0f93b8-de11-445a-b79a-96b003c3cf5e None admin] RBAC: Adding query filter params (name=reader) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 09:33:24.203962 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0f93b8-de11-445a-b79a-96b003c3cf5e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:33:24.205433 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0f93b8-de11-445a-b79a-96b003c3cf5e None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:33:24.221161 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 129/249] 10.222.0.65 () {56 vars in 1101 bytes} [Thu Oct 27 09:33:24 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 09:33:24.222688 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be803d4c-6a53-4156-807d-27e447d243d3 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:33:24.286549 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:33:24.342590 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be803d4c-6a53-4156-807d-27e447d243d3 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:33:24.381715 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd49177f-ce2d-4ea2-9494-f093a36886ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:33:24.382372 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd49177f-ce2d-4ea2-9494-f093a36886ee None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:33:24.382678 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd49177f-ce2d-4ea2-9494-f093a36886ee None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:33:24.382958 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd49177f-ce2d-4ea2-9494-f093a36886ee None admin] PATH_INFO: `/v3/users/0a16d54516144c68b71a10fc3bdcad55` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:33:24.384126 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd49177f-ce2d-4ea2-9494-f093a36886ee None admin] RBAC: Authorizing `identity:get_user(user_id=0a16d54516144c68b71a10fc3bdcad55)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:33:24.385651 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd49177f-ce2d-4ea2-9494-f093a36886ee None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:33:24.387429 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 121/250] 10.222.0.65 () {56 vars in 1177 bytes} [Thu Oct 27 09:33:24 2022] GET /identity/v3/users/0a16d54516144c68b71a10fc3bdcad55 => generated 293 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 09:33:24.394122 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0f93b8-de11-445a-b79a-96b003c3cf5e None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:33:24.468566 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd49177f-ce2d-4ea2-9494-f093a36886ee None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:33:24.525988 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0f93b8-de11-445a-b79a-96b003c3cf5e None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:33:24.584233 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba59d540-efff-46de-904a-b46cb768893d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:33:24.584911 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba59d540-efff-46de-904a-b46cb768893d None admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:33:24.585197 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba59d540-efff-46de-904a-b46cb768893d None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:33:24.585479 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba59d540-efff-46de-904a-b46cb768893d None admin] PATH_INFO: `/v3/system/users/0a16d54516144c68b71a10fc3bdcad55/roles/4d4811302e664f5fac66b7229e5c1b8f` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:33:24.587562 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba59d540-efff-46de-904a-b46cb768893d None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=0a16d54516144c68b71a10fc3bdcad55, role_id=4d4811302e664f5fac66b7229e5c1b8f)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:33:24.589432 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba59d540-efff-46de-904a-b46cb768893d None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:33:24.627628 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd49177f-ce2d-4ea2-9494-f093a36886ee None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:33:24.647500 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:33:24.664906 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50fec5f-dbb2-4556-be22-c8705f5c64c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:33:24.665608 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50fec5f-dbb2-4556-be22-c8705f5c64c6 None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:33:24.665882 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50fec5f-dbb2-4556-be22-c8705f5c64c6 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:33:24.666159 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50fec5f-dbb2-4556-be22-c8705f5c64c6 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:33:24.668598 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 130/251] 10.222.0.65 () {58 vars in 1334 bytes} [Thu Oct 27 09:33:24 2022] PUT /identity/v3/system/users/0a16d54516144c68b71a10fc3bdcad55/roles/4d4811302e664f5fac66b7229e5c1b8f => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 09:33:24.681334 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50fec5f-dbb2-4556-be22-c8705f5c64c6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 09:33:24.688788 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application [None req-b50fec5f-dbb2-4556-be22-c8705f5c64c6 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 27 09:33:24.688788 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 09:33:24.688788 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 09:33:24.688788 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 09:33:24.688788 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 09:33:24.688788 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 09:33:24.688788 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 09:33:24.688788 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 09:33:24.688788 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 09:33:24.688788 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 09:33:24.688788 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 09:33:24.688788 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 09:33:24.688788 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 27 09:33:24.688788 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 27 09:33:24.688788 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 27 09:33:24.688788 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 27 09:33:24.689756 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 27 09:33:24.689756 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 27 09:33:24.689756 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 27 09:33:24.689756 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 27 09:33:24.689756 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 09:33:24.689756 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 09:33:24.689756 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 09:33:24.689756 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 09:33:24.689756 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 09:33:24.689756 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 09:33:24.689756 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 09:33:24.689756 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application with Lock( Oct 27 09:33:24.689756 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 09:33:24.689756 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._enter() Oct 27 09:33:24.689756 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 09:33:24.689756 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 09:33:24.690566 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 09:33:24.690566 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.creator() Oct 27 09:33:24.690566 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 09:33:24.690566 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application created_value = creator( Oct 27 09:33:24.690566 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 27 09:33:24.690566 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 27 09:33:24.690566 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 27 09:33:24.690566 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 27 09:33:24.690566 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 27 09:33:24.690566 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 27 09:33:24.690566 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 27 09:33:24.690566 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application Oct 27 09:33:24.696012 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 122/252] 10.222.0.65 () {56 vars in 1099 bytes} [Thu Oct 27 09:33:24 2022] GET /identity/v3/roles/member => generated 84 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 27 09:33:24.703360 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba59d540-efff-46de-904a-b46cb768893d None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:33:24.777551 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:33:24.838611 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba59d540-efff-46de-904a-b46cb768893d None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:33:24.884929 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b056a30-1d52-4be3-86a4-cdbb34250e6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:33:24.885558 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b056a30-1d52-4be3-86a4-cdbb34250e6f None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:33:24.885842 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b056a30-1d52-4be3-86a4-cdbb34250e6f None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:33:24.886119 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b056a30-1d52-4be3-86a4-cdbb34250e6f None admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:33:24.886930 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b056a30-1d52-4be3-86a4-cdbb34250e6f None admin] RBAC: Adding query filter params (name=member) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 09:33:24.887238 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b056a30-1d52-4be3-86a4-cdbb34250e6f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:33:24.890006 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b056a30-1d52-4be3-86a4-cdbb34250e6f None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:33:24.899696 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 131/253] 10.222.0.65 () {56 vars in 1101 bytes} [Thu Oct 27 09:33:24 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 09:33:24.906640 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50fec5f-dbb2-4556-be22-c8705f5c64c6 None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:33:25.034052 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50fec5f-dbb2-4556-be22-c8705f5c64c6 None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:33:25.079888 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcdbc77-1148-4437-ba74-d64b928f5a97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:33:25.080536 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcdbc77-1148-4437-ba74-d64b928f5a97 None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:33:25.080819 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcdbc77-1148-4437-ba74-d64b928f5a97 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:33:25.081099 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcdbc77-1148-4437-ba74-d64b928f5a97 None admin] PATH_INFO: `/v3/users/aa6e38ded8fe41bb9f726525bd161643` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:33:25.082248 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dcdbc77-1148-4437-ba74-d64b928f5a97 None admin] RBAC: Authorizing `identity:get_user(user_id=aa6e38ded8fe41bb9f726525bd161643)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:33:25.083805 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dcdbc77-1148-4437-ba74-d64b928f5a97 None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:33:25.085794 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 123/254] 10.222.0.65 () {56 vars in 1177 bytes} [Thu Oct 27 09:33:24 2022] GET /identity/v3/users/aa6e38ded8fe41bb9f726525bd161643 => generated 293 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 09:33:25.091731 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b056a30-1d52-4be3-86a4-cdbb34250e6f None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:33:25.227034 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b056a30-1d52-4be3-86a4-cdbb34250e6f None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:33:25.257711 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:33:25.274442 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6508a074-c33c-4f1b-a778-f281f9feb4d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:33:25.275087 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6508a074-c33c-4f1b-a778-f281f9feb4d0 None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:33:25.275368 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6508a074-c33c-4f1b-a778-f281f9feb4d0 None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:33:25.275640 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6508a074-c33c-4f1b-a778-f281f9feb4d0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:33:25.276372 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6508a074-c33c-4f1b-a778-f281f9feb4d0 None admin] RBAC: Adding query filter params (role.id=43543ce1450245af9661cb017bac17bd, user.id=aa6e38ded8fe41bb9f726525bd161643, scope.system=all) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 09:33:25.276680 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6508a074-c33c-4f1b-a778-f281f9feb4d0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:33:25.278129 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6508a074-c33c-4f1b-a778-f281f9feb4d0 None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:33:25.299283 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 132/255] 10.222.0.65 () {56 vars in 1308 bytes} [Thu Oct 27 09:33:25 2022] GET /identity/v3/role_assignments?user.id=aa6e38ded8fe41bb9f726525bd161643&scope.system=all&role.id=43543ce1450245af9661cb017bac17bd => generated 510 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 09:33:26.997077 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b70328-5fc2-476f-8989-6d92111cfade None None] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:33:26.999831 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b70328-5fc2-476f-8989-6d92111cfade None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:33:26.999831 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b70328-5fc2-476f-8989-6d92111cfade None None] PATH_INFO: `/` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:33:27.000343 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 124/256] 10.222.0.65 () {54 vars in 927 bytes} [Thu Oct 27 09:33:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 09:33:27.008572 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e0c5fc-5ac7-4598-9a6e-ac741b6a45a7 None None] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:33:27.009061 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e0c5fc-5ac7-4598-9a6e-ac741b6a45a7 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:33:27.009134 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e0c5fc-5ac7-4598-9a6e-ac741b6a45a7 None None] PATH_INFO: `/` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:33:27.010745 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 133/257] 10.222.0.65 () {54 vars in 927 bytes} [Thu Oct 27 09:33:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 09:33:27.012308 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e675c9-a79c-4b94-bd5b-78e9b2380ae0 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:33:27.012812 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e675c9-a79c-4b94-bd5b-78e9b2380ae0 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:33:27.013818 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e675c9-a79c-4b94-bd5b-78e9b2380ae0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:33:27.016758 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec0964f-9ab9-4f79-b74a-1bb4ab3372d4 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:33:27.017047 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec0964f-9ab9-4f79-b74a-1bb4ab3372d4 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:33:27.017327 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec0964f-9ab9-4f79-b74a-1bb4ab3372d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:33:27.050878 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-d3e675c9-a79c-4b94-bd5b-78e9b2380ae0 None None] MFA Rules not processed for user `b5065084bf664b99bdeac46067cb0f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:33:27.052100 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-d3e675c9-a79c-4b94-bd5b-78e9b2380ae0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:33:27.056913 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-8ec0964f-9ab9-4f79-b74a-1bb4ab3372d4 None None] MFA Rules not processed for user `b5065084bf664b99bdeac46067cb0f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:33:27.058449 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-8ec0964f-9ab9-4f79-b74a-1bb4ab3372d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:33:27.140661 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:33:27.163458 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 134/258] 10.222.0.65 () {58 vars in 1024 bytes} [Thu Oct 27 09:33:27 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Oct 27 09:33:27.173152 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 125/259] 10.222.0.65 () {58 vars in 1024 bytes} [Thu Oct 27 09:33:27 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Oct 27 09:33:27.619535 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8062adc0-b768-4041-83f4-e38b31229823 None None] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:33:27.619911 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8062adc0-b768-4041-83f4-e38b31229823 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:33:27.620111 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8062adc0-b768-4041-83f4-e38b31229823 None None] PATH_INFO: `/` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:33:27.621450 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 135/260] 10.222.0.65 () {54 vars in 927 bytes} [Thu Oct 27 09:33:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 09:33:27.627697 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbcfa8a-b2b4-4e8e-b68d-1abe5ea45b8d None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:33:27.627986 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbcfa8a-b2b4-4e8e-b68d-1abe5ea45b8d None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:33:27.628269 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbcfa8a-b2b4-4e8e-b68d-1abe5ea45b8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:33:27.660029 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-fbbcfa8a-b2b4-4e8e-b68d-1abe5ea45b8d None None] MFA Rules not processed for user `b5065084bf664b99bdeac46067cb0f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:33:27.661292 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-fbbcfa8a-b2b4-4e8e-b68d-1abe5ea45b8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:33:27.672377 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 126/261] 10.222.0.65 () {58 vars in 1024 bytes} [Thu Oct 27 09:33:27 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Oct 27 09:33:27.697656 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8062adc0-b768-4041-83f4-e38b31229823 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:33:27.713619 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8062adc0-b768-4041-83f4-e38b31229823 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:33:27.718425 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474a5fa4-2b4b-4caa-8e5e-0fb4ce0153d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:33:27.719087 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474a5fa4-2b4b-4caa-8e5e-0fb4ce0153d1 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:33:27.719368 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474a5fa4-2b4b-4caa-8e5e-0fb4ce0153d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:33:27.719641 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474a5fa4-2b4b-4caa-8e5e-0fb4ce0153d1 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:33:27.721613 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbcfa8a-b2b4-4e8e-b68d-1abe5ea45b8d None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:33:27.731623 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbcfa8a-b2b4-4e8e-b68d-1abe5ea45b8d None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:33:27.746261 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657c9cc2-21cc-4fd9-8f5b-caebafd4aab1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:33:27.746936 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657c9cc2-21cc-4fd9-8f5b-caebafd4aab1 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:33:27.747218 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657c9cc2-21cc-4fd9-8f5b-caebafd4aab1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:33:27.748044 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657c9cc2-21cc-4fd9-8f5b-caebafd4aab1 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:33:27.753816 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474a5fa4-2b4b-4caa-8e5e-0fb4ce0153d1 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 09:33:27.764756 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application [None req-474a5fa4-2b4b-4caa-8e5e-0fb4ce0153d1 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 27 09:33:27.764756 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 09:33:27.764756 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 09:33:27.764756 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 09:33:27.764756 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 09:33:27.764756 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 09:33:27.764756 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 09:33:27.764756 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 09:33:27.764756 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 09:33:27.764756 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 09:33:27.764756 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 09:33:27.764756 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 09:33:27.764756 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 27 09:33:27.764756 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 27 09:33:27.764756 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 27 09:33:27.764756 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 27 09:33:27.767034 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 27 09:33:27.767034 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 27 09:33:27.767034 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 27 09:33:27.767034 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 27 09:33:27.767034 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 09:33:27.767034 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 09:33:27.767034 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 09:33:27.767034 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 09:33:27.767034 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 09:33:27.767034 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 09:33:27.767034 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 09:33:27.767034 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application with Lock( Oct 27 09:33:27.767034 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 09:33:27.767034 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._enter() Oct 27 09:33:27.767034 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 09:33:27.767034 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 09:33:27.768935 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 09:33:27.768935 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.creator() Oct 27 09:33:27.768935 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 09:33:27.768935 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application created_value = creator( Oct 27 09:33:27.768935 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 27 09:33:27.768935 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 27 09:33:27.768935 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 27 09:33:27.768935 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 27 09:33:27.768935 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 27 09:33:27.768935 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 27 09:33:27.768935 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 27 09:33:27.768935 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application Oct 27 09:33:27.768935 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 136/262] 10.222.0.65 () {56 vars in 1120 bytes} [Thu Oct 27 09:33:27 2022] GET /identity/v3/roles/member => generated 84 bytes in 69 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 09:33:27.772260 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657c9cc2-21cc-4fd9-8f5b-caebafd4aab1 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 09:33:27.777039 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474a5fa4-2b4b-4caa-8e5e-0fb4ce0153d1 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:33:27.788130 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application [None req-657c9cc2-21cc-4fd9-8f5b-caebafd4aab1 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 27 09:33:27.788130 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 09:33:27.788130 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 09:33:27.788130 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 09:33:27.788130 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 09:33:27.788130 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 09:33:27.788130 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 09:33:27.788130 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 09:33:27.788130 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 09:33:27.788130 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 09:33:27.788130 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 09:33:27.788130 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 09:33:27.788130 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 27 09:33:27.788130 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 27 09:33:27.788130 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 27 09:33:27.788130 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 27 09:33:27.791074 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 27 09:33:27.791074 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 27 09:33:27.791074 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 27 09:33:27.791074 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 27 09:33:27.791074 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 09:33:27.791074 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 09:33:27.791074 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 09:33:27.791074 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 09:33:27.791074 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 09:33:27.791074 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 09:33:27.791074 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 09:33:27.791074 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application with Lock( Oct 27 09:33:27.791074 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 09:33:27.791074 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._enter() Oct 27 09:33:27.791074 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 09:33:27.791074 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 09:33:27.797599 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 09:33:27.797599 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.creator() Oct 27 09:33:27.797599 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 09:33:27.797599 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application created_value = creator( Oct 27 09:33:27.797599 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 27 09:33:27.797599 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 27 09:33:27.797599 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 27 09:33:27.797599 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 27 09:33:27.797599 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 27 09:33:27.797599 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 27 09:33:27.797599 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 27 09:33:27.797599 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application Oct 27 09:33:27.797599 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 127/263] 10.222.0.65 () {56 vars in 1135 bytes} [Thu Oct 27 09:33:27 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 68 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 27 09:33:27.797599 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657c9cc2-21cc-4fd9-8f5b-caebafd4aab1 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:33:27.799679 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474a5fa4-2b4b-4caa-8e5e-0fb4ce0153d1 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:33:27.808997 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f485d7-ed88-4d55-9540-7a7f1380efcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:33:27.809609 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f485d7-ed88-4d55-9540-7a7f1380efcc admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:33:27.809921 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f485d7-ed88-4d55-9540-7a7f1380efcc admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:33:27.810204 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f485d7-ed88-4d55-9540-7a7f1380efcc admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:33:27.811140 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f485d7-ed88-4d55-9540-7a7f1380efcc admin admin] RBAC: Adding query filter params (name=member) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 09:33:27.811444 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f485d7-ed88-4d55-9540-7a7f1380efcc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:33:27.816027 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657c9cc2-21cc-4fd9-8f5b-caebafd4aab1 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:33:27.817506 dv-cinder-797970-7-smb devstack@keystone.service[88311]: WARNING py.warnings [None req-00f485d7-ed88-4d55-9540-7a7f1380efcc admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 09:33:27.817506 dv-cinder-797970-7-smb devstack@keystone.service[88311]: warnings.warn(msg) Oct 27 09:33:27.817506 dv-cinder-797970-7-smb devstack@keystone.service[88311]: Oct 27 09:33:27.818446 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f485d7-ed88-4d55-9540-7a7f1380efcc admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:33:27.830713 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b3ee53-e28a-41c9-b97e-51a592b8a3d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:33:27.831343 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b3ee53-e28a-41c9-b97e-51a592b8a3d7 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:33:27.831622 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b3ee53-e28a-41c9-b97e-51a592b8a3d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:33:27.831894 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b3ee53-e28a-41c9-b97e-51a592b8a3d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:33:27.832570 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b3ee53-e28a-41c9-b97e-51a592b8a3d7 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 09:33:27.832874 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b3ee53-e28a-41c9-b97e-51a592b8a3d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:33:27.834706 dv-cinder-797970-7-smb devstack@keystone.service[88312]: WARNING py.warnings [None req-64b3ee53-e28a-41c9-b97e-51a592b8a3d7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 09:33:27.834706 dv-cinder-797970-7-smb devstack@keystone.service[88312]: warnings.warn(msg) Oct 27 09:33:27.834706 dv-cinder-797970-7-smb devstack@keystone.service[88312]: Oct 27 09:33:27.835624 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b3ee53-e28a-41c9-b97e-51a592b8a3d7 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:33:27.850577 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 137/264] 10.222.0.65 () {56 vars in 1122 bytes} [Thu Oct 27 09:33:27 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 09:33:27.851415 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 128/265] 10.222.0.65 () {56 vars in 1132 bytes} [Thu Oct 27 09:33:27 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 09:33:27.856802 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f485d7-ed88-4d55-9540-7a7f1380efcc admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:33:27.867083 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b3ee53-e28a-41c9-b97e-51a592b8a3d7 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:33:27.876809 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f485d7-ed88-4d55-9540-7a7f1380efcc admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:33:27.884936 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b3ee53-e28a-41c9-b97e-51a592b8a3d7 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:33:27.887787 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5c4ec2-f92a-40f8-bdf7-0fc41ff38faa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:33:27.888456 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5c4ec2-f92a-40f8-bdf7-0fc41ff38faa admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:33:27.888734 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5c4ec2-f92a-40f8-bdf7-0fc41ff38faa admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:33:27.888990 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5c4ec2-f92a-40f8-bdf7-0fc41ff38faa admin admin] PATH_INFO: `/v3/groups/1cf1417983a647b3a7949bc7ad5c76e9` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:33:27.899453 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b85bf4c-62ad-45ee-b842-122e619a1cbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:33:27.900096 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b85bf4c-62ad-45ee-b842-122e619a1cbf admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:33:27.900461 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b85bf4c-62ad-45ee-b842-122e619a1cbf admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:33:27.900852 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b85bf4c-62ad-45ee-b842-122e619a1cbf admin admin] PATH_INFO: `/v3/groups/1cf1417983a647b3a7949bc7ad5c76e9` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:33:27.901946 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5c4ec2-f92a-40f8-bdf7-0fc41ff38faa admin admin] RBAC: Authorizing `identity:get_group(group_id=1cf1417983a647b3a7949bc7ad5c76e9)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:33:27.903007 dv-cinder-797970-7-smb devstack@keystone.service[88311]: WARNING py.warnings [None req-0f5c4ec2-f92a-40f8-bdf7-0fc41ff38faa admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 27 09:33:27.903007 dv-cinder-797970-7-smb devstack@keystone.service[88311]: warnings.warn(msg) Oct 27 09:33:27.903007 dv-cinder-797970-7-smb devstack@keystone.service[88311]: Oct 27 09:33:27.904785 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5c4ec2-f92a-40f8-bdf7-0fc41ff38faa admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:33:27.906465 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 138/266] 10.222.0.65 () {56 vars in 1201 bytes} [Thu Oct 27 09:33:27 2022] GET /identity/v3/groups/1cf1417983a647b3a7949bc7ad5c76e9 => generated 226 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 09:33:27.907164 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b85bf4c-62ad-45ee-b842-122e619a1cbf admin admin] RBAC: Authorizing `identity:get_group(group_id=1cf1417983a647b3a7949bc7ad5c76e9)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:33:27.908264 dv-cinder-797970-7-smb devstack@keystone.service[88312]: WARNING py.warnings [None req-1b85bf4c-62ad-45ee-b842-122e619a1cbf admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 27 09:33:27.908264 dv-cinder-797970-7-smb devstack@keystone.service[88312]: warnings.warn(msg) Oct 27 09:33:27.908264 dv-cinder-797970-7-smb devstack@keystone.service[88312]: Oct 27 09:33:27.909488 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b85bf4c-62ad-45ee-b842-122e619a1cbf admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:33:27.911469 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 129/267] 10.222.0.65 () {56 vars in 1201 bytes} [Thu Oct 27 09:33:27 2022] GET /identity/v3/groups/1cf1417983a647b3a7949bc7ad5c76e9 => generated 226 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 09:33:27.916606 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b85bf4c-62ad-45ee-b842-122e619a1cbf admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:33:27.916994 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5c4ec2-f92a-40f8-bdf7-0fc41ff38faa admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:33:27.934563 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5c4ec2-f92a-40f8-bdf7-0fc41ff38faa admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:33:27.937440 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b85bf4c-62ad-45ee-b842-122e619a1cbf admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:33:27.944617 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fced26-b686-4588-8453-236751d11c26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:33:27.945257 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fced26-b686-4588-8453-236751d11c26 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:33:27.945539 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fced26-b686-4588-8453-236751d11c26 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:33:27.945821 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fced26-b686-4588-8453-236751d11c26 admin admin] PATH_INFO: `/v3/projects/a2e51b2800f14e7fa67e9bed4cc6498b` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:33:27.946888 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8eae61-2e11-4414-a2d9-3cc8dd537c0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:33:27.947511 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8eae61-2e11-4414-a2d9-3cc8dd537c0f admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:33:27.947786 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8eae61-2e11-4414-a2d9-3cc8dd537c0f admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:33:27.948056 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8eae61-2e11-4414-a2d9-3cc8dd537c0f admin admin] PATH_INFO: `/v3/projects/a2e51b2800f14e7fa67e9bed4cc6498b` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:33:27.949178 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8fced26-b686-4588-8453-236751d11c26 admin admin] RBAC: Authorizing `identity:get_project(project_id=a2e51b2800f14e7fa67e9bed4cc6498b)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:33:27.951389 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8fced26-b686-4588-8453-236751d11c26 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:33:27.951995 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8eae61-2e11-4414-a2d9-3cc8dd537c0f admin admin] RBAC: Authorizing `identity:get_project(project_id=a2e51b2800f14e7fa67e9bed4cc6498b)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:33:27.953505 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 139/268] 10.222.0.65 () {56 vars in 1207 bytes} [Thu Oct 27 09:33:27 2022] GET /identity/v3/projects/a2e51b2800f14e7fa67e9bed4cc6498b => generated 298 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 09:33:27.954117 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8eae61-2e11-4414-a2d9-3cc8dd537c0f admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:33:27.955842 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 130/269] 10.222.0.65 () {56 vars in 1207 bytes} [Thu Oct 27 09:33:27 2022] GET /identity/v3/projects/a2e51b2800f14e7fa67e9bed4cc6498b => generated 298 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 09:33:27.959562 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fced26-b686-4588-8453-236751d11c26 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:33:27.964015 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8eae61-2e11-4414-a2d9-3cc8dd537c0f admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:33:27.977304 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fced26-b686-4588-8453-236751d11c26 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:33:27.979707 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8eae61-2e11-4414-a2d9-3cc8dd537c0f admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:33:27.985729 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb066ca-0991-4baa-a821-87fd37d36830 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:33:27.990234 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb066ca-0991-4baa-a821-87fd37d36830 admin admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:33:27.990234 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb066ca-0991-4baa-a821-87fd37d36830 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:33:27.990234 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb066ca-0991-4baa-a821-87fd37d36830 admin admin] PATH_INFO: `/v3/projects/a2e51b2800f14e7fa67e9bed4cc6498b/groups/1cf1417983a647b3a7949bc7ad5c76e9/roles/438ff415f4f644afb2cc60293cc13741` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:33:27.990234 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb066ca-0991-4baa-a821-87fd37d36830 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a2e51b2800f14e7fa67e9bed4cc6498b, group_id=1cf1417983a647b3a7949bc7ad5c76e9, role_id=438ff415f4f644afb2cc60293cc13741)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:33:27.991458 dv-cinder-797970-7-smb devstack@keystone.service[88312]: WARNING py.warnings [None req-adb066ca-0991-4baa-a821-87fd37d36830 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 27 09:33:27.991458 dv-cinder-797970-7-smb devstack@keystone.service[88312]: warnings.warn(msg) Oct 27 09:33:27.991458 dv-cinder-797970-7-smb devstack@keystone.service[88312]: Oct 27 09:33:27.995276 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb066ca-0991-4baa-a821-87fd37d36830 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:33:27.996146 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3e3fb3-9fe4-47a7-b2b8-de021ad03e34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:33:27.996907 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3e3fb3-9fe4-47a7-b2b8-de021ad03e34 admin admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:33:27.997272 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3e3fb3-9fe4-47a7-b2b8-de021ad03e34 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:33:27.997748 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3e3fb3-9fe4-47a7-b2b8-de021ad03e34 admin admin] PATH_INFO: `/v3/projects/a2e51b2800f14e7fa67e9bed4cc6498b/groups/1cf1417983a647b3a7949bc7ad5c76e9/roles/43543ce1450245af9661cb017bac17bd` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:33:28.001275 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3e3fb3-9fe4-47a7-b2b8-de021ad03e34 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a2e51b2800f14e7fa67e9bed4cc6498b, group_id=1cf1417983a647b3a7949bc7ad5c76e9, role_id=43543ce1450245af9661cb017bac17bd)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:33:28.002337 dv-cinder-797970-7-smb devstack@keystone.service[88311]: WARNING py.warnings [None req-2a3e3fb3-9fe4-47a7-b2b8-de021ad03e34 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 27 09:33:28.002337 dv-cinder-797970-7-smb devstack@keystone.service[88311]: warnings.warn(msg) Oct 27 09:33:28.002337 dv-cinder-797970-7-smb devstack@keystone.service[88311]: Oct 27 09:33:28.004349 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3e3fb3-9fe4-47a7-b2b8-de021ad03e34 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:33:28.092246 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 131/270] 10.222.0.65 () {58 vars in 1463 bytes} [Thu Oct 27 09:33:27 2022] PUT /identity/v3/projects/a2e51b2800f14e7fa67e9bed4cc6498b/groups/1cf1417983a647b3a7949bc7ad5c76e9/roles/438ff415f4f644afb2cc60293cc13741 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 09:33:28.109319 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 140/271] 10.222.0.65 () {58 vars in 1463 bytes} [Thu Oct 27 09:33:27 2022] PUT /identity/v3/projects/a2e51b2800f14e7fa67e9bed4cc6498b/groups/1cf1417983a647b3a7949bc7ad5c76e9/roles/43543ce1450245af9661cb017bac17bd => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 09:33:28.137787 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb066ca-0991-4baa-a821-87fd37d36830 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:33:28.217286 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb066ca-0991-4baa-a821-87fd37d36830 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:33:28.293224 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c24e703-07c4-4d70-a02c-738f126a48d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:33:28.294891 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c24e703-07c4-4d70-a02c-738f126a48d9 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:33:28.295531 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c24e703-07c4-4d70-a02c-738f126a48d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:33:28.296000 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c24e703-07c4-4d70-a02c-738f126a48d9 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:33:28.313919 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c24e703-07c4-4d70-a02c-738f126a48d9 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 09:33:28.319547 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application [None req-9c24e703-07c4-4d70-a02c-738f126a48d9 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 27 09:33:28.319547 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 09:33:28.319547 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 09:33:28.319547 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 09:33:28.319547 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 09:33:28.319547 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 09:33:28.319547 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 09:33:28.319547 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 09:33:28.319547 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 09:33:28.319547 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 09:33:28.319547 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 09:33:28.319547 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 09:33:28.319547 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 27 09:33:28.319547 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 27 09:33:28.319547 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 27 09:33:28.319547 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 27 09:33:28.320453 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 27 09:33:28.320453 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 27 09:33:28.320453 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 27 09:33:28.320453 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 27 09:33:28.320453 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 09:33:28.320453 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 09:33:28.320453 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 09:33:28.320453 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 09:33:28.320453 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 09:33:28.320453 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 09:33:28.320453 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 09:33:28.320453 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application with Lock( Oct 27 09:33:28.320453 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 09:33:28.320453 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._enter() Oct 27 09:33:28.320453 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 09:33:28.320453 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 09:33:28.321457 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 09:33:28.321457 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.creator() Oct 27 09:33:28.321457 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 09:33:28.321457 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application created_value = creator( Oct 27 09:33:28.321457 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 27 09:33:28.321457 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 27 09:33:28.321457 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 27 09:33:28.321457 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 27 09:33:28.321457 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 27 09:33:28.321457 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 27 09:33:28.321457 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 27 09:33:28.321457 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application Oct 27 09:33:28.324400 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 132/272] 10.222.0.65 () {56 vars in 1120 bytes} [Thu Oct 27 09:33:28 2022] GET /identity/v3/roles/member => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 09:33:28.329996 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3e3fb3-9fe4-47a7-b2b8-de021ad03e34 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:33:28.348494 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3e3fb3-9fe4-47a7-b2b8-de021ad03e34 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:33:28.360188 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8826d4a3-a2d9-4938-b099-5ef05091371b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:33:28.360815 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8826d4a3-a2d9-4938-b099-5ef05091371b admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:33:28.361099 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8826d4a3-a2d9-4938-b099-5ef05091371b admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:33:28.361380 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8826d4a3-a2d9-4938-b099-5ef05091371b admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:33:28.362081 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8826d4a3-a2d9-4938-b099-5ef05091371b admin admin] RBAC: Adding query filter params (name=member) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 09:33:28.362387 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8826d4a3-a2d9-4938-b099-5ef05091371b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:33:28.364234 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8826d4a3-a2d9-4938-b099-5ef05091371b admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:33:28.377164 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 141/273] 10.222.0.65 () {56 vars in 1122 bytes} [Thu Oct 27 09:33:28 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 09:33:28.382828 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c24e703-07c4-4d70-a02c-738f126a48d9 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:33:28.399550 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c24e703-07c4-4d70-a02c-738f126a48d9 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:33:28.405706 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7736e6b2-946b-48e9-ab66-853e24f4c408 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:33:28.406853 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7736e6b2-946b-48e9-ab66-853e24f4c408 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:33:28.407357 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7736e6b2-946b-48e9-ab66-853e24f4c408 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:33:28.407834 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7736e6b2-946b-48e9-ab66-853e24f4c408 admin admin] PATH_INFO: `/v3/groups/1cf1417983a647b3a7949bc7ad5c76e9` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:33:28.409346 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7736e6b2-946b-48e9-ab66-853e24f4c408 admin admin] RBAC: Authorizing `identity:get_group(group_id=1cf1417983a647b3a7949bc7ad5c76e9)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:33:28.411761 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7736e6b2-946b-48e9-ab66-853e24f4c408 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:33:28.419752 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 133/274] 10.222.0.65 () {56 vars in 1201 bytes} [Thu Oct 27 09:33:28 2022] GET /identity/v3/groups/1cf1417983a647b3a7949bc7ad5c76e9 => generated 226 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 09:33:28.425843 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8826d4a3-a2d9-4938-b099-5ef05091371b admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:33:28.444181 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8826d4a3-a2d9-4938-b099-5ef05091371b admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:33:28.455241 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fa84a4-31f5-4fa4-951a-e481d901b534 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:33:28.455899 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fa84a4-31f5-4fa4-951a-e481d901b534 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:33:28.456182 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fa84a4-31f5-4fa4-951a-e481d901b534 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:33:28.456461 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fa84a4-31f5-4fa4-951a-e481d901b534 admin admin] PATH_INFO: `/v3/projects/b86df928a9974a6993ae75bd68b27098` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:33:28.463519 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60fa84a4-31f5-4fa4-951a-e481d901b534 admin admin] RBAC: Authorizing `identity:get_project(project_id=b86df928a9974a6993ae75bd68b27098)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:33:28.465783 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60fa84a4-31f5-4fa4-951a-e481d901b534 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:33:28.468038 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 142/275] 10.222.0.65 () {56 vars in 1207 bytes} [Thu Oct 27 09:33:28 2022] GET /identity/v3/projects/b86df928a9974a6993ae75bd68b27098 => generated 302 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 09:33:28.474116 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7736e6b2-946b-48e9-ab66-853e24f4c408 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:33:28.486470 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7736e6b2-946b-48e9-ab66-853e24f4c408 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:33:28.492730 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4005adb-5af5-46b7-b4b2-96523a71d387 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:33:28.493737 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4005adb-5af5-46b7-b4b2-96523a71d387 admin admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:33:28.494257 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4005adb-5af5-46b7-b4b2-96523a71d387 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:33:28.494754 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4005adb-5af5-46b7-b4b2-96523a71d387 admin admin] PATH_INFO: `/v3/projects/b86df928a9974a6993ae75bd68b27098/groups/1cf1417983a647b3a7949bc7ad5c76e9/roles/43543ce1450245af9661cb017bac17bd` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:33:28.496960 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4005adb-5af5-46b7-b4b2-96523a71d387 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b86df928a9974a6993ae75bd68b27098, group_id=1cf1417983a647b3a7949bc7ad5c76e9, role_id=43543ce1450245af9661cb017bac17bd)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:33:28.500751 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4005adb-5af5-46b7-b4b2-96523a71d387 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:33:28.556881 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4441a9-758f-4eed-b360-4f319a6d98a7 None None] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:33:28.557219 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4441a9-758f-4eed-b360-4f319a6d98a7 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:33:28.557503 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4441a9-758f-4eed-b360-4f319a6d98a7 None None] PATH_INFO: `/` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:33:28.559181 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 143/276] 10.222.0.65 () {54 vars in 927 bytes} [Thu Oct 27 09:33:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 09:33:28.565688 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f48c2b-c6e1-46e6-a259-ebb733972372 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:33:28.565975 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f48c2b-c6e1-46e6-a259-ebb733972372 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:33:28.566253 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f48c2b-c6e1-46e6-a259-ebb733972372 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:33:28.588292 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-29f48c2b-c6e1-46e6-a259-ebb733972372 None None] MFA Rules not processed for user `b5065084bf664b99bdeac46067cb0f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:33:28.589859 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-29f48c2b-c6e1-46e6-a259-ebb733972372 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:33:28.632942 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 134/277] 10.222.0.65 () {58 vars in 1463 bytes} [Thu Oct 27 09:33:28 2022] PUT /identity/v3/projects/b86df928a9974a6993ae75bd68b27098/groups/1cf1417983a647b3a7949bc7ad5c76e9/roles/43543ce1450245af9661cb017bac17bd => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 09:33:28.674282 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:33:28.685002 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 144/278] 10.222.0.65 () {58 vars in 1024 bytes} [Thu Oct 27 09:33:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 27 09:33:28.776067 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f97ad73-4505-4372-a6c0-c6e7d6df7baf None None] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:33:28.776399 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f97ad73-4505-4372-a6c0-c6e7d6df7baf None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:33:28.776627 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f97ad73-4505-4372-a6c0-c6e7d6df7baf None None] PATH_INFO: `/` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:33:28.778294 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 135/279] 10.222.0.65 () {54 vars in 927 bytes} [Thu Oct 27 09:33:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 09:33:28.785285 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbff9cc-a2ec-498e-8bde-b7eda6bd0d1e None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:33:28.785578 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbff9cc-a2ec-498e-8bde-b7eda6bd0d1e None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:33:28.785848 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbff9cc-a2ec-498e-8bde-b7eda6bd0d1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:33:28.813052 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-6dbff9cc-a2ec-498e-8bde-b7eda6bd0d1e None None] MFA Rules not processed for user `b5065084bf664b99bdeac46067cb0f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:33:28.814328 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-6dbff9cc-a2ec-498e-8bde-b7eda6bd0d1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:33:28.893713 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 145/280] 10.222.0.65 () {58 vars in 1024 bytes} [Thu Oct 27 09:33:28 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Oct 27 09:33:29.093642 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f97ad73-4505-4372-a6c0-c6e7d6df7baf None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:33:29.119280 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:33:29.224872 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f97ad73-4505-4372-a6c0-c6e7d6df7baf None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:33:29.248199 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbff9cc-a2ec-498e-8bde-b7eda6bd0d1e None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:33:29.257764 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbff9cc-a2ec-498e-8bde-b7eda6bd0d1e None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:33:29.266510 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4fe18b-baf8-4314-b7a6-bff1b3465bde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:33:29.267179 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4fe18b-baf8-4314-b7a6-bff1b3465bde admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:33:29.267462 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4fe18b-baf8-4314-b7a6-bff1b3465bde admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:33:29.267738 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4fe18b-baf8-4314-b7a6-bff1b3465bde admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:33:29.275981 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca9a40f-2c8e-4352-b02e-29b0c4417e61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:33:29.276620 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca9a40f-2c8e-4352-b02e-29b0c4417e61 None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:33:29.276924 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca9a40f-2c8e-4352-b02e-29b0c4417e61 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:33:29.277173 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca9a40f-2c8e-4352-b02e-29b0c4417e61 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:33:29.290859 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4fe18b-baf8-4314-b7a6-bff1b3465bde admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 09:33:29.296745 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application [None req-2b4fe18b-baf8-4314-b7a6-bff1b3465bde admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 27 09:33:29.296745 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 09:33:29.296745 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 09:33:29.296745 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 09:33:29.296745 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 09:33:29.296745 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 09:33:29.296745 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 09:33:29.296745 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 09:33:29.296745 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 09:33:29.296745 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 09:33:29.296745 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 09:33:29.296745 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 09:33:29.296745 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 27 09:33:29.296745 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 27 09:33:29.296745 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 27 09:33:29.296745 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 27 09:33:29.297726 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 27 09:33:29.297726 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 27 09:33:29.297726 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 27 09:33:29.297726 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 27 09:33:29.297726 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 09:33:29.297726 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 09:33:29.297726 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 09:33:29.297726 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 09:33:29.297726 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 09:33:29.297726 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 09:33:29.297726 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 09:33:29.297726 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application with Lock( Oct 27 09:33:29.297726 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 09:33:29.297726 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._enter() Oct 27 09:33:29.297726 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 09:33:29.297726 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 09:33:29.298573 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 09:33:29.298573 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.creator() Oct 27 09:33:29.298573 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 09:33:29.298573 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application created_value = creator( Oct 27 09:33:29.298573 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 27 09:33:29.298573 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 27 09:33:29.298573 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 27 09:33:29.298573 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 27 09:33:29.298573 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 27 09:33:29.298573 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 27 09:33:29.298573 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 27 09:33:29.298573 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application Oct 27 09:33:29.298573 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 146/281] 10.222.0.65 () {56 vars in 1135 bytes} [Thu Oct 27 09:33:29 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 27 09:33:29.304054 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca9a40f-2c8e-4352-b02e-29b0c4417e61 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 09:33:29.309220 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application [None req-9ca9a40f-2c8e-4352-b02e-29b0c4417e61 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 27 09:33:29.309220 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 09:33:29.309220 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 09:33:29.309220 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 09:33:29.309220 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 09:33:29.309220 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 09:33:29.309220 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 09:33:29.309220 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 09:33:29.309220 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 09:33:29.309220 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 09:33:29.309220 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 09:33:29.309220 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 09:33:29.309220 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 27 09:33:29.309220 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 27 09:33:29.309220 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 27 09:33:29.309220 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 27 09:33:29.311811 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 27 09:33:29.311811 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 27 09:33:29.311811 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 27 09:33:29.311811 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 27 09:33:29.311811 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 09:33:29.311811 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 09:33:29.311811 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 09:33:29.311811 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 09:33:29.311811 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 09:33:29.311811 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 09:33:29.311811 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 09:33:29.311811 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application with Lock( Oct 27 09:33:29.311811 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 09:33:29.311811 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._enter() Oct 27 09:33:29.311811 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 09:33:29.311811 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 09:33:29.313841 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 09:33:29.313841 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.creator() Oct 27 09:33:29.313841 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 09:33:29.313841 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application created_value = creator( Oct 27 09:33:29.313841 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 27 09:33:29.313841 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 27 09:33:29.313841 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 27 09:33:29.313841 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 27 09:33:29.313841 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 27 09:33:29.313841 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 27 09:33:29.313841 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 27 09:33:29.313841 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application Oct 27 09:33:29.316156 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4fe18b-baf8-4314-b7a6-bff1b3465bde admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:33:29.322602 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 136/282] 10.222.0.65 () {56 vars in 1099 bytes} [Thu Oct 27 09:33:29 2022] GET /identity/v3/roles/reader => generated 84 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 09:33:29.324902 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca9a40f-2c8e-4352-b02e-29b0c4417e61 None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:33:29.338109 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4fe18b-baf8-4314-b7a6-bff1b3465bde admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:33:29.343153 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7412b995-7dc5-458e-a305-0774b027681e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:33:29.343827 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7412b995-7dc5-458e-a305-0774b027681e admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:33:29.344056 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7412b995-7dc5-458e-a305-0774b027681e admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:33:29.344383 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7412b995-7dc5-458e-a305-0774b027681e admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:33:29.345049 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7412b995-7dc5-458e-a305-0774b027681e admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 09:33:29.345365 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7412b995-7dc5-458e-a305-0774b027681e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:33:29.348111 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7412b995-7dc5-458e-a305-0774b027681e admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:33:29.359210 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 147/283] 10.222.0.65 () {56 vars in 1132 bytes} [Thu Oct 27 09:33:29 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 09:33:29.377726 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7412b995-7dc5-458e-a305-0774b027681e admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:33:29.399573 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7412b995-7dc5-458e-a305-0774b027681e admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:33:29.414870 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f9ddac-5118-4c73-8251-c92fd8d0adc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:33:29.415770 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f9ddac-5118-4c73-8251-c92fd8d0adc6 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:33:29.416198 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f9ddac-5118-4c73-8251-c92fd8d0adc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:33:29.416617 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f9ddac-5118-4c73-8251-c92fd8d0adc6 admin admin] PATH_INFO: `/v3/groups/1cf1417983a647b3a7949bc7ad5c76e9` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:33:29.418952 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f9ddac-5118-4c73-8251-c92fd8d0adc6 admin admin] RBAC: Authorizing `identity:get_group(group_id=1cf1417983a647b3a7949bc7ad5c76e9)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:33:29.421636 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f9ddac-5118-4c73-8251-c92fd8d0adc6 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:33:29.425329 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 148/284] 10.222.0.65 () {56 vars in 1201 bytes} [Thu Oct 27 09:33:29 2022] GET /identity/v3/groups/1cf1417983a647b3a7949bc7ad5c76e9 => generated 226 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 09:33:29.455906 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f9ddac-5118-4c73-8251-c92fd8d0adc6 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:33:29.468081 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f9ddac-5118-4c73-8251-c92fd8d0adc6 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:33:29.472626 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef8f8e6-bde8-47f3-ba63-50ded4aff6f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:33:29.473141 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:33:29.473278 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef8f8e6-bde8-47f3-ba63-50ded4aff6f5 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:33:29.473447 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef8f8e6-bde8-47f3-ba63-50ded4aff6f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:33:29.473741 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef8f8e6-bde8-47f3-ba63-50ded4aff6f5 admin admin] PATH_INFO: `/v3/projects/b86df928a9974a6993ae75bd68b27098` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:33:29.474888 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef8f8e6-bde8-47f3-ba63-50ded4aff6f5 admin admin] RBAC: Authorizing `identity:get_project(project_id=b86df928a9974a6993ae75bd68b27098)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:33:29.476961 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef8f8e6-bde8-47f3-ba63-50ded4aff6f5 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:33:29.479003 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 149/285] 10.222.0.65 () {56 vars in 1207 bytes} [Thu Oct 27 09:33:29 2022] GET /identity/v3/projects/b86df928a9974a6993ae75bd68b27098 => generated 302 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 09:33:29.480234 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e254f7d3-9ef8-4c5d-9363-439a0d04ae35 None None] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:33:29.480518 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e254f7d3-9ef8-4c5d-9363-439a0d04ae35 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:33:29.480792 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e254f7d3-9ef8-4c5d-9363-439a0d04ae35 None None] PATH_INFO: `/` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:33:29.482795 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 150/286] 10.222.0.65 () {54 vars in 927 bytes} [Thu Oct 27 09:33:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 09:33:29.495862 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b3139a-dfae-48ba-a5dc-cc6712aed8f7 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:33:29.496171 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b3139a-dfae-48ba-a5dc-cc6712aed8f7 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:33:29.496411 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b3139a-dfae-48ba-a5dc-cc6712aed8f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:33:29.499558 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca9a40f-2c8e-4352-b02e-29b0c4417e61 None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:33:29.530179 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-10b3139a-dfae-48ba-a5dc-cc6712aed8f7 None None] MFA Rules not processed for user `b5065084bf664b99bdeac46067cb0f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:33:29.531491 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-10b3139a-dfae-48ba-a5dc-cc6712aed8f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:33:29.546923 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 151/287] 10.222.0.65 () {58 vars in 1024 bytes} [Thu Oct 27 09:33:29 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Oct 27 09:33:29.547644 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b3139a-dfae-48ba-a5dc-cc6712aed8f7 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:33:29.561656 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f59088-423a-4c13-92c3-ebeea82f88bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:33:29.562385 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f59088-423a-4c13-92c3-ebeea82f88bd None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:33:29.562684 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f59088-423a-4c13-92c3-ebeea82f88bd None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:33:29.563012 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f59088-423a-4c13-92c3-ebeea82f88bd None admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:33:29.563779 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f59088-423a-4c13-92c3-ebeea82f88bd None admin] RBAC: Adding query filter params (name=reader) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 09:33:29.564047 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f59088-423a-4c13-92c3-ebeea82f88bd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:33:29.565593 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f59088-423a-4c13-92c3-ebeea82f88bd None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:33:29.566255 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b3139a-dfae-48ba-a5dc-cc6712aed8f7 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:33:29.570820 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb13f02-4e76-48b5-9def-17104b86ad20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:33:29.571481 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb13f02-4e76-48b5-9def-17104b86ad20 admin admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:33:29.571761 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb13f02-4e76-48b5-9def-17104b86ad20 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:33:29.572031 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb13f02-4e76-48b5-9def-17104b86ad20 admin admin] PATH_INFO: `/v3/projects/b86df928a9974a6993ae75bd68b27098/groups/1cf1417983a647b3a7949bc7ad5c76e9/roles/438ff415f4f644afb2cc60293cc13741` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:33:29.579907 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb13f02-4e76-48b5-9def-17104b86ad20 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b86df928a9974a6993ae75bd68b27098, group_id=1cf1417983a647b3a7949bc7ad5c76e9, role_id=438ff415f4f644afb2cc60293cc13741)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:33:29.582603 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb13f02-4e76-48b5-9def-17104b86ad20 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:33:29.583800 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 137/288] 10.222.0.65 () {56 vars in 1101 bytes} [Thu Oct 27 09:33:29 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 09:33:29.590468 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f59088-423a-4c13-92c3-ebeea82f88bd None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:33:29.691018 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 152/289] 10.222.0.65 () {58 vars in 1463 bytes} [Thu Oct 27 09:33:29 2022] PUT /identity/v3/projects/b86df928a9974a6993ae75bd68b27098/groups/1cf1417983a647b3a7949bc7ad5c76e9/roles/438ff415f4f644afb2cc60293cc13741 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 09:33:29.750900 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f59088-423a-4c13-92c3-ebeea82f88bd None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:33:29.810368 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8529525c-ce7c-405f-a098-c33e40b76c33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:33:29.811294 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8529525c-ce7c-405f-a098-c33e40b76c33 None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:33:29.811628 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8529525c-ce7c-405f-a098-c33e40b76c33 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:33:29.811908 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8529525c-ce7c-405f-a098-c33e40b76c33 None admin] PATH_INFO: `/v3/users/0a16d54516144c68b71a10fc3bdcad55` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:33:29.813199 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8529525c-ce7c-405f-a098-c33e40b76c33 None admin] RBAC: Authorizing `identity:get_user(user_id=0a16d54516144c68b71a10fc3bdcad55)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:33:29.814693 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8529525c-ce7c-405f-a098-c33e40b76c33 None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:33:29.817320 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 138/290] 10.222.0.65 () {56 vars in 1177 bytes} [Thu Oct 27 09:33:29 2022] GET /identity/v3/users/0a16d54516144c68b71a10fc3bdcad55 => generated 293 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 09:33:29.823061 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb13f02-4e76-48b5-9def-17104b86ad20 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:33:29.977013 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:33:29.991255 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb13f02-4e76-48b5-9def-17104b86ad20 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:33:30.036316 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8529525c-ce7c-405f-a098-c33e40b76c33 None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:33:30.037913 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ee6994-7942-4075-ad9a-2d7b9ad3313d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:33:30.038878 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ee6994-7942-4075-ad9a-2d7b9ad3313d None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:33:30.039395 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ee6994-7942-4075-ad9a-2d7b9ad3313d None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:33:30.039890 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ee6994-7942-4075-ad9a-2d7b9ad3313d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:33:30.040855 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ee6994-7942-4075-ad9a-2d7b9ad3313d None admin] RBAC: Adding query filter params (role.id=4d4811302e664f5fac66b7229e5c1b8f, user.id=0a16d54516144c68b71a10fc3bdcad55, scope.system=all) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 09:33:30.041385 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ee6994-7942-4075-ad9a-2d7b9ad3313d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:33:30.043114 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ee6994-7942-4075-ad9a-2d7b9ad3313d None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:33:30.057318 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 153/291] 10.222.0.65 () {56 vars in 1308 bytes} [Thu Oct 27 09:33:29 2022] GET /identity/v3/role_assignments?user.id=0a16d54516144c68b71a10fc3bdcad55&scope.system=all&role.id=4d4811302e664f5fac66b7229e5c1b8f => generated 510 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 09:33:30.063303 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:33:30.151742 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8529525c-ce7c-405f-a098-c33e40b76c33 None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:33:30.157229 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3775ff-4b21-4ff7-a6c0-77777d166f14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:33:30.157894 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3775ff-4b21-4ff7-a6c0-77777d166f14 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:33:30.158250 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3775ff-4b21-4ff7-a6c0-77777d166f14 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:33:30.158544 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3775ff-4b21-4ff7-a6c0-77777d166f14 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:33:30.172800 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3775ff-4b21-4ff7-a6c0-77777d166f14 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 09:33:30.178040 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application [None req-3b3775ff-4b21-4ff7-a6c0-77777d166f14 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 27 09:33:30.178040 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 09:33:30.178040 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 09:33:30.178040 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 09:33:30.178040 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 09:33:30.178040 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 09:33:30.178040 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 09:33:30.178040 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 09:33:30.178040 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 09:33:30.178040 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 09:33:30.178040 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 09:33:30.178040 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 09:33:30.178040 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 27 09:33:30.178040 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 27 09:33:30.178040 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 27 09:33:30.178040 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 27 09:33:30.179016 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 27 09:33:30.179016 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 27 09:33:30.179016 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 27 09:33:30.179016 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 27 09:33:30.179016 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 09:33:30.179016 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 09:33:30.179016 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 09:33:30.179016 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 09:33:30.179016 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 09:33:30.179016 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 09:33:30.179016 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 09:33:30.179016 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application with Lock( Oct 27 09:33:30.179016 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 09:33:30.179016 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._enter() Oct 27 09:33:30.179016 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 09:33:30.179016 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 09:33:30.179783 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 09:33:30.179783 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.creator() Oct 27 09:33:30.179783 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 09:33:30.179783 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application created_value = creator( Oct 27 09:33:30.179783 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 27 09:33:30.179783 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 27 09:33:30.179783 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 27 09:33:30.179783 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 27 09:33:30.179783 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 27 09:33:30.179783 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 27 09:33:30.179783 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 27 09:33:30.179783 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application Oct 27 09:33:30.182658 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 139/292] 10.222.0.65 () {56 vars in 1117 bytes} [Thu Oct 27 09:33:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 144 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 09:33:30.186637 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ee6994-7942-4075-ad9a-2d7b9ad3313d None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:33:30.209675 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ee6994-7942-4075-ad9a-2d7b9ad3313d None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:33:30.216747 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ddf382-7a0e-4dd8-9502-0085addb6812 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:33:30.217940 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ddf382-7a0e-4dd8-9502-0085addb6812 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:33:30.218450 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ddf382-7a0e-4dd8-9502-0085addb6812 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:33:30.218980 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ddf382-7a0e-4dd8-9502-0085addb6812 admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:33:30.219897 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ddf382-7a0e-4dd8-9502-0085addb6812 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 09:33:30.220425 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ddf382-7a0e-4dd8-9502-0085addb6812 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:33:30.222331 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ddf382-7a0e-4dd8-9502-0085addb6812 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:33:30.243590 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 154/293] 10.222.0.65 () {56 vars in 1120 bytes} [Thu Oct 27 09:33:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 09:33:30.251315 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3775ff-4b21-4ff7-a6c0-77777d166f14 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:33:30.267365 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3775ff-4b21-4ff7-a6c0-77777d166f14 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:33:30.273117 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1991b5-55ed-4a66-b873-994a5dad1119 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:33:30.273807 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1991b5-55ed-4a66-b873-994a5dad1119 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:33:30.274088 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1991b5-55ed-4a66-b873-994a5dad1119 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:33:30.274361 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1991b5-55ed-4a66-b873-994a5dad1119 admin admin] PATH_INFO: `/v3/groups/8a2e5532083a4811855d4bea5982a599` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:33:30.283473 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1991b5-55ed-4a66-b873-994a5dad1119 admin admin] RBAC: Authorizing `identity:get_group(group_id=8a2e5532083a4811855d4bea5982a599)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:33:30.285626 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1991b5-55ed-4a66-b873-994a5dad1119 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:33:30.288711 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 140/294] 10.222.0.65 () {56 vars in 1201 bytes} [Thu Oct 27 09:33:30 2022] GET /identity/v3/groups/8a2e5532083a4811855d4bea5982a599 => generated 229 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 09:33:30.293419 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ddf382-7a0e-4dd8-9502-0085addb6812 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:33:30.304410 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ddf382-7a0e-4dd8-9502-0085addb6812 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:33:30.315045 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acba9fc6-a38f-43d8-a46a-fea2348528d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:33:30.316040 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acba9fc6-a38f-43d8-a46a-fea2348528d7 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:33:30.316520 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acba9fc6-a38f-43d8-a46a-fea2348528d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:33:30.316996 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acba9fc6-a38f-43d8-a46a-fea2348528d7 admin admin] PATH_INFO: `/v3/projects/9c03247ba584473d97a93650c876aafd` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:33:30.323418 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acba9fc6-a38f-43d8-a46a-fea2348528d7 admin admin] RBAC: Authorizing `identity:get_project(project_id=9c03247ba584473d97a93650c876aafd)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:33:30.326582 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acba9fc6-a38f-43d8-a46a-fea2348528d7 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:33:30.329328 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 155/295] 10.222.0.65 () {56 vars in 1207 bytes} [Thu Oct 27 09:33:30 2022] GET /identity/v3/projects/9c03247ba584473d97a93650c876aafd => generated 344 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 09:33:30.335156 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1991b5-55ed-4a66-b873-994a5dad1119 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:33:30.345854 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1991b5-55ed-4a66-b873-994a5dad1119 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:33:30.358236 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ce4b0b-9c76-4d37-8d37-2d7f374328ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:33:30.358934 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ce4b0b-9c76-4d37-8d37-2d7f374328ae admin admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:33:30.359217 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ce4b0b-9c76-4d37-8d37-2d7f374328ae admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:33:30.359492 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ce4b0b-9c76-4d37-8d37-2d7f374328ae admin admin] PATH_INFO: `/v3/projects/9c03247ba584473d97a93650c876aafd/groups/8a2e5532083a4811855d4bea5982a599/roles/6ad17b9f9dea4b66ab2da3677d7e715d` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:33:30.361449 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ce4b0b-9c76-4d37-8d37-2d7f374328ae admin admin] RBAC: Authorizing `identity:create_grant(project_id=9c03247ba584473d97a93650c876aafd, group_id=8a2e5532083a4811855d4bea5982a599, role_id=6ad17b9f9dea4b66ab2da3677d7e715d)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:33:30.364181 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ce4b0b-9c76-4d37-8d37-2d7f374328ae admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:33:30.445488 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 141/296] 10.222.0.65 () {58 vars in 1463 bytes} [Thu Oct 27 09:33:30 2022] PUT /identity/v3/projects/9c03247ba584473d97a93650c876aafd/groups/8a2e5532083a4811855d4bea5982a599/roles/6ad17b9f9dea4b66ab2da3677d7e715d => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 09:33:31.704905 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37505f61-a232-4d9f-9540-fe282ca95910 None None] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:33:31.705923 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37505f61-a232-4d9f-9540-fe282ca95910 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:33:31.706425 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37505f61-a232-4d9f-9540-fe282ca95910 None None] PATH_INFO: `/` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:33:31.708316 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 156/297] 10.222.0.65 () {54 vars in 927 bytes} [Thu Oct 27 09:33:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 09:33:31.714068 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08ca128-e304-4ecf-b24f-a006b4e4f9e5 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:33:31.714957 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08ca128-e304-4ecf-b24f-a006b4e4f9e5 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:33:31.715429 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08ca128-e304-4ecf-b24f-a006b4e4f9e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:33:31.743920 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-d08ca128-e304-4ecf-b24f-a006b4e4f9e5 None None] MFA Rules not processed for user `b5065084bf664b99bdeac46067cb0f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:33:31.745666 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-d08ca128-e304-4ecf-b24f-a006b4e4f9e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:33:31.841274 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 142/298] 10.222.0.65 () {58 vars in 1024 bytes} [Thu Oct 27 09:33:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 27 09:33:31.885345 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dccc20-c05b-4b62-822b-a1f45db9f4ae None None] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:33:31.885959 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dccc20-c05b-4b62-822b-a1f45db9f4ae None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:33:31.886449 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dccc20-c05b-4b62-822b-a1f45db9f4ae None None] PATH_INFO: `/` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:33:31.888956 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 157/299] 10.222.0.65 () {54 vars in 927 bytes} [Thu Oct 27 09:33:31 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 09:33:31.894715 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9d13bf-999e-4550-b3cc-7bf609e8e1a0 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:33:31.895296 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9d13bf-999e-4550-b3cc-7bf609e8e1a0 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:33:31.895783 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9d13bf-999e-4550-b3cc-7bf609e8e1a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:33:31.920706 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-eb9d13bf-999e-4550-b3cc-7bf609e8e1a0 None None] MFA Rules not processed for user `b5065084bf664b99bdeac46067cb0f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:33:31.922293 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-eb9d13bf-999e-4550-b3cc-7bf609e8e1a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:33:31.994352 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:33:31.999209 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ba4f73-bc5d-4e46-8873-3c6dfe3472ba None None] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:33:31.999814 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ba4f73-bc5d-4e46-8873-3c6dfe3472ba None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:33:32.000283 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ba4f73-bc5d-4e46-8873-3c6dfe3472ba None None] PATH_INFO: `/` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:33:32.002129 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 158/300] 10.222.0.65 () {54 vars in 927 bytes} [Thu Oct 27 09:33:31 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 09:33:32.007947 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54845a90-71b0-4e9a-a587-dde866cc1db2 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:33:32.010930 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54845a90-71b0-4e9a-a587-dde866cc1db2 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:33:32.010930 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54845a90-71b0-4e9a-a587-dde866cc1db2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:33:32.028980 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 143/301] 10.222.0.65 () {58 vars in 1024 bytes} [Thu Oct 27 09:33:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 27 09:33:32.037428 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-54845a90-71b0-4e9a-a587-dde866cc1db2 None None] MFA Rules not processed for user `b5065084bf664b99bdeac46067cb0f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:33:32.038942 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-54845a90-71b0-4e9a-a587-dde866cc1db2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:33:32.127127 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 159/302] 10.222.0.65 () {58 vars in 1024 bytes} [Thu Oct 27 09:33:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 27 09:33:32.198207 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9d13bf-999e-4550-b3cc-7bf609e8e1a0 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:33:32.320951 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9d13bf-999e-4550-b3cc-7bf609e8e1a0 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:33:32.363582 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54290c9-b31e-4fa7-880a-66d6eb8466f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:33:32.364219 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54290c9-b31e-4fa7-880a-66d6eb8466f9 None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:33:32.364496 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54290c9-b31e-4fa7-880a-66d6eb8466f9 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:33:32.364765 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54290c9-b31e-4fa7-880a-66d6eb8466f9 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:33:32.377759 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54290c9-b31e-4fa7-880a-66d6eb8466f9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 09:33:32.382702 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application [None req-e54290c9-b31e-4fa7-880a-66d6eb8466f9 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 27 09:33:32.382702 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 09:33:32.382702 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 09:33:32.382702 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 09:33:32.382702 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 09:33:32.382702 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 09:33:32.382702 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 09:33:32.382702 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 09:33:32.382702 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 09:33:32.382702 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 09:33:32.382702 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 09:33:32.382702 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 09:33:32.382702 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 27 09:33:32.382702 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 27 09:33:32.382702 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 27 09:33:32.382702 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 27 09:33:32.383590 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 27 09:33:32.383590 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 27 09:33:32.383590 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 27 09:33:32.383590 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 27 09:33:32.383590 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 09:33:32.383590 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 09:33:32.383590 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 09:33:32.383590 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 09:33:32.383590 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 09:33:32.383590 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 09:33:32.383590 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 09:33:32.383590 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application with Lock( Oct 27 09:33:32.383590 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 09:33:32.383590 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._enter() Oct 27 09:33:32.383590 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 09:33:32.383590 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 09:33:32.384367 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 09:33:32.384367 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.creator() Oct 27 09:33:32.384367 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 09:33:32.384367 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application created_value = creator( Oct 27 09:33:32.384367 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 27 09:33:32.384367 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 27 09:33:32.384367 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 27 09:33:32.384367 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 27 09:33:32.384367 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 27 09:33:32.384367 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 27 09:33:32.384367 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 27 09:33:32.384367 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application Oct 27 09:33:32.384367 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 144/303] 10.222.0.65 () {56 vars in 1114 bytes} [Thu Oct 27 09:33:32 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 09:33:32.390057 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54845a90-71b0-4e9a-a587-dde866cc1db2 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:33:32.476099 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:33:32.486258 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54290c9-b31e-4fa7-880a-66d6eb8466f9 None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:33:32.547287 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54845a90-71b0-4e9a-a587-dde866cc1db2 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:33:32.572479 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:33:32.588896 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6350693b-f2c7-4765-8051-37377aa4fdcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:33:32.590154 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6350693b-f2c7-4765-8051-37377aa4fdcf None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:33:32.590658 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6350693b-f2c7-4765-8051-37377aa4fdcf None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:33:32.591862 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6350693b-f2c7-4765-8051-37377aa4fdcf None admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:33:32.592875 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6350693b-f2c7-4765-8051-37377aa4fdcf None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 09:33:32.593376 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6350693b-f2c7-4765-8051-37377aa4fdcf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:33:32.595054 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6350693b-f2c7-4765-8051-37377aa4fdcf None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:33:32.604863 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 160/304] 10.222.0.65 () {56 vars in 1111 bytes} [Thu Oct 27 09:33:32 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 09:33:32.606038 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6350693b-f2c7-4765-8051-37377aa4fdcf None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:33:32.639190 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54290c9-b31e-4fa7-880a-66d6eb8466f9 None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:33:32.702429 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a44be6-a399-43ea-b19d-65cd49d4b426 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:33:32.703460 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a44be6-a399-43ea-b19d-65cd49d4b426 None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:33:32.703747 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a44be6-a399-43ea-b19d-65cd49d4b426 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:33:32.704178 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a44be6-a399-43ea-b19d-65cd49d4b426 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:33:32.728366 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a44be6-a399-43ea-b19d-65cd49d4b426 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 09:33:32.733928 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application [None req-e7a44be6-a399-43ea-b19d-65cd49d4b426 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 27 09:33:32.733928 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 09:33:32.733928 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 09:33:32.733928 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 09:33:32.733928 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 09:33:32.733928 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 09:33:32.733928 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 09:33:32.733928 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 09:33:32.733928 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 09:33:32.733928 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 09:33:32.733928 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 09:33:32.733928 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 09:33:32.733928 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 27 09:33:32.733928 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 27 09:33:32.733928 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 27 09:33:32.733928 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 27 09:33:32.735046 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 27 09:33:32.735046 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 27 09:33:32.735046 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 27 09:33:32.735046 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 27 09:33:32.735046 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 09:33:32.735046 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 09:33:32.735046 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 09:33:32.735046 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 09:33:32.735046 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 09:33:32.735046 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 09:33:32.735046 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 09:33:32.735046 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application with Lock( Oct 27 09:33:32.735046 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 09:33:32.735046 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._enter() Oct 27 09:33:32.735046 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 09:33:32.735046 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 09:33:32.735833 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 09:33:32.735833 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.creator() Oct 27 09:33:32.735833 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 09:33:32.735833 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application created_value = creator( Oct 27 09:33:32.735833 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 27 09:33:32.735833 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 27 09:33:32.735833 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 27 09:33:32.735833 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 27 09:33:32.735833 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 27 09:33:32.735833 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 27 09:33:32.735833 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 27 09:33:32.735833 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application Oct 27 09:33:32.735833 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 145/305] 10.222.0.65 () {56 vars in 1099 bytes} [Thu Oct 27 09:33:32 2022] GET /identity/v3/roles/member => generated 84 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 27 09:33:32.736469 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a44be6-a399-43ea-b19d-65cd49d4b426 None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:33:32.780400 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6350693b-f2c7-4765-8051-37377aa4fdcf None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:33:32.822102 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:33:32.832795 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce3fb47-f3b1-4e66-982a-575c96fd8e5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:33:32.833853 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce3fb47-f3b1-4e66-982a-575c96fd8e5d None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:33:32.834080 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce3fb47-f3b1-4e66-982a-575c96fd8e5d None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:33:32.834348 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce3fb47-f3b1-4e66-982a-575c96fd8e5d None admin] PATH_INFO: `/v3/roles/member` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:33:32.856181 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce3fb47-f3b1-4e66-982a-575c96fd8e5d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 09:33:32.862932 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application [None req-6ce3fb47-f3b1-4e66-982a-575c96fd8e5d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 27 09:33:32.862932 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 09:33:32.862932 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 09:33:32.862932 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 09:33:32.862932 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 09:33:32.862932 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 09:33:32.862932 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 09:33:32.862932 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 09:33:32.862932 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 09:33:32.862932 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 09:33:32.862932 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 09:33:32.862932 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 09:33:32.862932 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 27 09:33:32.862932 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 27 09:33:32.862932 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 27 09:33:32.862932 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 27 09:33:32.863956 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 27 09:33:32.863956 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 27 09:33:32.863956 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 27 09:33:32.863956 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 27 09:33:32.863956 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 09:33:32.863956 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 09:33:32.863956 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 09:33:32.863956 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 09:33:32.863956 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 09:33:32.863956 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 09:33:32.863956 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 09:33:32.863956 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application with Lock( Oct 27 09:33:32.863956 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 09:33:32.863956 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._enter() Oct 27 09:33:32.863956 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 09:33:32.863956 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 09:33:32.864775 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 09:33:32.864775 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.creator() Oct 27 09:33:32.864775 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 09:33:32.864775 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application created_value = creator( Oct 27 09:33:32.864775 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 27 09:33:32.864775 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 27 09:33:32.864775 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 27 09:33:32.864775 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 27 09:33:32.864775 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 27 09:33:32.864775 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 27 09:33:32.864775 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 27 09:33:32.864775 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application Oct 27 09:33:32.864775 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 161/306] 10.222.0.65 () {56 vars in 1099 bytes} [Thu Oct 27 09:33:32 2022] GET /identity/v3/roles/member => generated 84 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 09:33:32.865426 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7265e55f-4ca3-435c-afa8-8f1fedb18f53 None None] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:33:32.865755 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7265e55f-4ca3-435c-afa8-8f1fedb18f53 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:33:32.866293 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7265e55f-4ca3-435c-afa8-8f1fedb18f53 None None] PATH_INFO: `/` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:33:32.870659 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 162/307] 10.222.0.65 () {54 vars in 927 bytes} [Thu Oct 27 09:33:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 09:33:32.870659 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7265e55f-4ca3-435c-afa8-8f1fedb18f53 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:33:32.889345 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a44be6-a399-43ea-b19d-65cd49d4b426 None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:33:32.912248 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:33:32.939238 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e3d7f1-ff7f-4d79-86a6-074ac6d097ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:33:32.939446 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e3d7f1-ff7f-4d79-86a6-074ac6d097ff None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:33:32.939580 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e3d7f1-ff7f-4d79-86a6-074ac6d097ff None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:33:32.940343 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e3d7f1-ff7f-4d79-86a6-074ac6d097ff None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:33:33.004606 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7265e55f-4ca3-435c-afa8-8f1fedb18f53 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:33:33.038979 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e3d7f1-ff7f-4d79-86a6-074ac6d097ff None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:33:33.041206 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e3d7f1-ff7f-4d79-86a6-074ac6d097ff None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:33:33.051165 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5503c2-bf46-407f-b387-8e4803ad3d82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:33:33.052145 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5503c2-bf46-407f-b387-8e4803ad3d82 None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:33:33.052623 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5503c2-bf46-407f-b387-8e4803ad3d82 None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:33:33.053093 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5503c2-bf46-407f-b387-8e4803ad3d82 None admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:33:33.053956 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5503c2-bf46-407f-b387-8e4803ad3d82 None admin] RBAC: Adding query filter params (name=member) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 09:33:33.054420 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5503c2-bf46-407f-b387-8e4803ad3d82 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:33:33.055873 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5503c2-bf46-407f-b387-8e4803ad3d82 None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:33:33.066253 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 163/308] 10.222.0.65 () {56 vars in 1101 bytes} [Thu Oct 27 09:33:32 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 09:33:33.067135 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5503c2-bf46-407f-b387-8e4803ad3d82 None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:33:33.135458 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:33:33.177541 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 146/309] 10.222.0.65 () {58 vars in 1282 bytes} [Thu Oct 27 09:33:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 441 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 27 09:33:33.179842 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e462c6f-d874-44bd-8106-200862e0e1cc None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:33:33.180307 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e462c6f-d874-44bd-8106-200862e0e1cc None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:33:33.180896 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e462c6f-d874-44bd-8106-200862e0e1cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:33:33.198874 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5503c2-bf46-407f-b387-8e4803ad3d82 None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:33:33.203242 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-9e462c6f-d874-44bd-8106-200862e0e1cc None None] MFA Rules not processed for user `b5065084bf664b99bdeac46067cb0f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:33:33.204454 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-9e462c6f-d874-44bd-8106-200862e0e1cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:33:33.207744 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:33:33.247782 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cd1b9d-2af3-4640-b457-0917cfdb6087 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:33:33.248521 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cd1b9d-2af3-4640-b457-0917cfdb6087 None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:33:33.248728 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cd1b9d-2af3-4640-b457-0917cfdb6087 None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:33:33.248973 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cd1b9d-2af3-4640-b457-0917cfdb6087 None admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:33:33.249597 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09cd1b9d-2af3-4640-b457-0917cfdb6087 None admin] RBAC: Adding query filter params (name=member) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 09:33:33.249901 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09cd1b9d-2af3-4640-b457-0917cfdb6087 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:33:33.251382 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09cd1b9d-2af3-4640-b457-0917cfdb6087 None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:33:33.261844 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 164/310] 10.222.0.65 () {56 vars in 1101 bytes} [Thu Oct 27 09:33:33 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 09:33:33.263531 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cd1b9d-2af3-4640-b457-0917cfdb6087 None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:33:33.299872 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 147/311] 10.222.0.65 () {58 vars in 1024 bytes} [Thu Oct 27 09:33:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 27 09:33:33.301046 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e462c6f-d874-44bd-8106-200862e0e1cc None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:33:33.390650 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cd1b9d-2af3-4640-b457-0917cfdb6087 None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:33:33.405632 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:33:33.412756 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e462c6f-d874-44bd-8106-200862e0e1cc None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:33:33.432701 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23842c8f-b6b7-4e33-a14d-db09c06ebeb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:33:33.433473 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23842c8f-b6b7-4e33-a14d-db09c06ebeb1 None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:33:33.433854 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23842c8f-b6b7-4e33-a14d-db09c06ebeb1 None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:33:33.434322 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23842c8f-b6b7-4e33-a14d-db09c06ebeb1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:33:33.451999 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2d4ebe-af5a-43c0-bbd5-7d645805d291 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:33:33.452910 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2d4ebe-af5a-43c0-bbd5-7d645805d291 None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:33:33.453358 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2d4ebe-af5a-43c0-bbd5-7d645805d291 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:33:33.453824 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2d4ebe-af5a-43c0-bbd5-7d645805d291 None admin] PATH_INFO: `/v3/projects/a2e51b2800f14e7fa67e9bed4cc6498b` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:33:33.455174 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2d4ebe-af5a-43c0-bbd5-7d645805d291 None admin] RBAC: Authorizing `identity:get_project(project_id=a2e51b2800f14e7fa67e9bed4cc6498b)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:33:33.456777 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2d4ebe-af5a-43c0-bbd5-7d645805d291 None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:33:33.459137 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 148/312] 10.222.0.65 () {56 vars in 1186 bytes} [Thu Oct 27 09:33:33 2022] GET /identity/v3/projects/a2e51b2800f14e7fa67e9bed4cc6498b => generated 298 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 09:33:33.460059 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2d4ebe-af5a-43c0-bbd5-7d645805d291 None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:33:33.476665 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:33:33.514410 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23842c8f-b6b7-4e33-a14d-db09c06ebeb1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:33:33.516247 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23842c8f-b6b7-4e33-a14d-db09c06ebeb1 None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:33:33.579399 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2d4ebe-af5a-43c0-bbd5-7d645805d291 None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:33:33.618849 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e61cd0c-d25b-4c05-98aa-4c9b0ca25ed2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:33:33.619627 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e61cd0c-d25b-4c05-98aa-4c9b0ca25ed2 None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:33:33.619913 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e61cd0c-d25b-4c05-98aa-4c9b0ca25ed2 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:33:33.620185 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e61cd0c-d25b-4c05-98aa-4c9b0ca25ed2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:33:33.636090 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 165/313] 10.222.0.65 () {58 vars in 1282 bytes} [Thu Oct 27 09:33:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 27 09:33:33.638571 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23842c8f-b6b7-4e33-a14d-db09c06ebeb1 None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:33:33.655936 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:33:33.702693 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e61cd0c-d25b-4c05-98aa-4c9b0ca25ed2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:33:33.705450 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e61cd0c-d25b-4c05-98aa-4c9b0ca25ed2 None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:33:33.718964 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:33:33.768458 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23842c8f-b6b7-4e33-a14d-db09c06ebeb1 None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:33:33.808243 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4913399a-54f7-46ad-91b4-244c31685f10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:33:33.808864 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4913399a-54f7-46ad-91b4-244c31685f10 None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:33:33.809139 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4913399a-54f7-46ad-91b4-244c31685f10 None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:33:33.809937 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4913399a-54f7-46ad-91b4-244c31685f10 None admin] PATH_INFO: `/v3/groups/1cf1417983a647b3a7949bc7ad5c76e9` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:33:33.811344 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4913399a-54f7-46ad-91b4-244c31685f10 None admin] RBAC: Authorizing `identity:get_group(group_id=1cf1417983a647b3a7949bc7ad5c76e9)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:33:33.812793 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4913399a-54f7-46ad-91b4-244c31685f10 None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:33:33.814441 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 166/314] 10.222.0.65 () {56 vars in 1180 bytes} [Thu Oct 27 09:33:33 2022] GET /identity/v3/groups/1cf1417983a647b3a7949bc7ad5c76e9 => generated 226 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 09:33:33.815267 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4913399a-54f7-46ad-91b4-244c31685f10 None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:33:33.837369 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 149/315] 10.222.0.65 () {58 vars in 1282 bytes} [Thu Oct 27 09:33:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 27 09:33:33.838937 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e61cd0c-d25b-4c05-98aa-4c9b0ca25ed2 None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:33:33.920074 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:33:33.943387 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4913399a-54f7-46ad-91b4-244c31685f10 None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:33:33.963510 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e61cd0c-d25b-4c05-98aa-4c9b0ca25ed2 None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:33:33.975460 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:33:33.988095 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4d9e05-640c-437a-b496-a249bc4557dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:33:33.988990 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4d9e05-640c-437a-b496-a249bc4557dc None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:33:33.989416 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4d9e05-640c-437a-b496-a249bc4557dc None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:33:33.989831 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4d9e05-640c-437a-b496-a249bc4557dc None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:33:34.002847 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4d9e05-640c-437a-b496-a249bc4557dc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 09:33:34.008069 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application [None req-2a4d9e05-640c-437a-b496-a249bc4557dc None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 27 09:33:34.008069 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 09:33:34.008069 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 09:33:34.008069 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 09:33:34.008069 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 09:33:34.008069 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 09:33:34.008069 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 09:33:34.008069 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 09:33:34.008069 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 09:33:34.008069 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 09:33:34.008069 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 09:33:34.008069 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 09:33:34.008069 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 27 09:33:34.008069 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 27 09:33:34.008069 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 27 09:33:34.008069 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 27 09:33:34.008939 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 27 09:33:34.008939 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 27 09:33:34.008939 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 27 09:33:34.008939 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 27 09:33:34.008939 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 09:33:34.008939 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 09:33:34.008939 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 09:33:34.008939 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 09:33:34.008939 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 09:33:34.008939 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 09:33:34.008939 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 09:33:34.008939 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application with Lock( Oct 27 09:33:34.008939 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 09:33:34.008939 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._enter() Oct 27 09:33:34.008939 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 09:33:34.008939 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 09:33:34.009705 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 09:33:34.009705 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.creator() Oct 27 09:33:34.009705 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 09:33:34.009705 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application created_value = creator( Oct 27 09:33:34.009705 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 27 09:33:34.009705 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 27 09:33:34.009705 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 27 09:33:34.009705 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 27 09:33:34.009705 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 27 09:33:34.009705 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 27 09:33:34.009705 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 27 09:33:34.009705 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application Oct 27 09:33:34.010274 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ace68b-3ec9-4c92-b86d-d4586800d0d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:33:34.010274 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ace68b-3ec9-4c92-b86d-d4586800d0d2 None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:33:34.010415 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 167/316] 10.222.0.65 () {56 vars in 1114 bytes} [Thu Oct 27 09:33:33 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 09:33:34.010491 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ace68b-3ec9-4c92-b86d-d4586800d0d2 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:33:34.010491 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ace68b-3ec9-4c92-b86d-d4586800d0d2 None admin] PATH_INFO: `/v3/projects/b86df928a9974a6993ae75bd68b27098` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:33:34.010649 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c688108-a1f6-4fea-b5d6-f5b3efe76b6f None None] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:33:34.010649 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c688108-a1f6-4fea-b5d6-f5b3efe76b6f None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:33:34.010765 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ace68b-3ec9-4c92-b86d-d4586800d0d2 None admin] RBAC: Authorizing `identity:get_project(project_id=b86df928a9974a6993ae75bd68b27098)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:33:34.011391 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c688108-a1f6-4fea-b5d6-f5b3efe76b6f None None] PATH_INFO: `/` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:33:34.012925 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 168/317] 10.222.0.65 () {54 vars in 927 bytes} [Thu Oct 27 09:33:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 09:33:34.013398 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c688108-a1f6-4fea-b5d6-f5b3efe76b6f None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:33:34.018280 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ace68b-3ec9-4c92-b86d-d4586800d0d2 None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:33:34.019415 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 150/318] 10.222.0.65 () {56 vars in 1186 bytes} [Thu Oct 27 09:33:33 2022] GET /identity/v3/projects/b86df928a9974a6993ae75bd68b27098 => generated 302 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 09:33:34.020169 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ace68b-3ec9-4c92-b86d-d4586800d0d2 None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:33:34.121155 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c688108-a1f6-4fea-b5d6-f5b3efe76b6f None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:33:34.129235 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ace68b-3ec9-4c92-b86d-d4586800d0d2 None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:33:34.156874 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c021736-677c-4166-a9fa-a5982acaf14a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:33:34.157473 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c021736-677c-4166-a9fa-a5982acaf14a None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:33:34.157745 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c021736-677c-4166-a9fa-a5982acaf14a None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:33:34.158017 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c021736-677c-4166-a9fa-a5982acaf14a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:33:34.158772 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c021736-677c-4166-a9fa-a5982acaf14a None admin] RBAC: Adding query filter params (group.id=1cf1417983a647b3a7949bc7ad5c76e9, role.id=438ff415f4f644afb2cc60293cc13741, scope.project.id=a2e51b2800f14e7fa67e9bed4cc6498b) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 09:33:34.159078 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c021736-677c-4166-a9fa-a5982acaf14a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:33:34.160514 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c021736-677c-4166-a9fa-a5982acaf14a None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:33:34.163490 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c806a9-919d-4adf-9b8a-dd78e4c9ae3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:33:34.164114 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c806a9-919d-4adf-9b8a-dd78e4c9ae3b None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:33:34.164396 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c806a9-919d-4adf-9b8a-dd78e4c9ae3b None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:33:34.164668 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c806a9-919d-4adf-9b8a-dd78e4c9ae3b None admin] PATH_INFO: `/v3/projects/a2e51b2800f14e7fa67e9bed4cc6498b` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:33:34.165785 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c806a9-919d-4adf-9b8a-dd78e4c9ae3b None admin] RBAC: Authorizing `identity:get_project(project_id=a2e51b2800f14e7fa67e9bed4cc6498b)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:33:34.166220 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 169/319] 10.222.0.65 () {56 vars in 1376 bytes} [Thu Oct 27 09:33:34 2022] GET /identity/v3/role_assignments?group.id=1cf1417983a647b3a7949bc7ad5c76e9&scope.project.id=a2e51b2800f14e7fa67e9bed4cc6498b&role.id=438ff415f4f644afb2cc60293cc13741 => generated 611 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 09:33:34.167042 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c021736-677c-4166-a9fa-a5982acaf14a None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:33:34.167264 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c806a9-919d-4adf-9b8a-dd78e4c9ae3b None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:33:34.169414 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 151/320] 10.222.0.65 () {56 vars in 1186 bytes} [Thu Oct 27 09:33:34 2022] GET /identity/v3/projects/a2e51b2800f14e7fa67e9bed4cc6498b => generated 298 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 09:33:34.169414 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65e52a4-f818-46b9-9b5f-598c01831f8b None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:33:34.169414 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65e52a4-f818-46b9-9b5f-598c01831f8b None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:33:34.169414 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65e52a4-f818-46b9-9b5f-598c01831f8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:33:34.189635 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:33:34.195527 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-a65e52a4-f818-46b9-9b5f-598c01831f8b None None] MFA Rules not processed for user `b5065084bf664b99bdeac46067cb0f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:33:34.196787 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-a65e52a4-f818-46b9-9b5f-598c01831f8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:33:34.246399 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:33:34.286891 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 152/321] 10.222.0.65 () {58 vars in 1024 bytes} [Thu Oct 27 09:33:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 27 09:33:34.288208 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65e52a4-f818-46b9-9b5f-598c01831f8b None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:33:34.323268 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c021736-677c-4166-a9fa-a5982acaf14a None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:33:34.371524 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6478cb08-3802-435e-adbd-aca04b9fa269 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:33:34.371728 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6478cb08-3802-435e-adbd-aca04b9fa269 None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:33:34.372113 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6478cb08-3802-435e-adbd-aca04b9fa269 None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:33:34.372249 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6478cb08-3802-435e-adbd-aca04b9fa269 None admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:33:34.373080 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6478cb08-3802-435e-adbd-aca04b9fa269 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 09:33:34.373392 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6478cb08-3802-435e-adbd-aca04b9fa269 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:33:34.375469 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6478cb08-3802-435e-adbd-aca04b9fa269 None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:33:34.384497 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 170/322] 10.222.0.65 () {56 vars in 1111 bytes} [Thu Oct 27 09:33:34 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 09:33:34.385204 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6478cb08-3802-435e-adbd-aca04b9fa269 None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:33:34.432530 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65e52a4-f818-46b9-9b5f-598c01831f8b None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:33:34.474589 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15e0017-a021-4333-a4d5-5621f591503e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:33:34.475133 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15e0017-a021-4333-a4d5-5621f591503e None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:33:34.475409 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15e0017-a021-4333-a4d5-5621f591503e None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:33:34.475677 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15e0017-a021-4333-a4d5-5621f591503e None admin] PATH_INFO: `/v3/groups/1cf1417983a647b3a7949bc7ad5c76e9` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:33:34.476773 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15e0017-a021-4333-a4d5-5621f591503e None admin] RBAC: Authorizing `identity:get_group(group_id=1cf1417983a647b3a7949bc7ad5c76e9)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:33:34.477181 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:33:34.478563 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15e0017-a021-4333-a4d5-5621f591503e None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:33:34.480453 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 153/323] 10.222.0.65 () {56 vars in 1180 bytes} [Thu Oct 27 09:33:34 2022] GET /identity/v3/groups/1cf1417983a647b3a7949bc7ad5c76e9 => generated 226 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 09:33:34.481055 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15e0017-a021-4333-a4d5-5621f591503e None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:33:34.519767 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6478cb08-3802-435e-adbd-aca04b9fa269 None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:33:34.529746 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:33:34.557361 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cb3461-0c7e-4d50-aa10-4076ceb644d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:33:34.557984 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cb3461-0c7e-4d50-aa10-4076ceb644d9 None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:33:34.558274 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cb3461-0c7e-4d50-aa10-4076ceb644d9 None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:33:34.558621 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cb3461-0c7e-4d50-aa10-4076ceb644d9 None admin] PATH_INFO: `/v3/groups/1cf1417983a647b3a7949bc7ad5c76e9` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:33:34.560607 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04cb3461-0c7e-4d50-aa10-4076ceb644d9 None admin] RBAC: Authorizing `identity:get_group(group_id=1cf1417983a647b3a7949bc7ad5c76e9)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:33:34.562838 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04cb3461-0c7e-4d50-aa10-4076ceb644d9 None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:33:34.565517 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 171/324] 10.222.0.65 () {56 vars in 1180 bytes} [Thu Oct 27 09:33:34 2022] GET /identity/v3/groups/1cf1417983a647b3a7949bc7ad5c76e9 => generated 226 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 09:33:34.565517 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cb3461-0c7e-4d50-aa10-4076ceb644d9 None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:33:34.592882 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15e0017-a021-4333-a4d5-5621f591503e None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:33:34.628831 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2978a9df-c688-4a17-bb97-bf1727df39d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:33:34.629428 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2978a9df-c688-4a17-bb97-bf1727df39d4 None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:33:34.629703 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2978a9df-c688-4a17-bb97-bf1727df39d4 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:33:34.629973 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2978a9df-c688-4a17-bb97-bf1727df39d4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:33:34.672021 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cb3461-0c7e-4d50-aa10-4076ceb644d9 None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:33:34.700048 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2978a9df-c688-4a17-bb97-bf1727df39d4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:33:34.701582 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2978a9df-c688-4a17-bb97-bf1727df39d4 None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:33:34.706796 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a484aa-bfe6-4a81-bb5f-cf806e7f25d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:33:34.707404 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a484aa-bfe6-4a81-bb5f-cf806e7f25d4 None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:33:34.707745 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a484aa-bfe6-4a81-bb5f-cf806e7f25d4 None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:33:34.708029 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a484aa-bfe6-4a81-bb5f-cf806e7f25d4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:33:34.708766 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a484aa-bfe6-4a81-bb5f-cf806e7f25d4 None admin] RBAC: Adding query filter params (group.id=1cf1417983a647b3a7949bc7ad5c76e9, role.id=43543ce1450245af9661cb017bac17bd, scope.project.id=b86df928a9974a6993ae75bd68b27098) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 09:33:34.709069 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a484aa-bfe6-4a81-bb5f-cf806e7f25d4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:33:34.710491 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a484aa-bfe6-4a81-bb5f-cf806e7f25d4 None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:33:34.712260 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:33:34.717831 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 172/325] 10.222.0.65 () {56 vars in 1376 bytes} [Thu Oct 27 09:33:34 2022] GET /identity/v3/role_assignments?group.id=1cf1417983a647b3a7949bc7ad5c76e9&scope.project.id=b86df928a9974a6993ae75bd68b27098&role.id=43543ce1450245af9661cb017bac17bd => generated 611 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 09:33:34.729938 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a484aa-bfe6-4a81-bb5f-cf806e7f25d4 None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:33:34.749406 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:33:34.818116 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 154/326] 10.222.0.65 () {58 vars in 1282 bytes} [Thu Oct 27 09:33:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 27 09:33:34.819318 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2978a9df-c688-4a17-bb97-bf1727df39d4 None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:33:34.867383 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a484aa-bfe6-4a81-bb5f-cf806e7f25d4 None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:33:34.921997 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda0a8d9-f251-49f6-80cc-8176e74f4a27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:33:34.922675 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda0a8d9-f251-49f6-80cc-8176e74f4a27 None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:33:34.923298 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda0a8d9-f251-49f6-80cc-8176e74f4a27 None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:33:34.923475 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda0a8d9-f251-49f6-80cc-8176e74f4a27 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:33:34.924176 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda0a8d9-f251-49f6-80cc-8176e74f4a27 None admin] RBAC: Adding query filter params (group.id=1cf1417983a647b3a7949bc7ad5c76e9, role.id=43543ce1450245af9661cb017bac17bd, scope.project.id=a2e51b2800f14e7fa67e9bed4cc6498b) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 09:33:34.924484 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda0a8d9-f251-49f6-80cc-8176e74f4a27 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:33:34.925908 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda0a8d9-f251-49f6-80cc-8176e74f4a27 None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:33:34.934239 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 173/327] 10.222.0.65 () {56 vars in 1376 bytes} [Thu Oct 27 09:33:34 2022] GET /identity/v3/role_assignments?group.id=1cf1417983a647b3a7949bc7ad5c76e9&scope.project.id=a2e51b2800f14e7fa67e9bed4cc6498b&role.id=43543ce1450245af9661cb017bac17bd => generated 611 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 09:33:34.936758 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda0a8d9-f251-49f6-80cc-8176e74f4a27 None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:33:34.945713 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2978a9df-c688-4a17-bb97-bf1727df39d4 None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:33:34.990748 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd47646-5258-4579-a420-6b2d86370d09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:33:34.991700 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd47646-5258-4579-a420-6b2d86370d09 None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:33:34.992188 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd47646-5258-4579-a420-6b2d86370d09 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:33:34.992659 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd47646-5258-4579-a420-6b2d86370d09 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:33:35.007082 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd47646-5258-4579-a420-6b2d86370d09 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 09:33:35.012349 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application [None req-bbd47646-5258-4579-a420-6b2d86370d09 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 27 09:33:35.012349 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 09:33:35.012349 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 09:33:35.012349 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 09:33:35.012349 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 09:33:35.012349 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 09:33:35.012349 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 09:33:35.012349 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 09:33:35.012349 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 09:33:35.012349 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 09:33:35.012349 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 09:33:35.012349 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 09:33:35.012349 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 27 09:33:35.012349 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 27 09:33:35.012349 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 27 09:33:35.012349 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 27 09:33:35.013294 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 27 09:33:35.013294 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 27 09:33:35.013294 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 27 09:33:35.013294 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 27 09:33:35.013294 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 09:33:35.013294 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 09:33:35.013294 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 09:33:35.013294 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 09:33:35.013294 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 09:33:35.013294 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 09:33:35.013294 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 09:33:35.013294 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application with Lock( Oct 27 09:33:35.013294 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 09:33:35.013294 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._enter() Oct 27 09:33:35.013294 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 09:33:35.013294 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 09:33:35.014082 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 09:33:35.014082 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.creator() Oct 27 09:33:35.014082 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 09:33:35.014082 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application created_value = creator( Oct 27 09:33:35.014082 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 27 09:33:35.014082 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 27 09:33:35.014082 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 27 09:33:35.014082 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 27 09:33:35.014082 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 27 09:33:35.014082 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 27 09:33:35.014082 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 27 09:33:35.014082 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application Oct 27 09:33:35.014082 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 155/328] 10.222.0.65 () {56 vars in 1096 bytes} [Thu Oct 27 09:33:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 09:33:35.019737 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd47646-5258-4579-a420-6b2d86370d09 None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:33:35.024025 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:33:35.028522 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:33:35.072610 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda0a8d9-f251-49f6-80cc-8176e74f4a27 None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:33:35.109788 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074e05ac-f853-405d-ad3b-c326512c32ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:33:35.110493 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074e05ac-f853-405d-ad3b-c326512c32ca None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:33:35.110807 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074e05ac-f853-405d-ad3b-c326512c32ca None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:33:35.111087 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074e05ac-f853-405d-ad3b-c326512c32ca None admin] PATH_INFO: `/v3/projects/b86df928a9974a6993ae75bd68b27098` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:33:35.112283 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074e05ac-f853-405d-ad3b-c326512c32ca None admin] RBAC: Authorizing `identity:get_project(project_id=b86df928a9974a6993ae75bd68b27098)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:33:35.113769 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074e05ac-f853-405d-ad3b-c326512c32ca None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:33:35.118825 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 174/329] 10.222.0.65 () {56 vars in 1186 bytes} [Thu Oct 27 09:33:34 2022] GET /identity/v3/projects/b86df928a9974a6993ae75bd68b27098 => generated 302 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 09:33:35.121528 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074e05ac-f853-405d-ad3b-c326512c32ca None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:33:35.141946 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd47646-5258-4579-a420-6b2d86370d09 None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:33:35.183487 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d9edd9-2c10-4536-b006-cd1f38d56f43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:33:35.184198 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d9edd9-2c10-4536-b006-cd1f38d56f43 None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:33:35.185172 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d9edd9-2c10-4536-b006-cd1f38d56f43 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:33:35.185471 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d9edd9-2c10-4536-b006-cd1f38d56f43 None admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:33:35.186333 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d9edd9-2c10-4536-b006-cd1f38d56f43 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 09:33:35.189013 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d9edd9-2c10-4536-b006-cd1f38d56f43 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:33:35.189013 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d9edd9-2c10-4536-b006-cd1f38d56f43 None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:33:35.196812 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 156/330] 10.222.0.65 () {56 vars in 1099 bytes} [Thu Oct 27 09:33:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 09:33:35.202817 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d9edd9-2c10-4536-b006-cd1f38d56f43 None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:33:35.255562 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074e05ac-f853-405d-ad3b-c326512c32ca None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:33:35.283816 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:33:35.289144 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:33:35.299628 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a46409-b3c2-49fb-b3c5-5756b5424d69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:33:35.300272 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a46409-b3c2-49fb-b3c5-5756b5424d69 None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:33:35.300554 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a46409-b3c2-49fb-b3c5-5756b5424d69 None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:33:35.300827 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a46409-b3c2-49fb-b3c5-5756b5424d69 None admin] PATH_INFO: `/v3/groups/1cf1417983a647b3a7949bc7ad5c76e9` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:33:35.301949 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a46409-b3c2-49fb-b3c5-5756b5424d69 None admin] RBAC: Authorizing `identity:get_group(group_id=1cf1417983a647b3a7949bc7ad5c76e9)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:33:35.303495 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a46409-b3c2-49fb-b3c5-5756b5424d69 None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:33:35.305253 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 175/331] 10.222.0.65 () {56 vars in 1180 bytes} [Thu Oct 27 09:33:35 2022] GET /identity/v3/groups/1cf1417983a647b3a7949bc7ad5c76e9 => generated 226 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 09:33:35.311316 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a46409-b3c2-49fb-b3c5-5756b5424d69 None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:33:35.331430 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d9edd9-2c10-4536-b006-cd1f38d56f43 None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:33:35.377743 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc25ae1-3ffa-4aab-ad70-d85187f4c532 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:33:35.378366 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc25ae1-3ffa-4aab-ad70-d85187f4c532 None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:33:35.378706 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc25ae1-3ffa-4aab-ad70-d85187f4c532 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:33:35.378988 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc25ae1-3ffa-4aab-ad70-d85187f4c532 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:33:35.444053 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a46409-b3c2-49fb-b3c5-5756b5424d69 None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:33:35.459370 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc25ae1-3ffa-4aab-ad70-d85187f4c532 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:33:35.460789 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc25ae1-3ffa-4aab-ad70-d85187f4c532 None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:33:35.490080 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6c0ce5-7ca1-4d25-b43e-3a050514c50a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:33:35.490983 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6c0ce5-7ca1-4d25-b43e-3a050514c50a None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:33:35.491287 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6c0ce5-7ca1-4d25-b43e-3a050514c50a None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:33:35.491846 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6c0ce5-7ca1-4d25-b43e-3a050514c50a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:33:35.492289 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6c0ce5-7ca1-4d25-b43e-3a050514c50a None admin] RBAC: Adding query filter params (group.id=1cf1417983a647b3a7949bc7ad5c76e9, role.id=438ff415f4f644afb2cc60293cc13741, scope.project.id=b86df928a9974a6993ae75bd68b27098) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 09:33:35.492603 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6c0ce5-7ca1-4d25-b43e-3a050514c50a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:33:35.494071 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6c0ce5-7ca1-4d25-b43e-3a050514c50a None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:33:35.503165 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 176/332] 10.222.0.65 () {56 vars in 1376 bytes} [Thu Oct 27 09:33:35 2022] GET /identity/v3/role_assignments?group.id=1cf1417983a647b3a7949bc7ad5c76e9&scope.project.id=b86df928a9974a6993ae75bd68b27098&role.id=438ff415f4f644afb2cc60293cc13741 => generated 611 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 09:33:35.539389 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:33:35.590781 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 157/333] 10.222.0.65 () {58 vars in 1282 bytes} [Thu Oct 27 09:33:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Oct 27 09:33:35.597350 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6c0ce5-7ca1-4d25-b43e-3a050514c50a None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:33:35.672114 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:33:35.716418 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6c0ce5-7ca1-4d25-b43e-3a050514c50a None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:33:35.754912 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3062a89b-e89b-4f1d-9164-9d5ca37c0e18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:33:35.755539 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3062a89b-e89b-4f1d-9164-9d5ca37c0e18 None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:33:35.755818 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3062a89b-e89b-4f1d-9164-9d5ca37c0e18 None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:33:35.756088 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3062a89b-e89b-4f1d-9164-9d5ca37c0e18 None admin] PATH_INFO: `/v3/projects/9c03247ba584473d97a93650c876aafd` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:33:35.757190 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3062a89b-e89b-4f1d-9164-9d5ca37c0e18 None admin] RBAC: Authorizing `identity:get_project(project_id=9c03247ba584473d97a93650c876aafd)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:33:35.758697 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3062a89b-e89b-4f1d-9164-9d5ca37c0e18 None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:33:35.760308 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 177/334] 10.222.0.65 () {56 vars in 1186 bytes} [Thu Oct 27 09:33:35 2022] GET /identity/v3/projects/9c03247ba584473d97a93650c876aafd => generated 344 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 09:33:35.766766 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc25ae1-3ffa-4aab-ad70-d85187f4c532 None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:33:35.875449 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc25ae1-3ffa-4aab-ad70-d85187f4c532 None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:33:35.910929 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0be8043-990f-4d3b-8260-34760d6f9270 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:33:35.911558 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0be8043-990f-4d3b-8260-34760d6f9270 None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:33:35.911844 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0be8043-990f-4d3b-8260-34760d6f9270 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:33:35.912122 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0be8043-990f-4d3b-8260-34760d6f9270 None admin] PATH_INFO: `/v3/groups/8a2e5532083a4811855d4bea5982a599` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:33:35.913235 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0be8043-990f-4d3b-8260-34760d6f9270 None admin] RBAC: Authorizing `identity:get_group(group_id=8a2e5532083a4811855d4bea5982a599)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:33:35.914737 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0be8043-990f-4d3b-8260-34760d6f9270 None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:33:35.916318 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 158/335] 10.222.0.65 () {56 vars in 1180 bytes} [Thu Oct 27 09:33:35 2022] GET /identity/v3/groups/8a2e5532083a4811855d4bea5982a599 => generated 229 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 09:33:35.922870 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3062a89b-e89b-4f1d-9164-9d5ca37c0e18 None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:33:36.019464 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3062a89b-e89b-4f1d-9164-9d5ca37c0e18 None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:33:36.047901 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:33:36.053187 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34003efe-861c-4fd0-beba-95da812a17ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:33:36.053791 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34003efe-861c-4fd0-beba-95da812a17ba None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:33:36.054078 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34003efe-861c-4fd0-beba-95da812a17ba None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:33:36.054356 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34003efe-861c-4fd0-beba-95da812a17ba None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:33:36.055107 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34003efe-861c-4fd0-beba-95da812a17ba None admin] RBAC: Adding query filter params (group.id=8a2e5532083a4811855d4bea5982a599, role.id=6ad17b9f9dea4b66ab2da3677d7e715d, scope.project.id=9c03247ba584473d97a93650c876aafd) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 09:33:36.055423 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34003efe-861c-4fd0-beba-95da812a17ba None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:33:36.056847 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34003efe-861c-4fd0-beba-95da812a17ba None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:33:36.062615 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 178/336] 10.222.0.65 () {56 vars in 1376 bytes} [Thu Oct 27 09:33:35 2022] GET /identity/v3/role_assignments?group.id=8a2e5532083a4811855d4bea5982a599&scope.project.id=9c03247ba584473d97a93650c876aafd&role.id=6ad17b9f9dea4b66ab2da3677d7e715d => generated 611 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 09:33:38.619499 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88756f8-01c2-4ec1-9028-473222603782 None None] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:33:38.620066 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88756f8-01c2-4ec1-9028-473222603782 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:33:38.620066 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88756f8-01c2-4ec1-9028-473222603782 None None] PATH_INFO: `/` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:33:38.622253 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 159/337] 10.222.0.65 () {54 vars in 927 bytes} [Thu Oct 27 09:33:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 09:33:38.628148 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e352d9-4762-4b09-83ab-f5fc7e892b8b None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:33:38.631408 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e352d9-4762-4b09-83ab-f5fc7e892b8b None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:33:38.631408 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e352d9-4762-4b09-83ab-f5fc7e892b8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:33:38.655681 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-b1e352d9-4762-4b09-83ab-f5fc7e892b8b None None] MFA Rules not processed for user `b5065084bf664b99bdeac46067cb0f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:33:38.656950 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-b1e352d9-4762-4b09-83ab-f5fc7e892b8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:33:38.746202 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 179/338] 10.222.0.65 () {58 vars in 1024 bytes} [Thu Oct 27 09:33:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 27 09:33:38.798444 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f39c225-b744-4452-a30b-ea3152d45bbb None None] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:33:38.798766 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f39c225-b744-4452-a30b-ea3152d45bbb None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:33:38.799026 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f39c225-b744-4452-a30b-ea3152d45bbb None None] PATH_INFO: `/` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:33:38.800526 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 160/339] 10.222.0.65 () {54 vars in 927 bytes} [Thu Oct 27 09:33:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 09:33:38.815230 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d56b05-e88f-4e1a-893a-c3b262dcc4c4 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:33:38.815519 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d56b05-e88f-4e1a-893a-c3b262dcc4c4 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:33:38.815782 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d56b05-e88f-4e1a-893a-c3b262dcc4c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:33:38.843459 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-81d56b05-e88f-4e1a-893a-c3b262dcc4c4 None None] MFA Rules not processed for user `b5065084bf664b99bdeac46067cb0f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:33:38.844408 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-81d56b05-e88f-4e1a-893a-c3b262dcc4c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:33:38.948306 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 180/340] 10.222.0.65 () {58 vars in 1024 bytes} [Thu Oct 27 09:33:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 27 09:33:39.075091 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f39c225-b744-4452-a30b-ea3152d45bbb None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:33:39.084646 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9ce322-107a-4a6c-b9a9-824b35ff8360 None None] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:33:39.084926 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9ce322-107a-4a6c-b9a9-824b35ff8360 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:33:39.085198 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9ce322-107a-4a6c-b9a9-824b35ff8360 None None] PATH_INFO: `/` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:33:39.086911 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 181/341] 10.222.0.65 () {54 vars in 927 bytes} [Thu Oct 27 09:33:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 09:33:39.093026 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f615608-600c-44c8-9a7e-1a6b22a23683 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:33:39.093309 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f615608-600c-44c8-9a7e-1a6b22a23683 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:33:39.093583 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f615608-600c-44c8-9a7e-1a6b22a23683 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:33:39.118675 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-9f615608-600c-44c8-9a7e-1a6b22a23683 None None] MFA Rules not processed for user `b5065084bf664b99bdeac46067cb0f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:33:39.121370 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-9f615608-600c-44c8-9a7e-1a6b22a23683 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:33:39.129635 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:33:39.234882 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:33:39.238645 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 182/342] 10.222.0.65 () {58 vars in 1024 bytes} [Thu Oct 27 09:33:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 27 09:33:39.267151 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f39c225-b744-4452-a30b-ea3152d45bbb None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:33:39.314108 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af3035e-9afd-4795-b9a0-9648a8e7c0e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:33:39.314863 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af3035e-9afd-4795-b9a0-9648a8e7c0e9 None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:33:39.315145 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af3035e-9afd-4795-b9a0-9648a8e7c0e9 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:33:39.315478 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af3035e-9afd-4795-b9a0-9648a8e7c0e9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:33:39.334963 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af3035e-9afd-4795-b9a0-9648a8e7c0e9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:33:39.336450 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af3035e-9afd-4795-b9a0-9648a8e7c0e9 None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:33:39.355347 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f615608-600c-44c8-9a7e-1a6b22a23683 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:33:39.361477 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application [None req-9af3035e-9afd-4795-b9a0-9648a8e7c0e9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 09:33:39.361477 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 09:33:39.361477 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 09:33:39.361477 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 09:33:39.361477 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 09:33:39.361477 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 09:33:39.361477 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 09:33:39.361477 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 09:33:39.361477 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 09:33:39.361477 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 09:33:39.361477 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 09:33:39.361477 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 09:33:39.361477 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 27 09:33:39.361477 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 27 09:33:39.361477 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 27 09:33:39.361477 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 27 09:33:39.362652 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 09:33:39.362652 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 09:33:39.362652 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 09:33:39.362652 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 09:33:39.362652 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 09:33:39.362652 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 09:33:39.362652 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 09:33:39.362652 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application with Lock( Oct 27 09:33:39.362652 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 09:33:39.362652 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._enter() Oct 27 09:33:39.362652 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 09:33:39.362652 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 09:33:39.362652 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 09:33:39.362652 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.creator() Oct 27 09:33:39.362652 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 09:33:39.362652 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application created_value = creator( Oct 27 09:33:39.362652 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 27 09:33:39.363563 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 27 09:33:39.363563 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 09:33:39.363563 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application Oct 27 09:33:39.363563 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 161/343] 10.222.0.65 () {56 vars in 1108 bytes} [Thu Oct 27 09:33:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 288 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 09:33:39.369070 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af3035e-9afd-4795-b9a0-9648a8e7c0e9 None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:33:39.530333 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f615608-600c-44c8-9a7e-1a6b22a23683 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:33:39.566037 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:33:39.599389 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af3035e-9afd-4795-b9a0-9648a8e7c0e9 None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:33:39.602279 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb6ef6d-44b1-4189-92d9-68964cb0c564 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:33:39.602946 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb6ef6d-44b1-4189-92d9-68964cb0c564 None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:33:39.603225 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb6ef6d-44b1-4189-92d9-68964cb0c564 None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:33:39.603495 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb6ef6d-44b1-4189-92d9-68964cb0c564 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:33:39.623962 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb6ef6d-44b1-4189-92d9-68964cb0c564 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:33:39.625432 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb6ef6d-44b1-4189-92d9-68964cb0c564 None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:33:39.642833 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application [None req-afb6ef6d-44b1-4189-92d9-68964cb0c564 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 09:33:39.642833 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 09:33:39.642833 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 09:33:39.642833 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 09:33:39.642833 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 09:33:39.642833 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 09:33:39.642833 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 09:33:39.642833 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 09:33:39.642833 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 09:33:39.642833 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 09:33:39.642833 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 09:33:39.642833 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 09:33:39.642833 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 27 09:33:39.642833 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 27 09:33:39.642833 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 27 09:33:39.642833 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 27 09:33:39.644227 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 09:33:39.644227 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 09:33:39.644227 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 09:33:39.644227 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 09:33:39.644227 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 09:33:39.644227 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 09:33:39.644227 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 09:33:39.644227 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application with Lock( Oct 27 09:33:39.644227 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 09:33:39.644227 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._enter() Oct 27 09:33:39.644227 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 09:33:39.644227 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 09:33:39.644227 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 09:33:39.644227 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.creator() Oct 27 09:33:39.644227 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 09:33:39.644227 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application created_value = creator( Oct 27 09:33:39.644227 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 27 09:33:39.645082 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 27 09:33:39.645082 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 09:33:39.645082 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application Oct 27 09:33:39.645082 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 183/344] 10.222.0.65 () {56 vars in 1108 bytes} [Thu Oct 27 09:33:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 289 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 27 09:33:39.645302 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb6ef6d-44b1-4189-92d9-68964cb0c564 None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:33:39.666055 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e15de02-772a-483f-9d3b-1eeb349f7cff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:33:39.666755 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e15de02-772a-483f-9d3b-1eeb349f7cff None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:33:39.667105 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e15de02-772a-483f-9d3b-1eeb349f7cff None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:33:39.667388 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e15de02-772a-483f-9d3b-1eeb349f7cff None admin] PATH_INFO: `/v3/domains` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:33:39.668057 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e15de02-772a-483f-9d3b-1eeb349f7cff None admin] RBAC: Adding query filter params (name=Default) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 09:33:39.668904 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e15de02-772a-483f-9d3b-1eeb349f7cff None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:33:39.670561 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e15de02-772a-483f-9d3b-1eeb349f7cff None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:33:39.685443 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:33:39.686417 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 162/345] 10.222.0.65 () {56 vars in 1109 bytes} [Thu Oct 27 09:33:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 09:33:39.687451 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e15de02-772a-483f-9d3b-1eeb349f7cff None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:33:39.758468 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb6ef6d-44b1-4189-92d9-68964cb0c564 None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:33:39.794076 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d8e62c-f339-4880-80f4-cf5d3a8ac1fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:33:39.794759 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d8e62c-f339-4880-80f4-cf5d3a8ac1fe None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:33:39.794962 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d8e62c-f339-4880-80f4-cf5d3a8ac1fe None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:33:39.795206 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d8e62c-f339-4880-80f4-cf5d3a8ac1fe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:33:39.797549 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e15de02-772a-483f-9d3b-1eeb349f7cff None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:33:39.805803 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d8e62c-f339-4880-80f4-cf5d3a8ac1fe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:33:39.807299 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d8e62c-f339-4880-80f4-cf5d3a8ac1fe None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:33:39.822646 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application [None req-a5d8e62c-f339-4880-80f4-cf5d3a8ac1fe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 09:33:39.822646 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 09:33:39.822646 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 09:33:39.822646 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 09:33:39.822646 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 09:33:39.822646 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 09:33:39.822646 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 09:33:39.822646 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 09:33:39.822646 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 09:33:39.822646 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 09:33:39.822646 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 09:33:39.822646 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 09:33:39.822646 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 27 09:33:39.822646 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 27 09:33:39.822646 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 27 09:33:39.822646 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 27 09:33:39.823561 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 09:33:39.823561 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 09:33:39.823561 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 09:33:39.823561 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 09:33:39.823561 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 09:33:39.823561 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 09:33:39.823561 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 09:33:39.823561 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application with Lock( Oct 27 09:33:39.823561 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 09:33:39.823561 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._enter() Oct 27 09:33:39.823561 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 09:33:39.823561 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 09:33:39.823561 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 09:33:39.823561 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.creator() Oct 27 09:33:39.823561 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 09:33:39.823561 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application created_value = creator( Oct 27 09:33:39.823561 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 27 09:33:39.825108 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 27 09:33:39.825108 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 09:33:39.825108 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application Oct 27 09:33:39.825108 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 184/346] 10.222.0.65 () {56 vars in 1108 bytes} [Thu Oct 27 09:33:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 09:33:39.825108 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d8e62c-f339-4880-80f4-cf5d3a8ac1fe None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:33:39.838957 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f378cef-11fe-465a-b23d-2daea5023856 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:33:39.839406 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f378cef-11fe-465a-b23d-2daea5023856 None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:33:39.839689 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f378cef-11fe-465a-b23d-2daea5023856 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:33:39.839968 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f378cef-11fe-465a-b23d-2daea5023856 None admin] PATH_INFO: `/v3/domains` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:33:39.843509 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f378cef-11fe-465a-b23d-2daea5023856 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 09:33:39.843509 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f378cef-11fe-465a-b23d-2daea5023856 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:33:39.843509 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f378cef-11fe-465a-b23d-2daea5023856 None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:33:39.862817 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 163/347] 10.222.0.65 () {56 vars in 1109 bytes} [Thu Oct 27 09:33:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 09:33:39.862817 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcf5de2-2c35-4bcb-94df-edb497ea8f57 None None] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:33:39.862817 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcf5de2-2c35-4bcb-94df-edb497ea8f57 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:33:39.862817 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcf5de2-2c35-4bcb-94df-edb497ea8f57 None None] PATH_INFO: `/` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:33:39.862817 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 164/348] 10.222.0.65 () {54 vars in 927 bytes} [Thu Oct 27 09:33:39 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 09:33:39.862817 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcf5de2-2c35-4bcb-94df-edb497ea8f57 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:33:39.868098 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:33:39.930999 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:33:39.944438 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d8e62c-f339-4880-80f4-cf5d3a8ac1fe None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:33:39.970075 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcf5de2-2c35-4bcb-94df-edb497ea8f57 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:33:39.979315 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7c4342-e8fd-498f-8260-669e09767469 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:33:39.979932 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7c4342-e8fd-498f-8260-669e09767469 None admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:33:39.980209 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7c4342-e8fd-498f-8260-669e09767469 None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:33:39.980478 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7c4342-e8fd-498f-8260-669e09767469 None admin] PATH_INFO: `/v3/users` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:33:39.981683 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7c4342-e8fd-498f-8260-669e09767469 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:33:39.983166 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7c4342-e8fd-498f-8260-669e09767469 None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:33:40.006632 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136a4399-41ff-4d85-b9a0-9613dd1738b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:33:40.010142 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136a4399-41ff-4d85-b9a0-9613dd1738b1 None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:33:40.010142 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136a4399-41ff-4d85-b9a0-9613dd1738b1 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:33:40.010142 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136a4399-41ff-4d85-b9a0-9613dd1738b1 None admin] PATH_INFO: `/v3/domains` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:33:40.010142 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136a4399-41ff-4d85-b9a0-9613dd1738b1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 09:33:40.010142 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136a4399-41ff-4d85-b9a0-9613dd1738b1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:33:40.010142 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136a4399-41ff-4d85-b9a0-9613dd1738b1 None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:33:40.021665 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 165/349] 10.222.0.65 () {56 vars in 1109 bytes} [Thu Oct 27 09:33:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 09:33:40.022449 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136a4399-41ff-4d85-b9a0-9613dd1738b1 None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:33:40.092416 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:33:40.107423 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 185/350] 10.222.0.65 () {60 vars in 1132 bytes} [Thu Oct 27 09:33:39 2022] POST /identity/v3/users => generated 246 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 09:33:40.108893 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c93aba-bacd-4b9d-b187-af26bb78b3f9 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:33:40.109590 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c93aba-bacd-4b9d-b187-af26bb78b3f9 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:33:40.109827 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c93aba-bacd-4b9d-b187-af26bb78b3f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:33:40.130993 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-a0c93aba-bacd-4b9d-b187-af26bb78b3f9 None None] MFA Rules not processed for user `b5065084bf664b99bdeac46067cb0f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:33:40.132571 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-a0c93aba-bacd-4b9d-b187-af26bb78b3f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:33:40.145546 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136a4399-41ff-4d85-b9a0-9613dd1738b1 None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:33:40.188872 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea2f564-eaa5-4bc1-a832-c6f436b4fd7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:33:40.189901 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea2f564-eaa5-4bc1-a832-c6f436b4fd7c None admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:33:40.190405 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea2f564-eaa5-4bc1-a832-c6f436b4fd7c None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:33:40.190929 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea2f564-eaa5-4bc1-a832-c6f436b4fd7c None admin] PATH_INFO: `/v3/users` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:33:40.191796 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea2f564-eaa5-4bc1-a832-c6f436b4fd7c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:33:40.193508 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea2f564-eaa5-4bc1-a832-c6f436b4fd7c None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:33:40.229727 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 186/351] 10.222.0.65 () {58 vars in 1024 bytes} [Thu Oct 27 09:33:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 27 09:33:40.229727 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c93aba-bacd-4b9d-b187-af26bb78b3f9 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:33:40.296572 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 166/352] 10.222.0.65 () {60 vars in 1132 bytes} [Thu Oct 27 09:33:40 2022] POST /identity/v3/users => generated 248 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 09:33:40.330568 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:33:40.362221 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c93aba-bacd-4b9d-b187-af26bb78b3f9 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:33:40.408409 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b369c3b3-a298-477e-b577-7f8ee92c808a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:33:40.409333 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b369c3b3-a298-477e-b577-7f8ee92c808a None admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:33:40.409758 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b369c3b3-a298-477e-b577-7f8ee92c808a None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:33:40.410172 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b369c3b3-a298-477e-b577-7f8ee92c808a None admin] PATH_INFO: `/v3/users` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:33:40.411044 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b369c3b3-a298-477e-b577-7f8ee92c808a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:33:40.412770 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b369c3b3-a298-477e-b577-7f8ee92c808a None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:33:40.509849 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac13d78-82fc-4c4a-92bf-edb2b037d535 None None] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:33:40.510138 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac13d78-82fc-4c4a-92bf-edb2b037d535 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:33:40.510423 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac13d78-82fc-4c4a-92bf-edb2b037d535 None None] PATH_INFO: `/` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:33:40.512116 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 167/353] 10.222.0.65 () {54 vars in 927 bytes} [Thu Oct 27 09:33:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 27 09:33:40.517205 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d0bdb3-1682-4358-949b-651609564184 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:33:40.517512 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d0bdb3-1682-4358-949b-651609564184 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:33:40.517795 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d0bdb3-1682-4358-949b-651609564184 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:33:40.530004 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 187/354] 10.222.0.65 () {60 vars in 1132 bytes} [Thu Oct 27 09:33:40 2022] POST /identity/v3/users => generated 248 bytes in 304 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 09:33:40.530759 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b369c3b3-a298-477e-b577-7f8ee92c808a None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:33:40.544241 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-a5d0bdb3-1682-4358-949b-651609564184 None None] MFA Rules not processed for user `b5065084bf664b99bdeac46067cb0f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:33:40.545517 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-a5d0bdb3-1682-4358-949b-651609564184 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:33:40.652591 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 168/355] 10.222.0.65 () {58 vars in 1024 bytes} [Thu Oct 27 09:33:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 27 09:33:40.667826 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b369c3b3-a298-477e-b577-7f8ee92c808a None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:33:40.706999 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e7302f-68e6-4902-849e-21cc11447472 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:33:40.707651 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e7302f-68e6-4902-849e-21cc11447472 None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:33:40.707930 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e7302f-68e6-4902-849e-21cc11447472 None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:33:40.708203 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e7302f-68e6-4902-849e-21cc11447472 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:33:40.721215 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e7302f-68e6-4902-849e-21cc11447472 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:33:40.721699 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:33:40.724643 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e7302f-68e6-4902-849e-21cc11447472 None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:33:40.741286 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application [None req-49e7302f-68e6-4902-849e-21cc11447472 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 09:33:40.741286 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 09:33:40.741286 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 09:33:40.741286 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 09:33:40.741286 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 09:33:40.741286 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 09:33:40.741286 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 09:33:40.741286 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 09:33:40.741286 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 09:33:40.741286 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 09:33:40.741286 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 09:33:40.741286 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 09:33:40.741286 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 27 09:33:40.741286 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 27 09:33:40.741286 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 27 09:33:40.741286 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 27 09:33:40.742210 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 09:33:40.742210 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 09:33:40.742210 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 09:33:40.742210 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 09:33:40.742210 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 09:33:40.742210 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 09:33:40.742210 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 09:33:40.742210 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application with Lock( Oct 27 09:33:40.742210 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 09:33:40.742210 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._enter() Oct 27 09:33:40.742210 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 09:33:40.742210 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 09:33:40.742210 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 09:33:40.742210 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.creator() Oct 27 09:33:40.742210 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 09:33:40.742210 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application created_value = creator( Oct 27 09:33:40.742210 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 27 09:33:40.743089 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 27 09:33:40.743089 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 09:33:40.743089 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application Oct 27 09:33:40.743089 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 188/356] 10.222.0.65 () {56 vars in 1108 bytes} [Thu Oct 27 09:33:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 09:33:40.748864 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d0bdb3-1682-4358-949b-651609564184 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:33:40.803421 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:33:40.863962 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d0bdb3-1682-4358-949b-651609564184 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:33:40.909150 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c40428-a80e-4112-816c-ccc7efde9227 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:33:40.910105 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c40428-a80e-4112-816c-ccc7efde9227 None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:33:40.910641 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c40428-a80e-4112-816c-ccc7efde9227 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:33:40.911118 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c40428-a80e-4112-816c-ccc7efde9227 None admin] PATH_INFO: `/v3/domains` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:33:40.911978 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c40428-a80e-4112-816c-ccc7efde9227 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 09:33:40.912479 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c40428-a80e-4112-816c-ccc7efde9227 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:33:40.914061 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c40428-a80e-4112-816c-ccc7efde9227 None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:33:40.929823 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 169/357] 10.222.0.65 () {56 vars in 1109 bytes} [Thu Oct 27 09:33:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 09:33:40.935776 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e7302f-68e6-4902-849e-21cc11447472 None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:33:40.949245 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c40428-a80e-4112-816c-ccc7efde9227 None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:33:41.084113 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e7302f-68e6-4902-849e-21cc11447472 None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:33:41.106069 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c40428-a80e-4112-816c-ccc7efde9227 None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:33:41.121461 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:33:41.149178 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719bd8df-09cc-45e0-9b30-065869f5b81b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:33:41.149797 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719bd8df-09cc-45e0-9b30-065869f5b81b None admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:33:41.150075 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719bd8df-09cc-45e0-9b30-065869f5b81b None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:33:41.150347 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719bd8df-09cc-45e0-9b30-065869f5b81b None admin] PATH_INFO: `/v3/users` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:33:41.151031 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719bd8df-09cc-45e0-9b30-065869f5b81b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:33:41.152468 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719bd8df-09cc-45e0-9b30-065869f5b81b None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:33:41.171088 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89668a1-3e90-403a-82e3-5b0c0944aee2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:33:41.171611 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89668a1-3e90-403a-82e3-5b0c0944aee2 None admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:33:41.171891 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89668a1-3e90-403a-82e3-5b0c0944aee2 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:33:41.172162 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89668a1-3e90-403a-82e3-5b0c0944aee2 None admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:33:41.172836 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89668a1-3e90-403a-82e3-5b0c0944aee2 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:33:41.174201 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89668a1-3e90-403a-82e3-5b0c0944aee2 None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:33:41.224166 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.sql.core [None req-b89668a1-3e90-403a-82e3-5b0c0944aee2 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Oct 27 09:33:41.224166 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Oct 27 09:33:41.224166 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [parameters: {'id': 'a440df30bc664c6f917cb6471224a3c8', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Oct 27 09:33:41.224166 dv-cinder-797970-7-smb devstack@keystone.service[88312]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=88312) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 27 09:33:41.250747 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application [None req-b89668a1-3e90-403a-82e3-5b0c0944aee2 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Oct 27 09:33:41.250747 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 09:33:41.250747 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 27 09:33:41.250747 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 27 09:33:41.250747 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 27 09:33:41.250747 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 27 09:33:41.250747 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 27 09:33:41.250747 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application result = self._query(query) Oct 27 09:33:41.250747 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 27 09:33:41.250747 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application conn.query(q) Oct 27 09:33:41.250747 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 27 09:33:41.250747 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 27 09:33:41.250747 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 27 09:33:41.250747 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application result.read() Oct 27 09:33:41.250747 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 27 09:33:41.251647 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 27 09:33:41.251647 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 27 09:33:41.251647 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 27 09:33:41.251647 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 27 09:33:41.251647 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 27 09:33:41.251647 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 27 09:33:41.251647 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 27 09:33:41.251647 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Oct 27 09:33:41.251647 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application Oct 27 09:33:41.251647 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 27 09:33:41.251647 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application Oct 27 09:33:41.251647 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 09:33:41.251647 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 27 09:33:41.251647 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 27 09:33:41.251647 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Oct 27 09:33:41.251647 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return ref.to_dict() Oct 27 09:33:41.251647 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 27 09:33:41.251647 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application next(self.gen) Oct 27 09:33:41.252534 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1068, in _transaction_scope Oct 27 09:33:41.252534 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application yield resource Oct 27 09:33:41.252534 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 27 09:33:41.252534 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application next(self.gen) Oct 27 09:33:41.252534 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 670, in _session Oct 27 09:33:41.252534 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application self.session.rollback() Oct 27 09:33:41.252534 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 27 09:33:41.252534 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application self.force_reraise() Oct 27 09:33:41.252534 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 27 09:33:41.252534 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application raise self.value Oct 27 09:33:41.252534 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 667, in _session Oct 27 09:33:41.252534 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 27 09:33:41.252534 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 695, in _end_session_transaction Oct 27 09:33:41.252534 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application session.commit() Oct 27 09:33:41.252534 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 27 09:33:41.252534 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 27 09:33:41.252534 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 27 09:33:41.253394 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application self._prepare_impl() Oct 27 09:33:41.253394 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 27 09:33:41.253394 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application self.session.flush() Oct 27 09:33:41.253394 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 27 09:33:41.253394 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application self._flush(objects) Oct 27 09:33:41.253394 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 27 09:33:41.253394 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 27 09:33:41.253394 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 27 09:33:41.253394 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application compat.raise_( Oct 27 09:33:41.253394 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 27 09:33:41.253394 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application raise exception Oct 27 09:33:41.253394 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 27 09:33:41.253394 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application flush_context.execute() Oct 27 09:33:41.253394 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 27 09:33:41.253394 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application rec.execute(self) Oct 27 09:33:41.253394 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 27 09:33:41.253394 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 27 09:33:41.254320 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 27 09:33:41.254320 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 27 09:33:41.254320 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Oct 27 09:33:41.254320 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application c = connection._execute_20( Oct 27 09:33:41.254320 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 27 09:33:41.254320 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 27 09:33:41.254320 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 27 09:33:41.254320 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 27 09:33:41.254320 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 27 09:33:41.254320 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 27 09:33:41.254320 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 27 09:33:41.254320 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 27 09:33:41.254320 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 27 09:33:41.254320 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 27 09:33:41.254320 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 27 09:33:41.254320 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application raise exception Oct 27 09:33:41.256808 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 27 09:33:41.256808 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 27 09:33:41.256808 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 27 09:33:41.256808 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 27 09:33:41.256808 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 27 09:33:41.256808 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application result = self._query(query) Oct 27 09:33:41.256808 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 27 09:33:41.256808 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application conn.query(q) Oct 27 09:33:41.256808 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 27 09:33:41.256808 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 27 09:33:41.256808 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 27 09:33:41.256808 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application result.read() Oct 27 09:33:41.256808 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 27 09:33:41.256808 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 27 09:33:41.256808 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 27 09:33:41.256808 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 27 09:33:41.263555 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 27 09:33:41.263555 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 27 09:33:41.263555 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 27 09:33:41.263555 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 27 09:33:41.263555 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Oct 27 09:33:41.263555 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Oct 27 09:33:41.263555 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application [parameters: {'id': 'a440df30bc664c6f917cb6471224a3c8', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Oct 27 09:33:41.263555 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 27 09:33:41.263555 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application Oct 27 09:33:41.263555 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 27 09:33:41.263555 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application Oct 27 09:33:41.263555 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 09:33:41.263555 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 09:33:41.263555 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 09:33:41.263555 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 09:33:41.263555 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 09:33:41.265627 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 09:33:41.265627 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 09:33:41.265627 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 09:33:41.265627 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 09:33:41.265627 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 09:33:41.265627 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 09:33:41.265627 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Oct 27 09:33:41.265627 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Oct 27 09:33:41.265627 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 09:33:41.265627 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 09:33:41.265627 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Oct 27 09:33:41.265627 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Oct 27 09:33:41.265627 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 27 09:33:41.265627 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 27 09:33:41.265627 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Oct 27 09:33:41.265627 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application Oct 27 09:33:41.267657 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 189/358] 10.222.0.65 () {60 vars in 1132 bytes} [Thu Oct 27 09:33:40 2022] POST /identity/v3/users => generated 249 bytes in 316 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 09:33:41.267804 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 170/359] 10.222.0.65 () {60 vars in 1131 bytes} [Thu Oct 27 09:33:40 2022] POST /identity/v3/roles => generated 144 bytes in 304 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Oct 27 09:33:41.270604 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719bd8df-09cc-45e0-9b30-065869f5b81b None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:33:41.338934 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:33:41.429805 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719bd8df-09cc-45e0-9b30-065869f5b81b None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:33:41.479341 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024ef1ca-b297-44aa-b205-a09a646f1f97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:33:41.480084 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024ef1ca-b297-44aa-b205-a09a646f1f97 None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:33:41.480372 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024ef1ca-b297-44aa-b205-a09a646f1f97 None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:33:41.480701 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024ef1ca-b297-44aa-b205-a09a646f1f97 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:33:41.495313 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024ef1ca-b297-44aa-b205-a09a646f1f97 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 09:33:41.502312 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application [None req-024ef1ca-b297-44aa-b205-a09a646f1f97 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 27 09:33:41.502312 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 09:33:41.502312 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 09:33:41.502312 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 09:33:41.502312 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 09:33:41.502312 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 09:33:41.502312 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 09:33:41.502312 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 09:33:41.502312 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 09:33:41.502312 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 09:33:41.502312 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 09:33:41.502312 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 09:33:41.502312 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 27 09:33:41.502312 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 27 09:33:41.502312 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 27 09:33:41.502312 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 27 09:33:41.504500 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 27 09:33:41.504500 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 27 09:33:41.504500 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 27 09:33:41.504500 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 27 09:33:41.504500 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 09:33:41.504500 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 09:33:41.504500 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 09:33:41.504500 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 09:33:41.504500 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 09:33:41.504500 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 09:33:41.504500 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 09:33:41.504500 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application with Lock( Oct 27 09:33:41.504500 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 09:33:41.504500 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._enter() Oct 27 09:33:41.504500 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 09:33:41.504500 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 09:33:41.506436 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 09:33:41.506436 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.creator() Oct 27 09:33:41.506436 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 09:33:41.506436 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application created_value = creator( Oct 27 09:33:41.506436 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 27 09:33:41.506436 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 27 09:33:41.506436 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 27 09:33:41.506436 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 27 09:33:41.506436 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 27 09:33:41.506436 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 27 09:33:41.506436 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 27 09:33:41.506436 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application Oct 27 09:33:41.506436 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 190/360] 10.222.0.65 () {56 vars in 1114 bytes} [Thu Oct 27 09:33:41 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 09:33:41.515512 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89668a1-3e90-403a-82e3-5b0c0944aee2 None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:33:41.716757 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89668a1-3e90-403a-82e3-5b0c0944aee2 None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:33:41.764738 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32463a25-7581-444c-90f5-dd14e5de85fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:33:41.765514 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32463a25-7581-444c-90f5-dd14e5de85fb None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:33:41.765672 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32463a25-7581-444c-90f5-dd14e5de85fb None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:33:41.765910 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32463a25-7581-444c-90f5-dd14e5de85fb None admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:33:41.766612 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32463a25-7581-444c-90f5-dd14e5de85fb None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 09:33:41.766917 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32463a25-7581-444c-90f5-dd14e5de85fb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:33:41.768355 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32463a25-7581-444c-90f5-dd14e5de85fb None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:33:41.781579 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 171/361] 10.222.0.65 () {56 vars in 1111 bytes} [Thu Oct 27 09:33:41 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 09:33:42.844917 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9e6231-6256-454f-b767-45af140b08ea None None] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:33:42.844917 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9e6231-6256-454f-b767-45af140b08ea None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:33:42.844917 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9e6231-6256-454f-b767-45af140b08ea None None] PATH_INFO: `/` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:33:42.846764 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 191/362] 10.222.0.65 () {54 vars in 927 bytes} [Thu Oct 27 09:33:42 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 09:33:42.850241 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2bae74-32a9-45a2-a6d8-47c7daff0253 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:33:42.855735 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2bae74-32a9-45a2-a6d8-47c7daff0253 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:33:42.856060 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2bae74-32a9-45a2-a6d8-47c7daff0253 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:33:42.884094 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-9b2bae74-32a9-45a2-a6d8-47c7daff0253 None None] MFA Rules not processed for user `b5065084bf664b99bdeac46067cb0f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:33:42.885632 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-9b2bae74-32a9-45a2-a6d8-47c7daff0253 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:33:42.928299 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:33:42.981840 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 172/363] 10.222.0.65 () {58 vars in 1024 bytes} [Thu Oct 27 09:33:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 27 09:33:43.063450 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73ed621-2518-41a8-a293-e47b694b9357 None None] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:33:43.064239 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73ed621-2518-41a8-a293-e47b694b9357 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:33:43.064771 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73ed621-2518-41a8-a293-e47b694b9357 None None] PATH_INFO: `/` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:33:43.066605 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 192/364] 10.222.0.65 () {54 vars in 927 bytes} [Thu Oct 27 09:33:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 09:33:43.071795 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c022fc-e216-4692-b1f4-950c78c2714a None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:33:43.072081 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c022fc-e216-4692-b1f4-950c78c2714a None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:33:43.072359 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c022fc-e216-4692-b1f4-950c78c2714a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:33:43.095765 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-e3c022fc-e216-4692-b1f4-950c78c2714a None None] MFA Rules not processed for user `b5065084bf664b99bdeac46067cb0f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:33:43.096923 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-e3c022fc-e216-4692-b1f4-950c78c2714a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:33:43.188984 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 173/365] 10.222.0.65 () {58 vars in 1024 bytes} [Thu Oct 27 09:33:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 27 09:33:43.316889 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73ed621-2518-41a8-a293-e47b694b9357 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:33:43.427140 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:33:43.431717 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73ed621-2518-41a8-a293-e47b694b9357 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:33:43.487668 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124ccd6c-6d68-400f-b16f-775977309b6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:33:43.488314 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124ccd6c-6d68-400f-b16f-775977309b6f None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:33:43.488597 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124ccd6c-6d68-400f-b16f-775977309b6f None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:33:43.488872 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124ccd6c-6d68-400f-b16f-775977309b6f None admin] PATH_INFO: `/v3/roles/service` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:33:43.506225 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124ccd6c-6d68-400f-b16f-775977309b6f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 09:33:43.511153 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application [None req-124ccd6c-6d68-400f-b16f-775977309b6f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 27 09:33:43.511153 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 09:33:43.511153 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 09:33:43.511153 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 09:33:43.511153 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 09:33:43.511153 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 09:33:43.511153 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 09:33:43.511153 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 09:33:43.511153 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 09:33:43.511153 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 09:33:43.511153 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 09:33:43.511153 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 09:33:43.511153 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 27 09:33:43.511153 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 27 09:33:43.511153 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 27 09:33:43.511153 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 27 09:33:43.512702 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 27 09:33:43.512702 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 27 09:33:43.512702 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 27 09:33:43.512702 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 27 09:33:43.512702 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 09:33:43.512702 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 09:33:43.512702 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 09:33:43.512702 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 09:33:43.512702 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 09:33:43.512702 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 09:33:43.512702 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 09:33:43.512702 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application with Lock( Oct 27 09:33:43.512702 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 09:33:43.512702 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._enter() Oct 27 09:33:43.512702 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 09:33:43.512702 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 09:33:43.513974 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 09:33:43.513974 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.creator() Oct 27 09:33:43.513974 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 09:33:43.513974 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application created_value = creator( Oct 27 09:33:43.513974 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 27 09:33:43.513974 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 27 09:33:43.513974 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 27 09:33:43.513974 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 27 09:33:43.513974 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 27 09:33:43.513974 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 27 09:33:43.513974 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 27 09:33:43.513974 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application Oct 27 09:33:43.513974 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 193/366] 10.222.0.65 () {56 vars in 1102 bytes} [Thu Oct 27 09:33:43 2022] GET /identity/v3/roles/service => generated 85 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 09:33:43.518867 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c022fc-e216-4692-b1f4-950c78c2714a None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:33:43.614559 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b391bb67-1057-488c-94f3-1357617bd756 None None] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:33:43.615147 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b391bb67-1057-488c-94f3-1357617bd756 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:33:43.615617 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b391bb67-1057-488c-94f3-1357617bd756 None None] PATH_INFO: `/` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:33:43.617391 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 194/367] 10.222.0.65 () {54 vars in 927 bytes} [Thu Oct 27 09:33:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 27 09:33:43.624862 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4b792d-7a2e-44a1-a1ac-86eab6426bda None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:33:43.625503 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4b792d-7a2e-44a1-a1ac-86eab6426bda None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:33:43.625948 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4b792d-7a2e-44a1-a1ac-86eab6426bda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:33:43.650088 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-2e4b792d-7a2e-44a1-a1ac-86eab6426bda None None] MFA Rules not processed for user `b5065084bf664b99bdeac46067cb0f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:33:43.651382 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c022fc-e216-4692-b1f4-950c78c2714a None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:33:43.651811 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-2e4b792d-7a2e-44a1-a1ac-86eab6426bda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:33:43.654899 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:33:43.700728 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3361be5c-5f06-4acb-9cc4-15edb95e9920 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:33:43.702236 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3361be5c-5f06-4acb-9cc4-15edb95e9920 None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:33:43.702759 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3361be5c-5f06-4acb-9cc4-15edb95e9920 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:33:43.703237 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3361be5c-5f06-4acb-9cc4-15edb95e9920 None admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:33:43.704127 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3361be5c-5f06-4acb-9cc4-15edb95e9920 None admin] RBAC: Adding query filter params (name=service) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 09:33:43.705086 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3361be5c-5f06-4acb-9cc4-15edb95e9920 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:33:43.707449 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3361be5c-5f06-4acb-9cc4-15edb95e9920 None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:33:43.721181 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 174/368] 10.222.0.65 () {56 vars in 1103 bytes} [Thu Oct 27 09:33:43 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 09:33:43.722426 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3361be5c-5f06-4acb-9cc4-15edb95e9920 None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:33:43.737782 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 195/369] 10.222.0.65 () {58 vars in 1024 bytes} [Thu Oct 27 09:33:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 27 09:33:43.739088 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4b792d-7a2e-44a1-a1ac-86eab6426bda None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:33:43.908942 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:33:43.926018 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3361be5c-5f06-4acb-9cc4-15edb95e9920 None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:33:43.931655 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4b792d-7a2e-44a1-a1ac-86eab6426bda None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:33:43.998828 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea50299-bd56-4cc9-86be-1a633ce9d1a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:33:43.999410 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea50299-bd56-4cc9-86be-1a633ce9d1a0 None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:33:43.999695 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea50299-bd56-4cc9-86be-1a633ce9d1a0 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:33:43.999975 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea50299-bd56-4cc9-86be-1a633ce9d1a0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:33:44.001187 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d171bfaf-7c77-4d09-b7e2-8d7f8533c2c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:33:44.001835 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d171bfaf-7c77-4d09-b7e2-8d7f8533c2c3 None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:33:44.002113 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d171bfaf-7c77-4d09-b7e2-8d7f8533c2c3 None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:33:44.002383 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d171bfaf-7c77-4d09-b7e2-8d7f8533c2c3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:33:44.022427 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea50299-bd56-4cc9-86be-1a633ce9d1a0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 09:33:44.025881 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d171bfaf-7c77-4d09-b7e2-8d7f8533c2c3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:33:44.027430 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d171bfaf-7c77-4d09-b7e2-8d7f8533c2c3 None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:33:44.031510 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application [None req-4ea50299-bd56-4cc9-86be-1a633ce9d1a0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 27 09:33:44.031510 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 09:33:44.031510 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 09:33:44.031510 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 09:33:44.031510 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 09:33:44.031510 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 09:33:44.031510 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 09:33:44.031510 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 09:33:44.031510 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 09:33:44.031510 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 09:33:44.031510 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 09:33:44.031510 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 09:33:44.031510 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 27 09:33:44.031510 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 27 09:33:44.031510 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 27 09:33:44.031510 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 27 09:33:44.032383 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 27 09:33:44.032383 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 27 09:33:44.032383 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 27 09:33:44.032383 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 27 09:33:44.032383 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 09:33:44.032383 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 09:33:44.032383 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 09:33:44.032383 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 09:33:44.032383 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 09:33:44.032383 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 09:33:44.032383 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 09:33:44.032383 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application with Lock( Oct 27 09:33:44.032383 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 09:33:44.032383 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._enter() Oct 27 09:33:44.032383 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 09:33:44.032383 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 09:33:44.033384 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 09:33:44.033384 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.creator() Oct 27 09:33:44.033384 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 09:33:44.033384 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application created_value = creator( Oct 27 09:33:44.033384 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 27 09:33:44.033384 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 27 09:33:44.033384 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 27 09:33:44.033384 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 27 09:33:44.033384 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 27 09:33:44.033384 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 27 09:33:44.033384 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 27 09:33:44.033384 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application Oct 27 09:33:44.033384 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 175/370] 10.222.0.65 () {56 vars in 1102 bytes} [Thu Oct 27 09:33:43 2022] GET /identity/v3/roles/service => generated 85 bytes in 311 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 09:33:44.038409 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea50299-bd56-4cc9-86be-1a633ce9d1a0 None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:33:44.055963 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application [None req-d171bfaf-7c77-4d09-b7e2-8d7f8533c2c3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 09:33:44.055963 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 09:33:44.055963 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 09:33:44.055963 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 09:33:44.055963 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 09:33:44.055963 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 09:33:44.055963 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 09:33:44.055963 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 09:33:44.055963 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 09:33:44.055963 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 09:33:44.055963 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 09:33:44.055963 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 09:33:44.055963 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 27 09:33:44.055963 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 27 09:33:44.055963 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 27 09:33:44.055963 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 27 09:33:44.057203 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 09:33:44.057203 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 09:33:44.057203 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 09:33:44.057203 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 09:33:44.057203 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 09:33:44.057203 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 09:33:44.057203 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 09:33:44.057203 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application with Lock( Oct 27 09:33:44.057203 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 09:33:44.057203 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._enter() Oct 27 09:33:44.057203 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 09:33:44.057203 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 09:33:44.057203 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 09:33:44.057203 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.creator() Oct 27 09:33:44.057203 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 09:33:44.057203 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application created_value = creator( Oct 27 09:33:44.057203 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 27 09:33:44.058007 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 27 09:33:44.058007 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 09:33:44.058007 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application Oct 27 09:33:44.058007 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 196/371] 10.222.0.65 () {56 vars in 1108 bytes} [Thu Oct 27 09:33:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 317 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 09:33:44.061152 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d171bfaf-7c77-4d09-b7e2-8d7f8533c2c3 None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:33:44.086895 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:33:44.188413 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea50299-bd56-4cc9-86be-1a633ce9d1a0 None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:33:44.202893 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d171bfaf-7c77-4d09-b7e2-8d7f8533c2c3 None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:33:44.233276 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd58da2b-880c-409c-a5f4-c7d800aa4bfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:33:44.234169 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd58da2b-880c-409c-a5f4-c7d800aa4bfa None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:33:44.234643 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd58da2b-880c-409c-a5f4-c7d800aa4bfa None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:33:44.234924 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd58da2b-880c-409c-a5f4-c7d800aa4bfa None admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:33:44.235601 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd58da2b-880c-409c-a5f4-c7d800aa4bfa None admin] RBAC: Adding query filter params (name=service) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 09:33:44.235908 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd58da2b-880c-409c-a5f4-c7d800aa4bfa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:33:44.237320 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd58da2b-880c-409c-a5f4-c7d800aa4bfa None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:33:44.239294 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0717bd-e1bd-4e86-b8a8-3563b9079776 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:33:44.240172 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0717bd-e1bd-4e86-b8a8-3563b9079776 None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:33:44.240462 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0717bd-e1bd-4e86-b8a8-3563b9079776 None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:33:44.240740 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0717bd-e1bd-4e86-b8a8-3563b9079776 None admin] PATH_INFO: `/v3/domains` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:33:44.241388 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0717bd-e1bd-4e86-b8a8-3563b9079776 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 09:33:44.241692 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0717bd-e1bd-4e86-b8a8-3563b9079776 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:33:44.243140 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0717bd-e1bd-4e86-b8a8-3563b9079776 None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:33:44.252627 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 176/372] 10.222.0.65 () {56 vars in 1103 bytes} [Thu Oct 27 09:33:44 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 09:33:44.252627 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd58da2b-880c-409c-a5f4-c7d800aa4bfa None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:33:44.256482 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:33:44.266553 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 197/373] 10.222.0.65 () {56 vars in 1109 bytes} [Thu Oct 27 09:33:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 09:33:44.266553 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5755d19-6491-4e20-9f36-956f9df12e48 None None] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:33:44.266553 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5755d19-6491-4e20-9f36-956f9df12e48 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:33:44.266553 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5755d19-6491-4e20-9f36-956f9df12e48 None None] PATH_INFO: `/` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:33:44.266553 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 198/374] 10.222.0.65 () {54 vars in 927 bytes} [Thu Oct 27 09:33:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 09:33:44.266553 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5755d19-6491-4e20-9f36-956f9df12e48 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:33:44.343039 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:33:44.365280 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd58da2b-880c-409c-a5f4-c7d800aa4bfa None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:33:44.382845 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5755d19-6491-4e20-9f36-956f9df12e48 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:33:44.421998 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468c13a9-7868-4faf-84fe-07d702d790cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:33:44.423160 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468c13a9-7868-4faf-84fe-07d702d790cb None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:33:44.423843 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468c13a9-7868-4faf-84fe-07d702d790cb None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:33:44.424185 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468c13a9-7868-4faf-84fe-07d702d790cb None admin] PATH_INFO: `/v3/roles/service` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:33:44.429329 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc430277-1353-47b0-83dd-84a6b9b0c993 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:33:44.429993 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc430277-1353-47b0-83dd-84a6b9b0c993 None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:33:44.430274 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc430277-1353-47b0-83dd-84a6b9b0c993 None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:33:44.430582 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc430277-1353-47b0-83dd-84a6b9b0c993 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:33:44.439611 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468c13a9-7868-4faf-84fe-07d702d790cb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 09:33:44.442411 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc430277-1353-47b0-83dd-84a6b9b0c993 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:33:44.443940 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc430277-1353-47b0-83dd-84a6b9b0c993 None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:33:44.445451 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application [None req-468c13a9-7868-4faf-84fe-07d702d790cb None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 27 09:33:44.445451 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 09:33:44.445451 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 09:33:44.445451 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 09:33:44.445451 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 09:33:44.445451 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 09:33:44.445451 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 09:33:44.445451 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 09:33:44.445451 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 09:33:44.445451 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 09:33:44.445451 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 09:33:44.445451 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 09:33:44.445451 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 27 09:33:44.445451 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 27 09:33:44.445451 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 27 09:33:44.445451 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 27 09:33:44.446275 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 27 09:33:44.446275 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 27 09:33:44.446275 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 27 09:33:44.446275 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 27 09:33:44.446275 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 09:33:44.446275 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 09:33:44.446275 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 09:33:44.446275 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 09:33:44.446275 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 09:33:44.446275 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 09:33:44.446275 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 09:33:44.446275 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application with Lock( Oct 27 09:33:44.446275 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 09:33:44.446275 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._enter() Oct 27 09:33:44.446275 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 09:33:44.446275 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 09:33:44.447457 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 09:33:44.447457 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.creator() Oct 27 09:33:44.447457 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 09:33:44.447457 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application created_value = creator( Oct 27 09:33:44.447457 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 27 09:33:44.447457 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 27 09:33:44.447457 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 27 09:33:44.447457 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 27 09:33:44.447457 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 27 09:33:44.447457 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 27 09:33:44.447457 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 27 09:33:44.447457 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application Oct 27 09:33:44.447457 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 177/375] 10.222.0.65 () {56 vars in 1102 bytes} [Thu Oct 27 09:33:44 2022] GET /identity/v3/roles/service => generated 85 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 09:33:44.451462 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468c13a9-7868-4faf-84fe-07d702d790cb None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:33:44.462308 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application [None req-fc430277-1353-47b0-83dd-84a6b9b0c993 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 09:33:44.462308 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 09:33:44.462308 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 09:33:44.462308 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 09:33:44.462308 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 09:33:44.462308 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 09:33:44.462308 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 09:33:44.462308 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 09:33:44.462308 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 09:33:44.462308 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 09:33:44.462308 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 09:33:44.462308 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 09:33:44.462308 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 27 09:33:44.462308 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 27 09:33:44.462308 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 27 09:33:44.462308 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 27 09:33:44.463434 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 09:33:44.463434 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 09:33:44.463434 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 09:33:44.463434 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 09:33:44.463434 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 09:33:44.463434 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 09:33:44.463434 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 09:33:44.463434 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application with Lock( Oct 27 09:33:44.463434 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 09:33:44.463434 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._enter() Oct 27 09:33:44.463434 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 09:33:44.463434 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 09:33:44.463434 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 09:33:44.463434 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.creator() Oct 27 09:33:44.463434 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 09:33:44.463434 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application created_value = creator( Oct 27 09:33:44.463434 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 27 09:33:44.464465 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 27 09:33:44.464465 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 09:33:44.464465 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application Oct 27 09:33:44.464465 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 199/376] 10.222.0.65 () {56 vars in 1108 bytes} [Thu Oct 27 09:33:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 09:33:44.466326 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a67cc79-1e8f-4ba8-8b95-f3409828fd49 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:33:44.466808 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a67cc79-1e8f-4ba8-8b95-f3409828fd49 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:33:44.466972 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a67cc79-1e8f-4ba8-8b95-f3409828fd49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:33:44.486457 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-6a67cc79-1e8f-4ba8-8b95-f3409828fd49 None None] MFA Rules not processed for user `b5065084bf664b99bdeac46067cb0f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:33:44.487709 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-6a67cc79-1e8f-4ba8-8b95-f3409828fd49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:33:44.546677 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:33:44.568011 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 200/377] 10.222.0.65 () {58 vars in 1024 bytes} [Thu Oct 27 09:33:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 27 09:33:44.568959 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a67cc79-1e8f-4ba8-8b95-f3409828fd49 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:33:44.569525 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468c13a9-7868-4faf-84fe-07d702d790cb None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:33:44.609526 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2729657b-6638-4855-894e-c65751bfb7d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:33:44.610159 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2729657b-6638-4855-894e-c65751bfb7d6 None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:33:44.610442 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2729657b-6638-4855-894e-c65751bfb7d6 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:33:44.610750 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2729657b-6638-4855-894e-c65751bfb7d6 None admin] PATH_INFO: `/v3/users/nova` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:33:44.618753 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2729657b-6638-4855-894e-c65751bfb7d6 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:33:44.620377 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2729657b-6638-4855-894e-c65751bfb7d6 None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:33:44.623294 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:33:44.634197 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application [None req-2729657b-6638-4855-894e-c65751bfb7d6 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 27 09:33:44.634197 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 09:33:44.634197 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 09:33:44.634197 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 09:33:44.634197 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 09:33:44.634197 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 09:33:44.634197 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 09:33:44.634197 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 09:33:44.634197 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 09:33:44.634197 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 09:33:44.634197 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 09:33:44.634197 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 09:33:44.634197 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 27 09:33:44.634197 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 27 09:33:44.634197 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 27 09:33:44.634197 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 27 09:33:44.635219 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 09:33:44.635219 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 09:33:44.635219 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 27 09:33:44.635219 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 27 09:33:44.635219 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 27 09:33:44.635219 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 27 09:33:44.635219 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 09:33:44.635219 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 09:33:44.635219 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 09:33:44.635219 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 09:33:44.635219 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 09:33:44.635219 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application with Lock( Oct 27 09:33:44.635219 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 09:33:44.635219 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._enter() Oct 27 09:33:44.635219 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 09:33:44.635219 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 09:33:44.635219 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 09:33:44.635219 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.creator() Oct 27 09:33:44.636089 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 09:33:44.636089 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application created_value = creator( Oct 27 09:33:44.636089 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 27 09:33:44.636089 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 27 09:33:44.636089 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 27 09:33:44.636089 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 27 09:33:44.636089 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 27 09:33:44.636089 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 27 09:33:44.636089 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 27 09:33:44.636089 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application Oct 27 09:33:44.636089 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 178/378] 10.222.0.65 () {56 vars in 1093 bytes} [Thu Oct 27 09:33:44 2022] GET /identity/v3/users/nova => generated 82 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 09:33:44.636089 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2729657b-6638-4855-894e-c65751bfb7d6 None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:33:44.680738 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a67cc79-1e8f-4ba8-8b95-f3409828fd49 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:33:44.722684 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384bfa01-2971-43aa-a108-ada5e114ad1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:33:44.723303 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384bfa01-2971-43aa-a108-ada5e114ad1e None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:33:44.723582 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384bfa01-2971-43aa-a108-ada5e114ad1e None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:33:44.723854 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384bfa01-2971-43aa-a108-ada5e114ad1e None admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:33:44.724522 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384bfa01-2971-43aa-a108-ada5e114ad1e None admin] RBAC: Adding query filter params (name=service) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 09:33:44.724823 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384bfa01-2971-43aa-a108-ada5e114ad1e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:33:44.726201 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384bfa01-2971-43aa-a108-ada5e114ad1e None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:33:44.735365 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 201/379] 10.222.0.65 () {56 vars in 1103 bytes} [Thu Oct 27 09:33:44 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 09:33:44.740850 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144941e8-02bc-4cc5-9a19-8f7160096709 None None] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:33:44.741209 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144941e8-02bc-4cc5-9a19-8f7160096709 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:33:44.741553 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144941e8-02bc-4cc5-9a19-8f7160096709 None None] PATH_INFO: `/` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:33:44.743172 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 202/380] 10.222.0.65 () {54 vars in 927 bytes} [Thu Oct 27 09:33:44 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 09:33:44.748253 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144941e8-02bc-4cc5-9a19-8f7160096709 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:33:44.756667 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2729657b-6638-4855-894e-c65751bfb7d6 None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:33:44.798825 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b06bfed-2a26-4f0e-8b8e-880887820d3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:33:44.799359 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b06bfed-2a26-4f0e-8b8e-880887820d3b None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:33:44.799674 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b06bfed-2a26-4f0e-8b8e-880887820d3b None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:33:44.799912 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b06bfed-2a26-4f0e-8b8e-880887820d3b None admin] PATH_INFO: `/v3/domains` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:33:44.800738 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b06bfed-2a26-4f0e-8b8e-880887820d3b None admin] RBAC: Adding query filter params (name=Default) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 09:33:44.800856 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b06bfed-2a26-4f0e-8b8e-880887820d3b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:33:44.801299 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:33:44.802676 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b06bfed-2a26-4f0e-8b8e-880887820d3b None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:33:44.820615 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 179/381] 10.222.0.65 () {56 vars in 1109 bytes} [Thu Oct 27 09:33:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 09:33:44.820615 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b06bfed-2a26-4f0e-8b8e-880887820d3b None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:33:44.869900 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144941e8-02bc-4cc5-9a19-8f7160096709 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:33:44.891231 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:33:44.905119 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84c6fa8-e2cd-423e-b4a5-d005e89e6f95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:33:44.905847 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84c6fa8-e2cd-423e-b4a5-d005e89e6f95 None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:33:44.906124 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84c6fa8-e2cd-423e-b4a5-d005e89e6f95 None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:33:44.906396 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84c6fa8-e2cd-423e-b4a5-d005e89e6f95 None admin] PATH_INFO: `/v3/users` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:33:44.907155 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84c6fa8-e2cd-423e-b4a5-d005e89e6f95 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 09:33:44.907459 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84c6fa8-e2cd-423e-b4a5-d005e89e6f95 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:33:44.908903 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84c6fa8-e2cd-423e-b4a5-d005e89e6f95 None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:33:44.933367 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b06bfed-2a26-4f0e-8b8e-880887820d3b None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:33:44.946197 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 203/382] 10.222.0.65 () {56 vars in 1133 bytes} [Thu Oct 27 09:33:44 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 09:33:44.947462 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1475b35b-8fde-4b3d-8bd8-21387c608ea9 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:33:44.947746 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1475b35b-8fde-4b3d-8bd8-21387c608ea9 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:33:44.948019 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1475b35b-8fde-4b3d-8bd8-21387c608ea9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:33:44.967230 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-1475b35b-8fde-4b3d-8bd8-21387c608ea9 None None] MFA Rules not processed for user `b5065084bf664b99bdeac46067cb0f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:33:44.968434 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-1475b35b-8fde-4b3d-8bd8-21387c608ea9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:33:44.973451 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a387cf-d3de-4f20-b0ce-b9dd82ef8e87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:33:44.974095 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a387cf-d3de-4f20-b0ce-b9dd82ef8e87 None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:33:44.974379 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a387cf-d3de-4f20-b0ce-b9dd82ef8e87 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:33:44.974691 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a387cf-d3de-4f20-b0ce-b9dd82ef8e87 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:33:44.986140 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a387cf-d3de-4f20-b0ce-b9dd82ef8e87 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:33:44.987755 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a387cf-d3de-4f20-b0ce-b9dd82ef8e87 None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:33:45.003088 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application [None req-e2a387cf-d3de-4f20-b0ce-b9dd82ef8e87 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 09:33:45.003088 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 09:33:45.003088 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 09:33:45.003088 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 09:33:45.003088 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 09:33:45.003088 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 09:33:45.003088 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 09:33:45.003088 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 09:33:45.003088 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 09:33:45.003088 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 09:33:45.003088 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 09:33:45.003088 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 09:33:45.003088 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 27 09:33:45.003088 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 27 09:33:45.003088 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 27 09:33:45.003088 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 27 09:33:45.004121 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 09:33:45.004121 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 09:33:45.004121 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 09:33:45.004121 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 09:33:45.004121 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 09:33:45.004121 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 09:33:45.004121 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 09:33:45.004121 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application with Lock( Oct 27 09:33:45.004121 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 09:33:45.004121 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._enter() Oct 27 09:33:45.004121 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 09:33:45.004121 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 09:33:45.004121 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 09:33:45.004121 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.creator() Oct 27 09:33:45.004121 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 09:33:45.004121 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application created_value = creator( Oct 27 09:33:45.004121 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 27 09:33:45.004942 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 27 09:33:45.004942 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 09:33:45.004942 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application Oct 27 09:33:45.004942 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 180/383] 10.222.0.65 () {56 vars in 1108 bytes} [Thu Oct 27 09:33:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 09:33:45.005267 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a387cf-d3de-4f20-b0ce-b9dd82ef8e87 None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:33:45.048680 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 204/384] 10.222.0.65 () {58 vars in 1024 bytes} [Thu Oct 27 09:33:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 27 09:33:45.049586 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1475b35b-8fde-4b3d-8bd8-21387c608ea9 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:33:45.083554 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:33:45.140789 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a387cf-d3de-4f20-b0ce-b9dd82ef8e87 None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:33:45.155286 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:33:45.157011 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1475b35b-8fde-4b3d-8bd8-21387c608ea9 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:33:45.177162 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cbecb8-3d57-4d1f-a437-ecb4361f4ca6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:33:45.177793 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cbecb8-3d57-4d1f-a437-ecb4361f4ca6 None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:33:45.178084 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cbecb8-3d57-4d1f-a437-ecb4361f4ca6 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:33:45.178359 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cbecb8-3d57-4d1f-a437-ecb4361f4ca6 None admin] PATH_INFO: `/v3/users/glance` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:33:45.187659 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7cbecb8-3d57-4d1f-a437-ecb4361f4ca6 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:33:45.189483 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7cbecb8-3d57-4d1f-a437-ecb4361f4ca6 None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:33:45.195074 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6421841-aef8-4d25-85c4-16df3e3e759f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:33:45.195681 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6421841-aef8-4d25-85c4-16df3e3e759f None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:33:45.195960 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6421841-aef8-4d25-85c4-16df3e3e759f None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:33:45.196243 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6421841-aef8-4d25-85c4-16df3e3e759f None admin] PATH_INFO: `/v3/roles/service` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:33:45.202660 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application [None req-e7cbecb8-3d57-4d1f-a437-ecb4361f4ca6 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Oct 27 09:33:45.202660 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 09:33:45.202660 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 09:33:45.202660 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 09:33:45.202660 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 09:33:45.202660 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 09:33:45.202660 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 09:33:45.202660 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 09:33:45.202660 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 09:33:45.202660 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 09:33:45.202660 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 09:33:45.202660 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 09:33:45.202660 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 27 09:33:45.202660 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 27 09:33:45.202660 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 27 09:33:45.202660 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 27 09:33:45.203539 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 09:33:45.203539 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 09:33:45.203539 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 27 09:33:45.203539 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 27 09:33:45.203539 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 27 09:33:45.203539 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 27 09:33:45.203539 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 09:33:45.203539 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 09:33:45.203539 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 09:33:45.203539 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 09:33:45.203539 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 09:33:45.203539 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application with Lock( Oct 27 09:33:45.203539 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 09:33:45.203539 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._enter() Oct 27 09:33:45.203539 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 09:33:45.203539 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 09:33:45.203539 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 09:33:45.203539 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.creator() Oct 27 09:33:45.204366 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 09:33:45.204366 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application created_value = creator( Oct 27 09:33:45.204366 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 27 09:33:45.204366 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 27 09:33:45.204366 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 27 09:33:45.204366 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 27 09:33:45.204366 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 27 09:33:45.204366 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 27 09:33:45.204366 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Oct 27 09:33:45.204366 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application Oct 27 09:33:45.204366 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 181/385] 10.222.0.65 () {56 vars in 1099 bytes} [Thu Oct 27 09:33:45 2022] GET /identity/v3/users/glance => generated 84 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 09:33:45.204366 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cbecb8-3d57-4d1f-a437-ecb4361f4ca6 None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:33:45.213869 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6421841-aef8-4d25-85c4-16df3e3e759f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 09:33:45.218866 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application [None req-b6421841-aef8-4d25-85c4-16df3e3e759f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 27 09:33:45.218866 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 09:33:45.218866 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 09:33:45.218866 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 09:33:45.218866 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 09:33:45.218866 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 09:33:45.218866 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 09:33:45.218866 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 09:33:45.218866 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 09:33:45.218866 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 09:33:45.218866 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 09:33:45.218866 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 09:33:45.218866 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 27 09:33:45.218866 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 27 09:33:45.218866 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 27 09:33:45.218866 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 27 09:33:45.219923 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 27 09:33:45.219923 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 27 09:33:45.219923 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 27 09:33:45.219923 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 27 09:33:45.219923 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 09:33:45.219923 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 09:33:45.219923 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 09:33:45.219923 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 09:33:45.219923 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 09:33:45.219923 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 09:33:45.219923 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 09:33:45.219923 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application with Lock( Oct 27 09:33:45.219923 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 09:33:45.219923 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._enter() Oct 27 09:33:45.219923 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 09:33:45.219923 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 09:33:45.220705 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 09:33:45.220705 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.creator() Oct 27 09:33:45.220705 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 09:33:45.220705 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application created_value = creator( Oct 27 09:33:45.220705 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 27 09:33:45.220705 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 27 09:33:45.220705 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 27 09:33:45.220705 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 27 09:33:45.220705 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 27 09:33:45.220705 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 27 09:33:45.220705 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 27 09:33:45.220705 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application Oct 27 09:33:45.220705 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 205/386] 10.222.0.65 () {56 vars in 1102 bytes} [Thu Oct 27 09:33:45 2022] GET /identity/v3/roles/service => generated 85 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 09:33:45.221343 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6421841-aef8-4d25-85c4-16df3e3e759f None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:33:45.321688 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:33:45.324021 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cbecb8-3d57-4d1f-a437-ecb4361f4ca6 None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:33:45.331446 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6421841-aef8-4d25-85c4-16df3e3e759f None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:33:45.360654 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48967b3e-01e7-4538-9409-90b0d3dfe404 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:33:45.361029 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48967b3e-01e7-4538-9409-90b0d3dfe404 None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:33:45.361317 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48967b3e-01e7-4538-9409-90b0d3dfe404 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:33:45.361599 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48967b3e-01e7-4538-9409-90b0d3dfe404 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:33:45.366579 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652a812e-f61a-41c4-ba22-fc908659e4a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:33:45.367195 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652a812e-f61a-41c4-ba22-fc908659e4a4 None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:33:45.367473 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652a812e-f61a-41c4-ba22-fc908659e4a4 None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:33:45.367749 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652a812e-f61a-41c4-ba22-fc908659e4a4 None admin] PATH_INFO: `/v3/domains` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:33:45.368400 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652a812e-f61a-41c4-ba22-fc908659e4a4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 09:33:45.369160 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652a812e-f61a-41c4-ba22-fc908659e4a4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:33:45.370586 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652a812e-f61a-41c4-ba22-fc908659e4a4 None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:33:45.373630 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48967b3e-01e7-4538-9409-90b0d3dfe404 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:33:45.375131 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48967b3e-01e7-4538-9409-90b0d3dfe404 None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:33:45.383320 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 206/387] 10.222.0.65 () {56 vars in 1109 bytes} [Thu Oct 27 09:33:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 09:33:45.383932 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652a812e-f61a-41c4-ba22-fc908659e4a4 None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:33:45.392449 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application [None req-48967b3e-01e7-4538-9409-90b0d3dfe404 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 09:33:45.392449 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 09:33:45.392449 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 09:33:45.392449 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 09:33:45.392449 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 09:33:45.392449 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 09:33:45.392449 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 09:33:45.392449 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 09:33:45.392449 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 09:33:45.392449 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 09:33:45.392449 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 09:33:45.392449 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 09:33:45.392449 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 27 09:33:45.392449 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 27 09:33:45.392449 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 27 09:33:45.392449 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 27 09:33:45.393555 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 09:33:45.393555 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 09:33:45.393555 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 09:33:45.393555 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 09:33:45.393555 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 09:33:45.393555 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 09:33:45.393555 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 09:33:45.393555 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application with Lock( Oct 27 09:33:45.393555 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 09:33:45.393555 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._enter() Oct 27 09:33:45.393555 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 09:33:45.393555 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 09:33:45.393555 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 09:33:45.393555 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.creator() Oct 27 09:33:45.393555 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 09:33:45.393555 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application created_value = creator( Oct 27 09:33:45.393555 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 27 09:33:45.394626 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 27 09:33:45.394626 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 09:33:45.394626 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application Oct 27 09:33:45.394626 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 182/388] 10.222.0.65 () {56 vars in 1108 bytes} [Thu Oct 27 09:33:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 09:33:45.394893 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48967b3e-01e7-4538-9409-90b0d3dfe404 None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:33:45.422133 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:33:45.488173 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652a812e-f61a-41c4-ba22-fc908659e4a4 None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:33:45.498221 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48967b3e-01e7-4538-9409-90b0d3dfe404 None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:33:45.522646 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544c5a39-d75f-4666-b770-3e619e81efb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:33:45.523257 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544c5a39-d75f-4666-b770-3e619e81efb6 None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:33:45.523549 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544c5a39-d75f-4666-b770-3e619e81efb6 None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:33:45.523826 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544c5a39-d75f-4666-b770-3e619e81efb6 None admin] PATH_INFO: `/v3/users` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:33:45.524554 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544c5a39-d75f-4666-b770-3e619e81efb6 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 09:33:45.525218 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544c5a39-d75f-4666-b770-3e619e81efb6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:33:45.526687 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544c5a39-d75f-4666-b770-3e619e81efb6 None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:33:45.531953 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b20a44-0c8f-407c-85f2-8f2bb9216bb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:33:45.532551 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b20a44-0c8f-407c-85f2-8f2bb9216bb9 None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:33:45.532830 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b20a44-0c8f-407c-85f2-8f2bb9216bb9 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:33:45.533103 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b20a44-0c8f-407c-85f2-8f2bb9216bb9 None admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:33:45.533768 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b20a44-0c8f-407c-85f2-8f2bb9216bb9 None admin] RBAC: Adding query filter params (name=service) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 09:33:45.534074 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b20a44-0c8f-407c-85f2-8f2bb9216bb9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:33:45.535466 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b20a44-0c8f-407c-85f2-8f2bb9216bb9 None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:33:45.544738 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 183/389] 10.222.0.65 () {56 vars in 1103 bytes} [Thu Oct 27 09:33:45 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 09:33:45.545708 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b20a44-0c8f-407c-85f2-8f2bb9216bb9 None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:33:45.545813 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 207/390] 10.222.0.65 () {56 vars in 1137 bytes} [Thu Oct 27 09:33:45 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 09:33:45.546370 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544c5a39-d75f-4666-b770-3e619e81efb6 None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:33:45.559191 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:33:45.651362 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:33:45.661181 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544c5a39-d75f-4666-b770-3e619e81efb6 None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:33:45.666426 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b20a44-0c8f-407c-85f2-8f2bb9216bb9 None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:33:45.696798 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3436060-41b0-4f11-b5b0-bb06065fe63f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:33:45.697433 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3436060-41b0-4f11-b5b0-bb06065fe63f None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:33:45.697725 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3436060-41b0-4f11-b5b0-bb06065fe63f None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:33:45.697999 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3436060-41b0-4f11-b5b0-bb06065fe63f None admin] PATH_INFO: `/v3/users/cinder` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:33:45.701236 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194125d1-bf03-409f-80b9-3b353abc1b01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:33:45.701857 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194125d1-bf03-409f-80b9-3b353abc1b01 None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:33:45.702141 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194125d1-bf03-409f-80b9-3b353abc1b01 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:33:45.702419 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194125d1-bf03-409f-80b9-3b353abc1b01 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:33:45.705687 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3436060-41b0-4f11-b5b0-bb06065fe63f None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:33:45.707179 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3436060-41b0-4f11-b5b0-bb06065fe63f None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:33:45.713269 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194125d1-bf03-409f-80b9-3b353abc1b01 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:33:45.714806 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194125d1-bf03-409f-80b9-3b353abc1b01 None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:33:45.720235 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application [None req-e3436060-41b0-4f11-b5b0-bb06065fe63f None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Oct 27 09:33:45.720235 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 09:33:45.720235 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 09:33:45.720235 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 09:33:45.720235 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 09:33:45.720235 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 09:33:45.720235 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 09:33:45.720235 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 09:33:45.720235 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 09:33:45.720235 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 09:33:45.720235 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 09:33:45.720235 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 09:33:45.720235 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 27 09:33:45.720235 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 27 09:33:45.720235 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 27 09:33:45.720235 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 27 09:33:45.721211 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 09:33:45.721211 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 09:33:45.721211 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 27 09:33:45.721211 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 27 09:33:45.721211 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 27 09:33:45.721211 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 27 09:33:45.721211 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 09:33:45.721211 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 09:33:45.721211 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 09:33:45.721211 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 09:33:45.721211 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 09:33:45.721211 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application with Lock( Oct 27 09:33:45.721211 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 09:33:45.721211 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._enter() Oct 27 09:33:45.721211 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 09:33:45.721211 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 09:33:45.721211 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 09:33:45.721211 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.creator() Oct 27 09:33:45.722186 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 09:33:45.722186 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application created_value = creator( Oct 27 09:33:45.722186 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 27 09:33:45.722186 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 27 09:33:45.722186 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 27 09:33:45.722186 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 27 09:33:45.722186 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 27 09:33:45.722186 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 27 09:33:45.722186 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Oct 27 09:33:45.722186 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application Oct 27 09:33:45.722186 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 208/391] 10.222.0.65 () {56 vars in 1099 bytes} [Thu Oct 27 09:33:45 2022] GET /identity/v3/users/cinder => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 09:33:45.726728 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3436060-41b0-4f11-b5b0-bb06065fe63f None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:33:45.729449 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application [None req-194125d1-bf03-409f-80b9-3b353abc1b01 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 09:33:45.729449 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 09:33:45.729449 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 09:33:45.729449 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 09:33:45.729449 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 09:33:45.729449 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 09:33:45.729449 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 09:33:45.729449 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 09:33:45.729449 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 09:33:45.729449 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 09:33:45.729449 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 09:33:45.729449 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 09:33:45.729449 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 27 09:33:45.729449 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 27 09:33:45.729449 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 27 09:33:45.729449 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 27 09:33:45.731047 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 09:33:45.731047 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 09:33:45.731047 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 09:33:45.731047 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 09:33:45.731047 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 09:33:45.731047 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 09:33:45.731047 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 09:33:45.731047 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application with Lock( Oct 27 09:33:45.731047 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 09:33:45.731047 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._enter() Oct 27 09:33:45.731047 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 09:33:45.731047 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 09:33:45.731047 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 09:33:45.731047 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.creator() Oct 27 09:33:45.731047 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 09:33:45.731047 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application created_value = creator( Oct 27 09:33:45.731047 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 27 09:33:45.731992 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 27 09:33:45.731992 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 09:33:45.731992 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application Oct 27 09:33:45.736161 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 184/392] 10.222.0.65 () {56 vars in 1108 bytes} [Thu Oct 27 09:33:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 09:33:45.737026 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194125d1-bf03-409f-80b9-3b353abc1b01 None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:33:45.800576 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:33:45.831985 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3436060-41b0-4f11-b5b0-bb06065fe63f None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:33:45.841804 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194125d1-bf03-409f-80b9-3b353abc1b01 None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:33:45.869501 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80f3dd8-e654-43e3-9965-124b7b2b7c49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:33:45.870115 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80f3dd8-e654-43e3-9965-124b7b2b7c49 None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:33:45.870397 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80f3dd8-e654-43e3-9965-124b7b2b7c49 None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:33:45.870707 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80f3dd8-e654-43e3-9965-124b7b2b7c49 None admin] PATH_INFO: `/v3/domains` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:33:45.872168 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80f3dd8-e654-43e3-9965-124b7b2b7c49 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 09:33:45.872598 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80f3dd8-e654-43e3-9965-124b7b2b7c49 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:33:45.874007 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80f3dd8-e654-43e3-9965-124b7b2b7c49 None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:33:45.881131 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb8b357-e0da-4d98-87c5-ca836e45735c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:33:45.881758 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb8b357-e0da-4d98-87c5-ca836e45735c None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:33:45.882043 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb8b357-e0da-4d98-87c5-ca836e45735c None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:33:45.882319 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb8b357-e0da-4d98-87c5-ca836e45735c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:33:45.885966 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 209/393] 10.222.0.65 () {56 vars in 1109 bytes} [Thu Oct 27 09:33:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 09:33:45.887474 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80f3dd8-e654-43e3-9965-124b7b2b7c49 None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:33:45.890601 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:33:45.895431 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb8b357-e0da-4d98-87c5-ca836e45735c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:33:45.896896 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb8b357-e0da-4d98-87c5-ca836e45735c None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:33:45.911777 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application [None req-6eb8b357-e0da-4d98-87c5-ca836e45735c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 09:33:45.911777 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 09:33:45.911777 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 09:33:45.911777 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 09:33:45.911777 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 09:33:45.911777 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 09:33:45.911777 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 09:33:45.911777 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 09:33:45.911777 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 09:33:45.911777 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 09:33:45.911777 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 09:33:45.911777 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 09:33:45.911777 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 27 09:33:45.911777 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 27 09:33:45.911777 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 27 09:33:45.911777 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 27 09:33:45.912701 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 09:33:45.912701 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 09:33:45.912701 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 09:33:45.912701 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 09:33:45.912701 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 09:33:45.912701 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 09:33:45.912701 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 09:33:45.912701 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application with Lock( Oct 27 09:33:45.912701 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 09:33:45.912701 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._enter() Oct 27 09:33:45.912701 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 09:33:45.912701 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 09:33:45.912701 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 09:33:45.912701 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.creator() Oct 27 09:33:45.912701 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 09:33:45.912701 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application created_value = creator( Oct 27 09:33:45.912701 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 27 09:33:45.913529 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 27 09:33:45.913529 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 09:33:45.913529 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application Oct 27 09:33:45.913529 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 185/394] 10.222.0.65 () {56 vars in 1108 bytes} [Thu Oct 27 09:33:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 09:33:45.913738 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb8b357-e0da-4d98-87c5-ca836e45735c None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:33:45.989370 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80f3dd8-e654-43e3-9965-124b7b2b7c49 None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:33:46.015595 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb8b357-e0da-4d98-87c5-ca836e45735c None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:33:46.019580 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:33:46.025174 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeae31a3-837a-4194-916a-debdccab8549 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:33:46.025806 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeae31a3-837a-4194-916a-debdccab8549 None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:33:46.032333 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeae31a3-837a-4194-916a-debdccab8549 None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:33:46.032333 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeae31a3-837a-4194-916a-debdccab8549 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:33:46.036399 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeae31a3-837a-4194-916a-debdccab8549 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:33:46.037846 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeae31a3-837a-4194-916a-debdccab8549 None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:33:46.049343 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6596f94-1f33-4893-ad38-28e50c6953d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:33:46.049950 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6596f94-1f33-4893-ad38-28e50c6953d8 None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:33:46.050232 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6596f94-1f33-4893-ad38-28e50c6953d8 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:33:46.050511 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6596f94-1f33-4893-ad38-28e50c6953d8 None admin] PATH_INFO: `/v3/users` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:33:46.051275 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6596f94-1f33-4893-ad38-28e50c6953d8 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 09:33:46.051585 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6596f94-1f33-4893-ad38-28e50c6953d8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:33:46.052416 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application [None req-eeae31a3-837a-4194-916a-debdccab8549 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 09:33:46.052416 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 09:33:46.052416 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 09:33:46.052416 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 09:33:46.052416 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 09:33:46.052416 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 09:33:46.052416 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 09:33:46.052416 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 09:33:46.052416 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 09:33:46.052416 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 09:33:46.052416 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 09:33:46.052416 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 09:33:46.052416 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 27 09:33:46.052416 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 27 09:33:46.052416 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 27 09:33:46.052416 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 27 09:33:46.053360 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 09:33:46.053360 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 09:33:46.053360 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 09:33:46.053360 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 09:33:46.053360 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 09:33:46.053360 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 09:33:46.053360 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 09:33:46.053360 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application with Lock( Oct 27 09:33:46.053360 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 09:33:46.053360 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._enter() Oct 27 09:33:46.053360 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 09:33:46.053360 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 09:33:46.053360 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 09:33:46.053360 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.creator() Oct 27 09:33:46.053360 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 09:33:46.053360 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application created_value = creator( Oct 27 09:33:46.053360 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 27 09:33:46.054172 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 27 09:33:46.054172 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 09:33:46.054172 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application Oct 27 09:33:46.054331 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6596f94-1f33-4893-ad38-28e50c6953d8 None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:33:46.054396 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 210/395] 10.222.0.65 () {56 vars in 1108 bytes} [Thu Oct 27 09:33:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 09:33:46.054396 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeae31a3-837a-4194-916a-debdccab8549 None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:33:46.090963 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 186/396] 10.222.0.65 () {56 vars in 1137 bytes} [Thu Oct 27 09:33:45 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 09:33:46.091815 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6596f94-1f33-4893-ad38-28e50c6953d8 None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:33:46.142339 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:33:46.160285 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeae31a3-837a-4194-916a-debdccab8549 None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:33:46.196074 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6596f94-1f33-4893-ad38-28e50c6953d8 None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:33:46.197801 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597d9cfa-aa18-4768-9129-287a67a8e5af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:33:46.198412 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597d9cfa-aa18-4768-9129-287a67a8e5af None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:33:46.198728 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597d9cfa-aa18-4768-9129-287a67a8e5af None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:33:46.199003 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597d9cfa-aa18-4768-9129-287a67a8e5af None admin] PATH_INFO: `/v3/domains` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:33:46.199932 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597d9cfa-aa18-4768-9129-287a67a8e5af None admin] RBAC: Adding query filter params (name=Default) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 09:33:46.200241 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597d9cfa-aa18-4768-9129-287a67a8e5af None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:33:46.201626 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597d9cfa-aa18-4768-9129-287a67a8e5af None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:33:46.214640 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 211/397] 10.222.0.65 () {56 vars in 1109 bytes} [Thu Oct 27 09:33:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 09:33:46.215579 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597d9cfa-aa18-4768-9129-287a67a8e5af None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:33:46.236093 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07c6961-501a-4c0e-8628-22dce6fb499c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:33:46.236731 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07c6961-501a-4c0e-8628-22dce6fb499c None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:33:46.237018 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07c6961-501a-4c0e-8628-22dce6fb499c None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:33:46.237303 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07c6961-501a-4c0e-8628-22dce6fb499c None admin] PATH_INFO: `/v3/projects/service` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:33:46.244713 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07c6961-501a-4c0e-8628-22dce6fb499c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:33:46.247042 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07c6961-501a-4c0e-8628-22dce6fb499c None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:33:46.258950 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application [None req-e07c6961-501a-4c0e-8628-22dce6fb499c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 27 09:33:46.258950 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 09:33:46.258950 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 09:33:46.258950 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 09:33:46.258950 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 09:33:46.258950 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 09:33:46.258950 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 09:33:46.258950 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 09:33:46.258950 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 09:33:46.258950 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 09:33:46.258950 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 09:33:46.258950 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 09:33:46.258950 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 27 09:33:46.258950 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 27 09:33:46.258950 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 27 09:33:46.259975 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 27 09:33:46.259975 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 09:33:46.259975 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 09:33:46.259975 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 09:33:46.259975 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 09:33:46.259975 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 09:33:46.259975 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 09:33:46.259975 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 09:33:46.259975 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application with Lock( Oct 27 09:33:46.259975 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 09:33:46.259975 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._enter() Oct 27 09:33:46.259975 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 09:33:46.259975 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 09:33:46.259975 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 09:33:46.259975 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.creator() Oct 27 09:33:46.259975 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 09:33:46.259975 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application created_value = creator( Oct 27 09:33:46.265576 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 27 09:33:46.265576 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 27 09:33:46.265576 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 27 09:33:46.265576 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 27 09:33:46.265576 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 27 09:33:46.265576 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 27 09:33:46.265576 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 27 09:33:46.265576 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application Oct 27 09:33:46.265576 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 187/398] 10.222.0.65 () {56 vars in 1111 bytes} [Thu Oct 27 09:33:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 09:33:46.265576 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07c6961-501a-4c0e-8628-22dce6fb499c None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:33:46.266164 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:33:46.318042 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597d9cfa-aa18-4768-9129-287a67a8e5af None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:33:46.353560 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498d1781-354a-4088-8610-e39f6fdc5ff2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:33:46.354168 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498d1781-354a-4088-8610-e39f6fdc5ff2 None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:33:46.354443 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498d1781-354a-4088-8610-e39f6fdc5ff2 None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:33:46.354744 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498d1781-354a-4088-8610-e39f6fdc5ff2 None admin] PATH_INFO: `/v3/domains` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:33:46.355969 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498d1781-354a-4088-8610-e39f6fdc5ff2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 09:33:46.356411 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498d1781-354a-4088-8610-e39f6fdc5ff2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:33:46.357877 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498d1781-354a-4088-8610-e39f6fdc5ff2 None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:33:46.363091 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07c6961-501a-4c0e-8628-22dce6fb499c None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:33:46.369951 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 212/399] 10.222.0.65 () {56 vars in 1109 bytes} [Thu Oct 27 09:33:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 09:33:46.370812 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498d1781-354a-4088-8610-e39f6fdc5ff2 None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:33:46.378352 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:33:46.404714 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd571793-c0b7-41b7-ab72-6155bcd779e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:33:46.405314 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd571793-c0b7-41b7-ab72-6155bcd779e0 None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:33:46.405593 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd571793-c0b7-41b7-ab72-6155bcd779e0 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:33:46.405867 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd571793-c0b7-41b7-ab72-6155bcd779e0 None admin] PATH_INFO: `/v3/domains` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:33:46.406529 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd571793-c0b7-41b7-ab72-6155bcd779e0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 09:33:46.406848 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd571793-c0b7-41b7-ab72-6155bcd779e0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:33:46.408278 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd571793-c0b7-41b7-ab72-6155bcd779e0 None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:33:46.420382 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 188/400] 10.222.0.65 () {56 vars in 1109 bytes} [Thu Oct 27 09:33:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 09:33:46.421267 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd571793-c0b7-41b7-ab72-6155bcd779e0 None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:33:46.473490 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498d1781-354a-4088-8610-e39f6fdc5ff2 None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:33:46.474925 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:33:46.507338 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5715853e-550c-4e1a-971c-c880523547d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:33:46.507963 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5715853e-550c-4e1a-971c-c880523547d2 None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:33:46.508252 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5715853e-550c-4e1a-971c-c880523547d2 None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:33:46.508526 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5715853e-550c-4e1a-971c-c880523547d2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:33:46.520185 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5715853e-550c-4e1a-971c-c880523547d2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:33:46.521708 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5715853e-550c-4e1a-971c-c880523547d2 None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:33:46.532449 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd571793-c0b7-41b7-ab72-6155bcd779e0 None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:33:46.536601 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application [None req-5715853e-550c-4e1a-971c-c880523547d2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 09:33:46.536601 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 09:33:46.536601 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 09:33:46.536601 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 09:33:46.536601 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 09:33:46.536601 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 09:33:46.536601 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 09:33:46.536601 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 09:33:46.536601 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 09:33:46.536601 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 09:33:46.536601 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 09:33:46.536601 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 09:33:46.536601 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 27 09:33:46.536601 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 27 09:33:46.536601 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 27 09:33:46.536601 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 27 09:33:46.537681 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 09:33:46.537681 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 09:33:46.537681 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 09:33:46.537681 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 09:33:46.537681 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 09:33:46.537681 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 09:33:46.537681 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 09:33:46.537681 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application with Lock( Oct 27 09:33:46.537681 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 09:33:46.537681 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._enter() Oct 27 09:33:46.537681 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 09:33:46.537681 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 09:33:46.537681 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 09:33:46.537681 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.creator() Oct 27 09:33:46.537681 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 09:33:46.537681 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application created_value = creator( Oct 27 09:33:46.537681 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 27 09:33:46.543820 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 27 09:33:46.543820 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 09:33:46.543820 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application Oct 27 09:33:46.543820 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 213/401] 10.222.0.65 () {56 vars in 1108 bytes} [Thu Oct 27 09:33:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 09:33:46.543820 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5715853e-550c-4e1a-971c-c880523547d2 None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:33:46.571396 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32da46d7-9874-41bd-a6da-b4d3e17f05ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:33:46.572003 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32da46d7-9874-41bd-a6da-b4d3e17f05ea None admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:33:46.572506 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32da46d7-9874-41bd-a6da-b4d3e17f05ea None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:33:46.572615 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32da46d7-9874-41bd-a6da-b4d3e17f05ea None admin] PATH_INFO: `/v3/users` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:33:46.573182 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32da46d7-9874-41bd-a6da-b4d3e17f05ea None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:33:46.574719 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32da46d7-9874-41bd-a6da-b4d3e17f05ea None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:33:46.640225 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5715853e-550c-4e1a-971c-c880523547d2 None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:33:46.673957 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6c32a8-9759-45d3-8345-4c58067dcebe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:33:46.674605 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6c32a8-9759-45d3-8345-4c58067dcebe None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:33:46.674890 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6c32a8-9759-45d3-8345-4c58067dcebe None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:33:46.675165 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6c32a8-9759-45d3-8345-4c58067dcebe None admin] PATH_INFO: `/v3/projects` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:33:46.675853 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6c32a8-9759-45d3-8345-4c58067dcebe None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 09:33:46.676162 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6c32a8-9759-45d3-8345-4c58067dcebe None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:33:46.677614 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6c32a8-9759-45d3-8345-4c58067dcebe None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:33:46.686509 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 189/402] 10.222.0.65 () {60 vars in 1132 bytes} [Thu Oct 27 09:33:46 2022] POST /identity/v3/users => generated 247 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 09:33:46.687432 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32da46d7-9874-41bd-a6da-b4d3e17f05ea None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:33:46.697255 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 214/403] 10.222.0.65 () {56 vars in 1148 bytes} [Thu Oct 27 09:33:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 09:33:46.697992 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6c32a8-9759-45d3-8345-4c58067dcebe None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:33:46.715670 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:33:46.721769 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:33:46.809650 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32da46d7-9874-41bd-a6da-b4d3e17f05ea None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:33:46.815655 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6c32a8-9759-45d3-8345-4c58067dcebe None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:33:46.855072 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9097799-6a1c-4ae4-bc04-424c693677f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:33:46.856343 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9097799-6a1c-4ae4-bc04-424c693677f7 None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:33:46.856911 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9097799-6a1c-4ae4-bc04-424c693677f7 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:33:46.858106 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9097799-6a1c-4ae4-bc04-424c693677f7 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:33:46.863438 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c5883d-44d6-4f09-8328-3c463af22d03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:33:46.864211 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c5883d-44d6-4f09-8328-3c463af22d03 None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:33:46.864857 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c5883d-44d6-4f09-8328-3c463af22d03 None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:33:46.865251 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c5883d-44d6-4f09-8328-3c463af22d03 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:33:46.868483 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9097799-6a1c-4ae4-bc04-424c693677f7 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:33:46.869926 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9097799-6a1c-4ae4-bc04-424c693677f7 None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:33:46.874602 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c5883d-44d6-4f09-8328-3c463af22d03 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:33:46.876109 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c5883d-44d6-4f09-8328-3c463af22d03 None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:33:46.882621 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application [None req-f9097799-6a1c-4ae4-bc04-424c693677f7 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Oct 27 09:33:46.882621 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 09:33:46.882621 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 09:33:46.882621 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 09:33:46.882621 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 09:33:46.882621 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 09:33:46.882621 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 09:33:46.882621 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 09:33:46.882621 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 09:33:46.882621 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 09:33:46.882621 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 09:33:46.882621 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 09:33:46.882621 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 27 09:33:46.882621 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 27 09:33:46.882621 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 27 09:33:46.882621 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 27 09:33:46.883526 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 09:33:46.883526 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 09:33:46.883526 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 27 09:33:46.883526 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 27 09:33:46.883526 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 27 09:33:46.883526 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 27 09:33:46.883526 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 09:33:46.883526 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 09:33:46.883526 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 09:33:46.883526 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 09:33:46.883526 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 09:33:46.883526 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application with Lock( Oct 27 09:33:46.883526 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 09:33:46.883526 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._enter() Oct 27 09:33:46.883526 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 09:33:46.883526 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 09:33:46.883526 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 09:33:46.883526 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.creator() Oct 27 09:33:46.884392 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 09:33:46.884392 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application created_value = creator( Oct 27 09:33:46.884392 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 27 09:33:46.884392 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 27 09:33:46.884392 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 27 09:33:46.884392 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 27 09:33:46.884392 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 27 09:33:46.884392 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 27 09:33:46.884392 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Oct 27 09:33:46.884392 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application Oct 27 09:33:46.884392 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 190/404] 10.222.0.65 () {56 vars in 1102 bytes} [Thu Oct 27 09:33:46 2022] GET /identity/v3/users/neutron => generated 85 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 09:33:46.884926 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9097799-6a1c-4ae4-bc04-424c693677f7 None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:33:46.893461 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application [None req-03c5883d-44d6-4f09-8328-3c463af22d03 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 27 09:33:46.893461 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 09:33:46.893461 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 09:33:46.893461 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 09:33:46.893461 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 09:33:46.893461 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 09:33:46.893461 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 09:33:46.893461 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 09:33:46.893461 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 09:33:46.893461 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 09:33:46.893461 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 09:33:46.893461 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 09:33:46.893461 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 27 09:33:46.893461 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 27 09:33:46.893461 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 27 09:33:46.894330 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 27 09:33:46.894330 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 09:33:46.894330 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 09:33:46.894330 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 09:33:46.894330 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 09:33:46.894330 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 09:33:46.894330 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 09:33:46.894330 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 09:33:46.894330 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application with Lock( Oct 27 09:33:46.894330 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 09:33:46.894330 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._enter() Oct 27 09:33:46.894330 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 09:33:46.894330 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 09:33:46.894330 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 09:33:46.894330 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.creator() Oct 27 09:33:46.894330 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 09:33:46.894330 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application created_value = creator( Oct 27 09:33:46.895220 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 27 09:33:46.895220 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 27 09:33:46.895220 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 27 09:33:46.895220 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 27 09:33:46.895220 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 27 09:33:46.895220 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 27 09:33:46.895220 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 27 09:33:46.895220 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application Oct 27 09:33:46.895220 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 215/405] 10.222.0.65 () {56 vars in 1111 bytes} [Thu Oct 27 09:33:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 09:33:46.896033 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c5883d-44d6-4f09-8328-3c463af22d03 None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:33:46.987220 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:33:46.992951 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:33:47.009833 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9097799-6a1c-4ae4-bc04-424c693677f7 None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:33:47.013955 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c5883d-44d6-4f09-8328-3c463af22d03 None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:33:47.052307 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b616e154-acf0-4b43-afe5-e0571cced057 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:33:47.052633 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28666ab9-1c9c-4c28-a58a-c166f861ecf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:33:47.053150 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b616e154-acf0-4b43-afe5-e0571cced057 None admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:33:47.053290 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b616e154-acf0-4b43-afe5-e0571cced057 None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:33:47.053376 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28666ab9-1c9c-4c28-a58a-c166f861ecf7 None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:33:47.053571 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b616e154-acf0-4b43-afe5-e0571cced057 None admin] PATH_INFO: `/v3/projects/dc2e3a7a1bcc480891c0b433291c00b1/users/fd0d23ef039d4f1591a589d302ef165f/roles/8d728ccbaa534a949df6711b47151356` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:33:47.053729 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28666ab9-1c9c-4c28-a58a-c166f861ecf7 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:33:47.054140 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28666ab9-1c9c-4c28-a58a-c166f861ecf7 None admin] PATH_INFO: `/v3/domains` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:33:47.055041 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28666ab9-1c9c-4c28-a58a-c166f861ecf7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 09:33:47.055869 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28666ab9-1c9c-4c28-a58a-c166f861ecf7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:33:47.057314 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28666ab9-1c9c-4c28-a58a-c166f861ecf7 None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:33:47.070238 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b616e154-acf0-4b43-afe5-e0571cced057 None admin] RBAC: Authorizing `identity:create_grant(project_id=dc2e3a7a1bcc480891c0b433291c00b1, user_id=fd0d23ef039d4f1591a589d302ef165f, role_id=8d728ccbaa534a949df6711b47151356)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:33:47.070899 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 191/406] 10.222.0.65 () {56 vars in 1109 bytes} [Thu Oct 27 09:33:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 09:33:47.071790 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28666ab9-1c9c-4c28-a58a-c166f861ecf7 None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:33:47.072342 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b616e154-acf0-4b43-afe5-e0571cced057 None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:33:47.178009 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 216/407] 10.222.0.65 () {58 vars in 1439 bytes} [Thu Oct 27 09:33:46 2022] PUT /identity/v3/projects/dc2e3a7a1bcc480891c0b433291c00b1/users/fd0d23ef039d4f1591a589d302ef165f/roles/8d728ccbaa534a949df6711b47151356 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 09:33:47.178905 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b616e154-acf0-4b43-afe5-e0571cced057 None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:33:47.188928 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28666ab9-1c9c-4c28-a58a-c166f861ecf7 None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:33:47.253198 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3b23de-c561-4343-825f-cf6607222b0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:33:47.254666 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3b23de-c561-4343-825f-cf6607222b0e None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:33:47.255282 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3b23de-c561-4343-825f-cf6607222b0e None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:33:47.255844 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3b23de-c561-4343-825f-cf6607222b0e None admin] PATH_INFO: `/v3/users` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:33:47.257635 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3b23de-c561-4343-825f-cf6607222b0e None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 09:33:47.258234 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3b23de-c561-4343-825f-cf6607222b0e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:33:47.260587 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3b23de-c561-4343-825f-cf6607222b0e None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:33:47.289050 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 192/408] 10.222.0.65 () {56 vars in 1139 bytes} [Thu Oct 27 09:33:47 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 09:33:47.291041 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3b23de-c561-4343-825f-cf6607222b0e None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:33:47.296301 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:33:47.319104 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b616e154-acf0-4b43-afe5-e0571cced057 None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:33:47.355044 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:33:47.376860 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc244852-90e5-4a3a-bc8d-2c0e8c5e2fa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:33:47.377130 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc244852-90e5-4a3a-bc8d-2c0e8c5e2fa7 None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:33:47.377357 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc244852-90e5-4a3a-bc8d-2c0e8c5e2fa7 None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:33:47.377588 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc244852-90e5-4a3a-bc8d-2c0e8c5e2fa7 None admin] PATH_INFO: `/v3/projects` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:33:47.378401 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc244852-90e5-4a3a-bc8d-2c0e8c5e2fa7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 09:33:47.378608 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc244852-90e5-4a3a-bc8d-2c0e8c5e2fa7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:33:47.380083 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc244852-90e5-4a3a-bc8d-2c0e8c5e2fa7 None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:33:47.399002 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 217/409] 10.222.0.65 () {56 vars in 1148 bytes} [Thu Oct 27 09:33:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 09:33:47.399672 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc244852-90e5-4a3a-bc8d-2c0e8c5e2fa7 None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:33:47.439615 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3b23de-c561-4343-825f-cf6607222b0e None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:33:47.487468 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267c411c-761b-4702-a996-6f9e8d272b16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:33:47.488675 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267c411c-761b-4702-a996-6f9e8d272b16 None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:33:47.489144 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267c411c-761b-4702-a996-6f9e8d272b16 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:33:47.490148 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267c411c-761b-4702-a996-6f9e8d272b16 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:33:47.500977 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267c411c-761b-4702-a996-6f9e8d272b16 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:33:47.503424 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267c411c-761b-4702-a996-6f9e8d272b16 None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:33:47.507493 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc244852-90e5-4a3a-bc8d-2c0e8c5e2fa7 None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:33:47.523016 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application [None req-267c411c-761b-4702-a996-6f9e8d272b16 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 27 09:33:47.523016 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 09:33:47.523016 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 09:33:47.523016 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 09:33:47.523016 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 09:33:47.523016 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 09:33:47.523016 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 09:33:47.523016 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 09:33:47.523016 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 09:33:47.523016 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 09:33:47.523016 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 09:33:47.523016 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 09:33:47.523016 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 27 09:33:47.523016 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 27 09:33:47.523016 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 27 09:33:47.523877 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 27 09:33:47.523877 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 09:33:47.523877 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 09:33:47.523877 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 09:33:47.523877 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 09:33:47.523877 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 09:33:47.523877 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 09:33:47.523877 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 09:33:47.523877 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application with Lock( Oct 27 09:33:47.523877 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 09:33:47.523877 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._enter() Oct 27 09:33:47.523877 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 09:33:47.523877 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 09:33:47.523877 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 09:33:47.523877 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.creator() Oct 27 09:33:47.523877 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 09:33:47.523877 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application created_value = creator( Oct 27 09:33:47.524696 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 27 09:33:47.524696 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 27 09:33:47.524696 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 27 09:33:47.524696 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 27 09:33:47.524696 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 27 09:33:47.524696 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 27 09:33:47.524696 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 27 09:33:47.524696 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application Oct 27 09:33:47.532804 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 193/410] 10.222.0.65 () {56 vars in 1111 bytes} [Thu Oct 27 09:33:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 09:33:47.532804 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267c411c-761b-4702-a996-6f9e8d272b16 None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:33:47.553175 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec5ac2e-5225-4525-a95c-b7e366c8efc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:33:47.553949 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec5ac2e-5225-4525-a95c-b7e366c8efc1 None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:33:47.554365 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec5ac2e-5225-4525-a95c-b7e366c8efc1 None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:33:47.554948 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec5ac2e-5225-4525-a95c-b7e366c8efc1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:33:47.567954 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec5ac2e-5225-4525-a95c-b7e366c8efc1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:33:47.569638 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec5ac2e-5225-4525-a95c-b7e366c8efc1 None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:33:47.585922 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application [None req-9ec5ac2e-5225-4525-a95c-b7e366c8efc1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 09:33:47.585922 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 09:33:47.585922 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 09:33:47.585922 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 09:33:47.585922 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 09:33:47.585922 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 09:33:47.585922 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 09:33:47.585922 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 09:33:47.585922 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 09:33:47.585922 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 09:33:47.585922 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 09:33:47.585922 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 09:33:47.585922 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 27 09:33:47.585922 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 27 09:33:47.585922 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 27 09:33:47.585922 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 27 09:33:47.590561 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 09:33:47.590561 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 09:33:47.590561 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 09:33:47.590561 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 09:33:47.590561 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 09:33:47.590561 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 09:33:47.590561 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 09:33:47.590561 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application with Lock( Oct 27 09:33:47.590561 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 09:33:47.590561 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._enter() Oct 27 09:33:47.590561 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 09:33:47.590561 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 09:33:47.590561 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 09:33:47.590561 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.creator() Oct 27 09:33:47.590561 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 09:33:47.590561 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application created_value = creator( Oct 27 09:33:47.590561 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 27 09:33:47.591402 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 27 09:33:47.591402 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 09:33:47.591402 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application Oct 27 09:33:47.591402 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 218/411] 10.222.0.65 () {56 vars in 1108 bytes} [Thu Oct 27 09:33:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 09:33:47.593430 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec5ac2e-5225-4525-a95c-b7e366c8efc1 None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:33:47.615682 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:33:47.639025 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:33:47.659707 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267c411c-761b-4702-a996-6f9e8d272b16 None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:33:47.698275 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113fc217-1d2d-4c67-beef-32fffa63ab03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:33:47.699395 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113fc217-1d2d-4c67-beef-32fffa63ab03 None admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:33:47.699987 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113fc217-1d2d-4c67-beef-32fffa63ab03 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:33:47.700314 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113fc217-1d2d-4c67-beef-32fffa63ab03 None admin] PATH_INFO: `/v3/projects/dc2e3a7a1bcc480891c0b433291c00b1/users/c4b0886666584397be686ee02a505269/roles/8d728ccbaa534a949df6711b47151356` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:33:47.717398 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113fc217-1d2d-4c67-beef-32fffa63ab03 None admin] RBAC: Authorizing `identity:create_grant(project_id=dc2e3a7a1bcc480891c0b433291c00b1, user_id=c4b0886666584397be686ee02a505269, role_id=8d728ccbaa534a949df6711b47151356)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:33:47.717746 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec5ac2e-5225-4525-a95c-b7e366c8efc1 None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:33:47.719357 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113fc217-1d2d-4c67-beef-32fffa63ab03 None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:33:47.755000 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfcca0f-1430-4803-9ae7-d5576687ee18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:33:47.755615 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfcca0f-1430-4803-9ae7-d5576687ee18 None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:33:47.755895 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfcca0f-1430-4803-9ae7-d5576687ee18 None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:33:47.756168 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfcca0f-1430-4803-9ae7-d5576687ee18 None admin] PATH_INFO: `/v3/projects` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:33:47.756886 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfcca0f-1430-4803-9ae7-d5576687ee18 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 09:33:47.757152 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfcca0f-1430-4803-9ae7-d5576687ee18 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:33:47.758618 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfcca0f-1430-4803-9ae7-d5576687ee18 None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:33:47.771434 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 219/412] 10.222.0.65 () {56 vars in 1148 bytes} [Thu Oct 27 09:33:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 09:33:47.776562 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfcca0f-1430-4803-9ae7-d5576687ee18 None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:33:47.805424 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 194/413] 10.222.0.65 () {58 vars in 1439 bytes} [Thu Oct 27 09:33:47 2022] PUT /identity/v3/projects/dc2e3a7a1bcc480891c0b433291c00b1/users/c4b0886666584397be686ee02a505269/roles/8d728ccbaa534a949df6711b47151356 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 09:33:47.807379 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113fc217-1d2d-4c67-beef-32fffa63ab03 None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:33:47.938342 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113fc217-1d2d-4c67-beef-32fffa63ab03 None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:33:47.958999 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:33:47.984372 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519c1897-b949-495a-b853-fd1bad5b8f1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:33:47.985343 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519c1897-b949-495a-b853-fd1bad5b8f1a None admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:33:47.985766 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519c1897-b949-495a-b853-fd1bad5b8f1a None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:33:47.986280 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519c1897-b949-495a-b853-fd1bad5b8f1a None admin] PATH_INFO: `/v3/projects/dc2e3a7a1bcc480891c0b433291c00b1/users/b8e5d5f04c4741bb86ca4a0f667d4ec0/roles/8d728ccbaa534a949df6711b47151356` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:33:47.997071 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:33:48.006393 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfcca0f-1430-4803-9ae7-d5576687ee18 None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:33:48.012645 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519c1897-b949-495a-b853-fd1bad5b8f1a None admin] RBAC: Authorizing `identity:create_grant(project_id=dc2e3a7a1bcc480891c0b433291c00b1, user_id=b8e5d5f04c4741bb86ca4a0f667d4ec0, role_id=8d728ccbaa534a949df6711b47151356)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:33:48.014350 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519c1897-b949-495a-b853-fd1bad5b8f1a None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:33:48.053087 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f918e9c1-06b7-47f2-9143-c38bff06f670 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:33:48.053646 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f918e9c1-06b7-47f2-9143-c38bff06f670 None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:33:48.053804 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f918e9c1-06b7-47f2-9143-c38bff06f670 None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:33:48.054022 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f918e9c1-06b7-47f2-9143-c38bff06f670 None admin] PATH_INFO: `/v3/domains` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:33:48.055294 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f918e9c1-06b7-47f2-9143-c38bff06f670 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 09:33:48.055294 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f918e9c1-06b7-47f2-9143-c38bff06f670 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:33:48.056463 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f918e9c1-06b7-47f2-9143-c38bff06f670 None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:33:48.069865 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 220/414] 10.222.0.65 () {56 vars in 1109 bytes} [Thu Oct 27 09:33:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 09:33:48.075596 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f918e9c1-06b7-47f2-9143-c38bff06f670 None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:33:48.106929 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 195/415] 10.222.0.65 () {58 vars in 1439 bytes} [Thu Oct 27 09:33:47 2022] PUT /identity/v3/projects/dc2e3a7a1bcc480891c0b433291c00b1/users/b8e5d5f04c4741bb86ca4a0f667d4ec0/roles/8d728ccbaa534a949df6711b47151356 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 09:33:48.195088 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f918e9c1-06b7-47f2-9143-c38bff06f670 None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:33:48.235891 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d7adab-e026-4300-8ea2-052496cf747e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:33:48.236862 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d7adab-e026-4300-8ea2-052496cf747e None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:33:48.237321 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d7adab-e026-4300-8ea2-052496cf747e None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:33:48.237757 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d7adab-e026-4300-8ea2-052496cf747e None admin] PATH_INFO: `/v3/projects/service` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:33:48.245719 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d7adab-e026-4300-8ea2-052496cf747e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:33:48.247669 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d7adab-e026-4300-8ea2-052496cf747e None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:33:48.259661 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application [None req-28d7adab-e026-4300-8ea2-052496cf747e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 27 09:33:48.259661 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 09:33:48.259661 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 09:33:48.259661 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 09:33:48.259661 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 09:33:48.259661 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 09:33:48.259661 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 09:33:48.259661 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 09:33:48.259661 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 09:33:48.259661 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 09:33:48.259661 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 09:33:48.259661 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 09:33:48.259661 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 27 09:33:48.259661 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 27 09:33:48.259661 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 27 09:33:48.260586 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 27 09:33:48.260586 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 09:33:48.260586 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 09:33:48.260586 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 09:33:48.260586 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 09:33:48.260586 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 09:33:48.260586 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 09:33:48.260586 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 09:33:48.260586 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application with Lock( Oct 27 09:33:48.260586 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 09:33:48.260586 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._enter() Oct 27 09:33:48.260586 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 09:33:48.260586 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 09:33:48.260586 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 09:33:48.260586 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.creator() Oct 27 09:33:48.260586 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 09:33:48.260586 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application created_value = creator( Oct 27 09:33:48.261458 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 27 09:33:48.261458 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 27 09:33:48.261458 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 27 09:33:48.261458 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 27 09:33:48.261458 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 27 09:33:48.261458 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 27 09:33:48.261458 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 27 09:33:48.261458 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application Oct 27 09:33:48.263612 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 221/416] 10.222.0.65 () {56 vars in 1111 bytes} [Thu Oct 27 09:33:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 09:33:48.269570 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519c1897-b949-495a-b853-fd1bad5b8f1a None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:33:48.404667 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519c1897-b949-495a-b853-fd1bad5b8f1a None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:33:48.446893 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48789a0b-e7c5-45c6-837e-cc57147d051e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:33:48.447732 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48789a0b-e7c5-45c6-837e-cc57147d051e None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:33:48.448153 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48789a0b-e7c5-45c6-837e-cc57147d051e None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:33:48.448565 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48789a0b-e7c5-45c6-837e-cc57147d051e None admin] PATH_INFO: `/v3/projects` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:33:48.450508 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48789a0b-e7c5-45c6-837e-cc57147d051e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 09:33:48.451018 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48789a0b-e7c5-45c6-837e-cc57147d051e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:33:48.452590 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48789a0b-e7c5-45c6-837e-cc57147d051e None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:33:48.478184 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 196/417] 10.222.0.65 () {56 vars in 1148 bytes} [Thu Oct 27 09:33:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 09:33:48.484645 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d7adab-e026-4300-8ea2-052496cf747e None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:33:48.533210 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:33:48.601123 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d7adab-e026-4300-8ea2-052496cf747e None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:33:48.651329 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea75a43f-4cdf-47c8-8893-6905d35f5fd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:33:48.652025 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea75a43f-4cdf-47c8-8893-6905d35f5fd8 None admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:33:48.652919 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea75a43f-4cdf-47c8-8893-6905d35f5fd8 None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:33:48.653567 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea75a43f-4cdf-47c8-8893-6905d35f5fd8 None admin] PATH_INFO: `/v3/projects/dc2e3a7a1bcc480891c0b433291c00b1/users/6191cc41efa74f46b49022cf387f7a4c/roles/8d728ccbaa534a949df6711b47151356` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:33:48.677735 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea75a43f-4cdf-47c8-8893-6905d35f5fd8 None admin] RBAC: Authorizing `identity:create_grant(project_id=dc2e3a7a1bcc480891c0b433291c00b1, user_id=6191cc41efa74f46b49022cf387f7a4c, role_id=8d728ccbaa534a949df6711b47151356)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:33:48.679213 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea75a43f-4cdf-47c8-8893-6905d35f5fd8 None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:33:48.762128 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 222/418] 10.222.0.65 () {58 vars in 1439 bytes} [Thu Oct 27 09:33:48 2022] PUT /identity/v3/projects/dc2e3a7a1bcc480891c0b433291c00b1/users/6191cc41efa74f46b49022cf387f7a4c/roles/8d728ccbaa534a949df6711b47151356 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 09:33:49.248101 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6333db5-d547-4c74-a3b9-3f3dec284f72 None None] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:33:49.248623 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6333db5-d547-4c74-a3b9-3f3dec284f72 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:33:49.248726 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6333db5-d547-4c74-a3b9-3f3dec284f72 None None] PATH_INFO: `/` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:33:49.250309 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 197/419] 10.222.0.65 () {54 vars in 927 bytes} [Thu Oct 27 09:33:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 09:33:49.255999 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03434c7f-1df6-441a-b561-7e36539a10c7 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:33:49.256434 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03434c7f-1df6-441a-b561-7e36539a10c7 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:33:49.256580 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03434c7f-1df6-441a-b561-7e36539a10c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:33:49.278562 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-03434c7f-1df6-441a-b561-7e36539a10c7 None None] MFA Rules not processed for user `b5065084bf664b99bdeac46067cb0f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:33:49.279772 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-03434c7f-1df6-441a-b561-7e36539a10c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:33:49.362066 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:33:49.374495 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 223/420] 10.222.0.65 () {58 vars in 1024 bytes} [Thu Oct 27 09:33:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 27 09:33:49.634040 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56c65ce-695c-471d-9c6c-e1c2677632d4 None None] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:33:49.634226 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56c65ce-695c-471d-9c6c-e1c2677632d4 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:33:49.634506 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56c65ce-695c-471d-9c6c-e1c2677632d4 None None] PATH_INFO: `/` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:33:49.636170 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 198/421] 10.222.0.65 () {54 vars in 927 bytes} [Thu Oct 27 09:33:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 09:33:49.642418 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4035e25-075a-4d43-bcbf-1f28a179815e None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:33:49.642743 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4035e25-075a-4d43-bcbf-1f28a179815e None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:33:49.643029 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4035e25-075a-4d43-bcbf-1f28a179815e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:33:49.662192 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-f4035e25-075a-4d43-bcbf-1f28a179815e None None] MFA Rules not processed for user `b5065084bf664b99bdeac46067cb0f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:33:49.663545 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-f4035e25-075a-4d43-bcbf-1f28a179815e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:33:49.733762 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 224/422] 10.222.0.65 () {58 vars in 1024 bytes} [Thu Oct 27 09:33:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 27 09:33:49.788582 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56c65ce-695c-471d-9c6c-e1c2677632d4 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:33:49.826779 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:33:49.936206 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56c65ce-695c-471d-9c6c-e1c2677632d4 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:33:49.986015 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6178c6a8-f0e3-4f4b-af76-3347ea178d71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:33:49.986680 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6178c6a8-f0e3-4f4b-af76-3347ea178d71 None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:33:49.986962 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6178c6a8-f0e3-4f4b-af76-3347ea178d71 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:33:49.987237 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6178c6a8-f0e3-4f4b-af76-3347ea178d71 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:33:50.000491 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6178c6a8-f0e3-4f4b-af76-3347ea178d71 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 09:33:50.005354 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application [None req-6178c6a8-f0e3-4f4b-af76-3347ea178d71 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 27 09:33:50.005354 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 09:33:50.005354 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 09:33:50.005354 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 09:33:50.005354 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 09:33:50.005354 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 09:33:50.005354 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 09:33:50.005354 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 09:33:50.005354 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 09:33:50.005354 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 09:33:50.005354 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 09:33:50.005354 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 09:33:50.005354 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 27 09:33:50.005354 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 27 09:33:50.005354 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 27 09:33:50.005354 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 27 09:33:50.006207 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 27 09:33:50.006207 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 27 09:33:50.006207 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 27 09:33:50.006207 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 27 09:33:50.006207 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 09:33:50.006207 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 09:33:50.006207 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 09:33:50.006207 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 09:33:50.006207 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 09:33:50.006207 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 09:33:50.006207 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 09:33:50.006207 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application with Lock( Oct 27 09:33:50.006207 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 09:33:50.006207 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._enter() Oct 27 09:33:50.006207 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 09:33:50.006207 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 09:33:50.007033 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 09:33:50.007033 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.creator() Oct 27 09:33:50.007033 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 09:33:50.007033 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application created_value = creator( Oct 27 09:33:50.007033 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 27 09:33:50.007033 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 27 09:33:50.007033 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 27 09:33:50.007033 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 27 09:33:50.007033 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 27 09:33:50.007033 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 27 09:33:50.007033 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 27 09:33:50.007033 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application Oct 27 09:33:50.007033 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 199/423] 10.222.0.65 () {56 vars in 1102 bytes} [Thu Oct 27 09:33:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 09:33:50.012683 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4035e25-075a-4d43-bcbf-1f28a179815e None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:33:50.093060 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6178c6a8-f0e3-4f4b-af76-3347ea178d71 None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:33:50.133168 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4035e25-075a-4d43-bcbf-1f28a179815e None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:33:50.163043 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:33:50.177300 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fbb71f-4de3-4e02-8afc-f98aa70a1cfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:33:50.182881 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fbb71f-4de3-4e02-8afc-f98aa70a1cfc None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:33:50.182881 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fbb71f-4de3-4e02-8afc-f98aa70a1cfc None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:33:50.182881 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fbb71f-4de3-4e02-8afc-f98aa70a1cfc None admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:33:50.182881 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6fbb71f-4de3-4e02-8afc-f98aa70a1cfc None admin] RBAC: Adding query filter params (name=service) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 09:33:50.182881 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6fbb71f-4de3-4e02-8afc-f98aa70a1cfc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:33:50.182881 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6fbb71f-4de3-4e02-8afc-f98aa70a1cfc None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:33:50.197780 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 225/424] 10.222.0.65 () {56 vars in 1103 bytes} [Thu Oct 27 09:33:50 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 09:33:50.202350 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fbb71f-4de3-4e02-8afc-f98aa70a1cfc None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:33:50.254315 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:33:50.276588 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6178c6a8-f0e3-4f4b-af76-3347ea178d71 None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:33:50.315872 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e9104b-45a4-42f6-96ac-71bed64a93c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:33:50.316910 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e9104b-45a4-42f6-96ac-71bed64a93c3 None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:33:50.317625 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e9104b-45a4-42f6-96ac-71bed64a93c3 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:33:50.318357 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e9104b-45a4-42f6-96ac-71bed64a93c3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:33:50.323282 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fbb71f-4de3-4e02-8afc-f98aa70a1cfc None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:33:50.335509 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e9104b-45a4-42f6-96ac-71bed64a93c3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 09:33:50.343329 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application [None req-43e9104b-45a4-42f6-96ac-71bed64a93c3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 27 09:33:50.343329 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 09:33:50.343329 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 09:33:50.343329 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 09:33:50.343329 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 09:33:50.343329 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 09:33:50.343329 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 09:33:50.343329 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 09:33:50.343329 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 09:33:50.343329 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 09:33:50.343329 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 09:33:50.343329 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 09:33:50.343329 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 27 09:33:50.343329 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 27 09:33:50.343329 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 27 09:33:50.343329 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 27 09:33:50.344413 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 27 09:33:50.344413 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 27 09:33:50.344413 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 27 09:33:50.344413 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 27 09:33:50.344413 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 09:33:50.344413 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 09:33:50.344413 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 09:33:50.344413 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 09:33:50.344413 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 09:33:50.344413 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 09:33:50.344413 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 09:33:50.344413 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application with Lock( Oct 27 09:33:50.344413 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 09:33:50.344413 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._enter() Oct 27 09:33:50.344413 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 09:33:50.344413 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 09:33:50.345402 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 09:33:50.345402 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.creator() Oct 27 09:33:50.345402 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 09:33:50.345402 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application created_value = creator( Oct 27 09:33:50.345402 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 27 09:33:50.345402 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 27 09:33:50.345402 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 27 09:33:50.345402 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 27 09:33:50.345402 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 27 09:33:50.345402 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 27 09:33:50.345402 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 27 09:33:50.345402 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application Oct 27 09:33:50.347682 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 200/425] 10.222.0.65 () {56 vars in 1102 bytes} [Thu Oct 27 09:33:50 2022] GET /identity/v3/roles/service => generated 85 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 09:33:50.349096 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038d0565-6730-4295-a25d-f06d0f4ae995 None None] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:33:50.350147 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038d0565-6730-4295-a25d-f06d0f4ae995 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:33:50.350618 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038d0565-6730-4295-a25d-f06d0f4ae995 None None] PATH_INFO: `/` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:33:50.352034 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 201/426] 10.222.0.65 () {54 vars in 927 bytes} [Thu Oct 27 09:33:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 09:33:50.356795 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038d0565-6730-4295-a25d-f06d0f4ae995 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:33:50.378705 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc548c2b-1ce8-4f31-8858-0ec5485ec8b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:33:50.379434 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc548c2b-1ce8-4f31-8858-0ec5485ec8b3 None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:33:50.379759 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc548c2b-1ce8-4f31-8858-0ec5485ec8b3 None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:33:50.380100 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc548c2b-1ce8-4f31-8858-0ec5485ec8b3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:33:50.394059 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc548c2b-1ce8-4f31-8858-0ec5485ec8b3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:33:50.395810 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc548c2b-1ce8-4f31-8858-0ec5485ec8b3 None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:33:50.414171 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application [None req-bc548c2b-1ce8-4f31-8858-0ec5485ec8b3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 09:33:50.414171 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 09:33:50.414171 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 09:33:50.414171 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 09:33:50.414171 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 09:33:50.414171 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 09:33:50.414171 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 09:33:50.414171 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 09:33:50.414171 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 09:33:50.414171 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 09:33:50.414171 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 09:33:50.414171 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 09:33:50.414171 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 27 09:33:50.414171 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 27 09:33:50.414171 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 27 09:33:50.414171 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 27 09:33:50.415154 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 09:33:50.415154 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 09:33:50.415154 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 09:33:50.415154 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 09:33:50.415154 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 09:33:50.415154 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 09:33:50.415154 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 09:33:50.415154 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application with Lock( Oct 27 09:33:50.415154 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 09:33:50.415154 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._enter() Oct 27 09:33:50.415154 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 09:33:50.415154 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 09:33:50.415154 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 09:33:50.415154 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.creator() Oct 27 09:33:50.415154 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 09:33:50.415154 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application created_value = creator( Oct 27 09:33:50.415154 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 27 09:33:50.415968 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 27 09:33:50.415968 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 09:33:50.415968 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application Oct 27 09:33:50.415968 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 226/427] 10.222.0.65 () {56 vars in 1108 bytes} [Thu Oct 27 09:33:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 27 09:33:50.418101 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06e3354-7cdb-4179-8cc0-56b027291fa2 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:33:50.418581 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06e3354-7cdb-4179-8cc0-56b027291fa2 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:33:50.418950 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06e3354-7cdb-4179-8cc0-56b027291fa2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:33:50.443140 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-a06e3354-7cdb-4179-8cc0-56b027291fa2 None None] MFA Rules not processed for user `b5065084bf664b99bdeac46067cb0f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:33:50.444731 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-a06e3354-7cdb-4179-8cc0-56b027291fa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:33:50.497698 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:33:50.500962 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038d0565-6730-4295-a25d-f06d0f4ae995 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:33:50.541037 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 227/428] 10.222.0.65 () {58 vars in 1024 bytes} [Thu Oct 27 09:33:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 27 09:33:50.542239 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06e3354-7cdb-4179-8cc0-56b027291fa2 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:33:50.546093 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151fb1c5-1a25-4cad-9611-c92837a1fc1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:33:50.547792 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151fb1c5-1a25-4cad-9611-c92837a1fc1c None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:33:50.548179 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151fb1c5-1a25-4cad-9611-c92837a1fc1c None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:33:50.556447 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151fb1c5-1a25-4cad-9611-c92837a1fc1c None admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:33:50.556447 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151fb1c5-1a25-4cad-9611-c92837a1fc1c None admin] RBAC: Adding query filter params (name=service) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 09:33:50.556447 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151fb1c5-1a25-4cad-9611-c92837a1fc1c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:33:50.556447 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151fb1c5-1a25-4cad-9611-c92837a1fc1c None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:33:50.570568 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 202/429] 10.222.0.65 () {56 vars in 1103 bytes} [Thu Oct 27 09:33:50 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 09:33:50.572224 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151fb1c5-1a25-4cad-9611-c92837a1fc1c None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:33:50.578775 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:33:50.681759 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06e3354-7cdb-4179-8cc0-56b027291fa2 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:33:50.700424 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151fb1c5-1a25-4cad-9611-c92837a1fc1c None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:33:50.735566 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce8ec86-bab4-4df9-90d6-86298c6c9205 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:33:50.736200 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce8ec86-bab4-4df9-90d6-86298c6c9205 None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:33:50.736483 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce8ec86-bab4-4df9-90d6-86298c6c9205 None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:33:50.736757 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce8ec86-bab4-4df9-90d6-86298c6c9205 None admin] PATH_INFO: `/v3/domains` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:33:50.739819 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce8ec86-bab4-4df9-90d6-86298c6c9205 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 09:33:50.740135 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce8ec86-bab4-4df9-90d6-86298c6c9205 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:33:50.741539 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce8ec86-bab4-4df9-90d6-86298c6c9205 None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:33:50.758904 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b47b083-1d69-4655-996c-f39268e5b6bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:33:50.759500 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b47b083-1d69-4655-996c-f39268e5b6bb None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:33:50.759785 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b47b083-1d69-4655-996c-f39268e5b6bb None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:33:50.760061 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b47b083-1d69-4655-996c-f39268e5b6bb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:33:50.766202 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 228/430] 10.222.0.65 () {56 vars in 1109 bytes} [Thu Oct 27 09:33:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 09:33:50.772614 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce8ec86-bab4-4df9-90d6-86298c6c9205 None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:33:50.784892 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b47b083-1d69-4655-996c-f39268e5b6bb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:33:50.786379 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b47b083-1d69-4655-996c-f39268e5b6bb None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:33:50.821030 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application [None req-4b47b083-1d69-4655-996c-f39268e5b6bb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 09:33:50.821030 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 09:33:50.821030 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 09:33:50.821030 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 09:33:50.821030 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 09:33:50.821030 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 09:33:50.821030 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 09:33:50.821030 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 09:33:50.821030 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 09:33:50.821030 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 09:33:50.821030 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 09:33:50.821030 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 09:33:50.821030 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 27 09:33:50.821030 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 27 09:33:50.821030 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 27 09:33:50.821030 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 27 09:33:50.821954 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 09:33:50.821954 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 09:33:50.821954 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 09:33:50.821954 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 09:33:50.821954 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 09:33:50.821954 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 09:33:50.821954 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 09:33:50.821954 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application with Lock( Oct 27 09:33:50.821954 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 09:33:50.821954 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._enter() Oct 27 09:33:50.821954 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 09:33:50.821954 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 09:33:50.821954 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 09:33:50.821954 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.creator() Oct 27 09:33:50.821954 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 09:33:50.821954 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application created_value = creator( Oct 27 09:33:50.821954 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 27 09:33:50.822821 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 27 09:33:50.822821 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 09:33:50.822821 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application Oct 27 09:33:50.822821 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 203/431] 10.222.0.65 () {56 vars in 1108 bytes} [Thu Oct 27 09:33:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 09:33:50.832654 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:33:50.835432 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b47b083-1d69-4655-996c-f39268e5b6bb None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:33:50.923894 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:33:50.928323 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce8ec86-bab4-4df9-90d6-86298c6c9205 None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:33:50.965518 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b311e1-facf-424d-b86b-ffc5e63c1232 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:33:50.966159 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b311e1-facf-424d-b86b-ffc5e63c1232 None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:33:50.966440 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b311e1-facf-424d-b86b-ffc5e63c1232 None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:33:50.966745 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b311e1-facf-424d-b86b-ffc5e63c1232 None admin] PATH_INFO: `/v3/users/swift` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:33:50.975566 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b311e1-facf-424d-b86b-ffc5e63c1232 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:33:50.977150 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b311e1-facf-424d-b86b-ffc5e63c1232 None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:33:50.989983 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application [None req-b6b311e1-facf-424d-b86b-ffc5e63c1232 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 27 09:33:50.989983 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 09:33:50.989983 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 09:33:50.989983 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 09:33:50.989983 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 09:33:50.989983 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 09:33:50.989983 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 09:33:50.989983 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 09:33:50.989983 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 09:33:50.989983 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 09:33:50.989983 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 09:33:50.989983 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 09:33:50.989983 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 27 09:33:50.989983 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 27 09:33:50.989983 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 27 09:33:50.989983 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 27 09:33:50.990972 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 09:33:50.990972 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 09:33:50.990972 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 27 09:33:50.990972 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 27 09:33:50.990972 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 27 09:33:50.990972 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 27 09:33:50.990972 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 09:33:50.990972 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 09:33:50.990972 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 09:33:50.990972 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 09:33:50.990972 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 09:33:50.990972 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application with Lock( Oct 27 09:33:50.990972 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 09:33:50.990972 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._enter() Oct 27 09:33:50.990972 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 09:33:50.990972 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 09:33:50.990972 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 09:33:50.990972 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.creator() Oct 27 09:33:50.991853 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 09:33:50.991853 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application created_value = creator( Oct 27 09:33:50.991853 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 27 09:33:50.991853 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 27 09:33:50.991853 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 27 09:33:50.991853 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 27 09:33:50.991853 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 27 09:33:50.991853 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 27 09:33:50.991853 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 27 09:33:50.991853 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application Oct 27 09:33:50.991853 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 229/432] 10.222.0.65 () {56 vars in 1096 bytes} [Thu Oct 27 09:33:50 2022] GET /identity/v3/users/swift => generated 83 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 09:33:50.999476 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b311e1-facf-424d-b86b-ffc5e63c1232 None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:33:51.004189 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b47b083-1d69-4655-996c-f39268e5b6bb None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:33:51.047700 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0ba89f-378b-4670-83d7-453c53a0c789 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:33:51.048226 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0ba89f-378b-4670-83d7-453c53a0c789 None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:33:51.048522 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0ba89f-378b-4670-83d7-453c53a0c789 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:33:51.048804 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0ba89f-378b-4670-83d7-453c53a0c789 None admin] PATH_INFO: `/v3/domains` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:33:51.049458 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0ba89f-378b-4670-83d7-453c53a0c789 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 09:33:51.049761 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0ba89f-378b-4670-83d7-453c53a0c789 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:33:51.051171 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0ba89f-378b-4670-83d7-453c53a0c789 None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:33:51.063661 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 204/433] 10.222.0.65 () {56 vars in 1109 bytes} [Thu Oct 27 09:33:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 09:33:51.064958 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a182cd-c1ad-494c-bddc-4312802d60a2 None None] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:33:51.065250 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a182cd-c1ad-494c-bddc-4312802d60a2 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:33:51.065528 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a182cd-c1ad-494c-bddc-4312802d60a2 None None] PATH_INFO: `/` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:33:51.070637 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 205/434] 10.222.0.65 () {54 vars in 927 bytes} [Thu Oct 27 09:33:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 09:33:51.070637 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a182cd-c1ad-494c-bddc-4312802d60a2 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:33:51.110993 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:33:51.123433 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b311e1-facf-424d-b86b-ffc5e63c1232 None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:33:51.161268 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd82440-9d96-4b79-be81-a667661a6b12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:33:51.161869 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd82440-9d96-4b79-be81-a667661a6b12 None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:33:51.162152 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd82440-9d96-4b79-be81-a667661a6b12 None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:33:51.162427 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd82440-9d96-4b79-be81-a667661a6b12 None admin] PATH_INFO: `/v3/users` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:33:51.163193 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd82440-9d96-4b79-be81-a667661a6b12 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 09:33:51.163502 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd82440-9d96-4b79-be81-a667661a6b12 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:33:51.164944 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd82440-9d96-4b79-be81-a667661a6b12 None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:33:51.184105 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 230/435] 10.222.0.65 () {56 vars in 1135 bytes} [Thu Oct 27 09:33:50 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 09:33:51.185228 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd82440-9d96-4b79-be81-a667661a6b12 None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:33:51.190279 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a182cd-c1ad-494c-bddc-4312802d60a2 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:33:51.208787 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:33:51.227197 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64f0853-8d13-4e1a-a033-346e8de97ef4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:33:51.227821 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64f0853-8d13-4e1a-a033-346e8de97ef4 None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:33:51.228146 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64f0853-8d13-4e1a-a033-346e8de97ef4 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:33:51.228384 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64f0853-8d13-4e1a-a033-346e8de97ef4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:33:51.238962 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64f0853-8d13-4e1a-a033-346e8de97ef4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 09:33:51.244074 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application [None req-a64f0853-8d13-4e1a-a033-346e8de97ef4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 27 09:33:51.244074 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 09:33:51.244074 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 09:33:51.244074 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 09:33:51.244074 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 09:33:51.244074 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 09:33:51.244074 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 09:33:51.244074 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 09:33:51.244074 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 09:33:51.244074 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 09:33:51.244074 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 09:33:51.244074 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 09:33:51.244074 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 27 09:33:51.244074 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 27 09:33:51.244074 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 27 09:33:51.244074 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 27 09:33:51.245109 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 27 09:33:51.245109 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 27 09:33:51.245109 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 27 09:33:51.245109 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 27 09:33:51.245109 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 09:33:51.245109 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 09:33:51.245109 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 09:33:51.245109 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 09:33:51.245109 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 09:33:51.245109 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 09:33:51.245109 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 09:33:51.245109 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application with Lock( Oct 27 09:33:51.245109 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 09:33:51.245109 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._enter() Oct 27 09:33:51.245109 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 09:33:51.245109 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 09:33:51.246769 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 09:33:51.246769 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.creator() Oct 27 09:33:51.246769 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 09:33:51.246769 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application created_value = creator( Oct 27 09:33:51.246769 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 27 09:33:51.246769 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 27 09:33:51.246769 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 27 09:33:51.246769 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 27 09:33:51.246769 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 27 09:33:51.246769 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 27 09:33:51.246769 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 27 09:33:51.246769 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application Oct 27 09:33:51.250269 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 206/436] 10.222.0.65 () {56 vars in 1102 bytes} [Thu Oct 27 09:33:51 2022] GET /identity/v3/roles/service => generated 85 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 09:33:51.251484 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d06d31-ec9a-4ada-9c26-098c5f558901 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:33:51.251764 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d06d31-ec9a-4ada-9c26-098c5f558901 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:33:51.252034 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d06d31-ec9a-4ada-9c26-098c5f558901 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:33:51.272459 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-94d06d31-ec9a-4ada-9c26-098c5f558901 None None] MFA Rules not processed for user `b5065084bf664b99bdeac46067cb0f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:33:51.273660 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-94d06d31-ec9a-4ada-9c26-098c5f558901 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:33:51.303181 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd82440-9d96-4b79-be81-a667661a6b12 None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:33:51.343383 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7ae09b-509b-43fc-875c-8bee74d014ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:33:51.344025 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7ae09b-509b-43fc-875c-8bee74d014ee None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:33:51.344343 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7ae09b-509b-43fc-875c-8bee74d014ee None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:33:51.344630 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7ae09b-509b-43fc-875c-8bee74d014ee None admin] PATH_INFO: `/v3/users/nova` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:33:51.352295 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 207/437] 10.222.0.65 () {58 vars in 1024 bytes} [Thu Oct 27 09:33:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 27 09:33:51.352528 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7ae09b-509b-43fc-875c-8bee74d014ee None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:33:51.353820 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7ae09b-509b-43fc-875c-8bee74d014ee None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:33:51.354545 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d06d31-ec9a-4ada-9c26-098c5f558901 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:33:51.376608 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application [None req-7c7ae09b-509b-43fc-875c-8bee74d014ee None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 27 09:33:51.376608 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 09:33:51.376608 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 09:33:51.376608 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 09:33:51.376608 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 09:33:51.376608 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 09:33:51.376608 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 09:33:51.376608 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 09:33:51.376608 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 09:33:51.376608 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 09:33:51.376608 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 09:33:51.376608 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 09:33:51.376608 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 27 09:33:51.376608 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 27 09:33:51.376608 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 27 09:33:51.376608 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 27 09:33:51.377537 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 09:33:51.377537 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 09:33:51.377537 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 27 09:33:51.377537 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 27 09:33:51.377537 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 27 09:33:51.377537 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 27 09:33:51.377537 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 09:33:51.377537 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 09:33:51.377537 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 09:33:51.377537 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 09:33:51.377537 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 09:33:51.377537 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application with Lock( Oct 27 09:33:51.377537 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 09:33:51.377537 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._enter() Oct 27 09:33:51.377537 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 09:33:51.377537 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 09:33:51.377537 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 09:33:51.377537 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.creator() Oct 27 09:33:51.378428 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 09:33:51.378428 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application created_value = creator( Oct 27 09:33:51.378428 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 27 09:33:51.378428 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 27 09:33:51.378428 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 27 09:33:51.378428 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 27 09:33:51.378428 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 27 09:33:51.378428 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 27 09:33:51.378428 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 27 09:33:51.378428 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application Oct 27 09:33:51.387935 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 231/438] 10.222.0.65 () {56 vars in 1093 bytes} [Thu Oct 27 09:33:51 2022] GET /identity/v3/users/nova => generated 82 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 09:33:51.387935 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7ae09b-509b-43fc-875c-8bee74d014ee None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:33:51.408200 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:33:51.487297 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d06d31-ec9a-4ada-9c26-098c5f558901 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:33:51.496575 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:33:51.526170 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357dc92c-dbe1-4a42-87aa-101d30643aa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:33:51.527162 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357dc92c-dbe1-4a42-87aa-101d30643aa2 None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:33:51.527782 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357dc92c-dbe1-4a42-87aa-101d30643aa2 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:33:51.527974 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357dc92c-dbe1-4a42-87aa-101d30643aa2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:33:51.540141 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357dc92c-dbe1-4a42-87aa-101d30643aa2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:33:51.540966 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7ae09b-509b-43fc-875c-8bee74d014ee None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:33:51.541772 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357dc92c-dbe1-4a42-87aa-101d30643aa2 None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:33:51.559571 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application [None req-357dc92c-dbe1-4a42-87aa-101d30643aa2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 09:33:51.559571 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 09:33:51.559571 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 09:33:51.559571 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 09:33:51.559571 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 09:33:51.559571 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 09:33:51.559571 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 09:33:51.559571 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 09:33:51.559571 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 09:33:51.559571 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 09:33:51.559571 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 09:33:51.559571 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 09:33:51.559571 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 27 09:33:51.559571 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 27 09:33:51.559571 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 27 09:33:51.559571 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 27 09:33:51.560729 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 09:33:51.560729 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 09:33:51.560729 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 09:33:51.560729 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 09:33:51.560729 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 09:33:51.560729 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 09:33:51.560729 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 09:33:51.560729 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application with Lock( Oct 27 09:33:51.560729 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 09:33:51.560729 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._enter() Oct 27 09:33:51.560729 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 09:33:51.560729 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 09:33:51.560729 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 09:33:51.560729 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.creator() Oct 27 09:33:51.560729 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 09:33:51.560729 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application created_value = creator( Oct 27 09:33:51.560729 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 27 09:33:51.561782 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 27 09:33:51.561782 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 09:33:51.561782 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application Oct 27 09:33:51.563667 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 208/439] 10.222.0.65 () {56 vars in 1108 bytes} [Thu Oct 27 09:33:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 09:33:51.564775 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357dc92c-dbe1-4a42-87aa-101d30643aa2 None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:33:51.583327 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8900cf-44db-491c-957e-4e588eb5efb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:33:51.584109 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8900cf-44db-491c-957e-4e588eb5efb8 None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:33:51.584461 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8900cf-44db-491c-957e-4e588eb5efb8 None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:33:51.584805 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8900cf-44db-491c-957e-4e588eb5efb8 None admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:33:51.585548 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8900cf-44db-491c-957e-4e588eb5efb8 None admin] RBAC: Adding query filter params (name=service) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 09:33:51.585917 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8900cf-44db-491c-957e-4e588eb5efb8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:33:51.587392 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8900cf-44db-491c-957e-4e588eb5efb8 None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:33:51.596287 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 232/440] 10.222.0.65 () {56 vars in 1103 bytes} [Thu Oct 27 09:33:51 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 09:33:51.601524 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8900cf-44db-491c-957e-4e588eb5efb8 None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:33:51.694768 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:33:51.716505 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357dc92c-dbe1-4a42-87aa-101d30643aa2 None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:33:51.731647 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8900cf-44db-491c-957e-4e588eb5efb8 None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:33:51.758108 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6702b651-812b-49e4-8053-0b75f18f9806 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:33:51.758769 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6702b651-812b-49e4-8053-0b75f18f9806 None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:33:51.759081 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6702b651-812b-49e4-8053-0b75f18f9806 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:33:51.759379 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6702b651-812b-49e4-8053-0b75f18f9806 None admin] PATH_INFO: `/v3/users` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:33:51.760140 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6702b651-812b-49e4-8053-0b75f18f9806 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 09:33:51.760460 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6702b651-812b-49e4-8053-0b75f18f9806 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:33:51.762024 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6702b651-812b-49e4-8053-0b75f18f9806 None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:33:51.775192 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f15ea5e-21ef-46e3-ab6d-0c37a97ccbf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:33:51.776106 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f15ea5e-21ef-46e3-ab6d-0c37a97ccbf0 None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:33:51.776563 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f15ea5e-21ef-46e3-ab6d-0c37a97ccbf0 None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:33:51.777681 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f15ea5e-21ef-46e3-ab6d-0c37a97ccbf0 None admin] PATH_INFO: `/v3/domains` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:33:51.778648 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f15ea5e-21ef-46e3-ab6d-0c37a97ccbf0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 09:33:51.779206 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f15ea5e-21ef-46e3-ab6d-0c37a97ccbf0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:33:51.780603 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f15ea5e-21ef-46e3-ab6d-0c37a97ccbf0 None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:33:51.783376 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 209/441] 10.222.0.65 () {56 vars in 1133 bytes} [Thu Oct 27 09:33:51 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 09:33:51.784218 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6702b651-812b-49e4-8053-0b75f18f9806 None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:33:51.800253 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 233/442] 10.222.0.65 () {56 vars in 1109 bytes} [Thu Oct 27 09:33:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 09:33:51.801478 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f15ea5e-21ef-46e3-ab6d-0c37a97ccbf0 None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:33:51.809637 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:33:51.905000 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6702b651-812b-49e4-8053-0b75f18f9806 None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:33:51.914842 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f15ea5e-21ef-46e3-ab6d-0c37a97ccbf0 None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:33:51.939100 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40694d6-b795-4ea6-a724-8036e8dda0c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:33:51.939726 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40694d6-b795-4ea6-a724-8036e8dda0c0 None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:33:51.940009 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40694d6-b795-4ea6-a724-8036e8dda0c0 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:33:51.940283 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40694d6-b795-4ea6-a724-8036e8dda0c0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:33:51.943847 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:33:51.950221 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaef3bbc-61bf-49cc-a183-50442defdce1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:33:51.950905 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaef3bbc-61bf-49cc-a183-50442defdce1 None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:33:51.951062 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40694d6-b795-4ea6-a724-8036e8dda0c0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:33:51.951180 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaef3bbc-61bf-49cc-a183-50442defdce1 None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:33:51.957123 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaef3bbc-61bf-49cc-a183-50442defdce1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:33:51.957227 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40694d6-b795-4ea6-a724-8036e8dda0c0 None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:33:51.962611 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaef3bbc-61bf-49cc-a183-50442defdce1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 09:33:51.967695 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application [None req-b40694d6-b795-4ea6-a724-8036e8dda0c0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 09:33:51.967695 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 09:33:51.967695 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 09:33:51.967695 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 09:33:51.967695 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 09:33:51.967695 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 09:33:51.967695 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 09:33:51.967695 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 09:33:51.967695 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 09:33:51.967695 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 09:33:51.967695 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 09:33:51.967695 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 09:33:51.967695 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 27 09:33:51.967695 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 27 09:33:51.967695 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 27 09:33:51.967695 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 27 09:33:51.968565 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 09:33:51.968565 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 09:33:51.968565 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 09:33:51.968565 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 09:33:51.968565 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 09:33:51.968565 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 09:33:51.968565 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 09:33:51.968565 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application with Lock( Oct 27 09:33:51.968565 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 09:33:51.968565 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._enter() Oct 27 09:33:51.968565 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 09:33:51.968565 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 09:33:51.968565 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 09:33:51.968565 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.creator() Oct 27 09:33:51.968565 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 09:33:51.968565 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application created_value = creator( Oct 27 09:33:51.968565 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 27 09:33:51.969381 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 27 09:33:51.969381 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 09:33:51.969381 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application Oct 27 09:33:51.969539 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application [None req-aaef3bbc-61bf-49cc-a183-50442defdce1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 27 09:33:51.969539 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 09:33:51.969539 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 09:33:51.969539 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 09:33:51.969539 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 09:33:51.969539 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 09:33:51.969539 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 09:33:51.969539 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 09:33:51.969539 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 09:33:51.969539 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 09:33:51.969539 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 09:33:51.969539 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 09:33:51.969539 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 27 09:33:51.969539 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 27 09:33:51.969539 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 27 09:33:51.969539 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 27 09:33:51.970279 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 27 09:33:51.970279 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 27 09:33:51.970279 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 27 09:33:51.970279 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 27 09:33:51.970279 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 09:33:51.970279 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 09:33:51.970279 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 09:33:51.970279 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 09:33:51.970279 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 09:33:51.970279 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 09:33:51.970279 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 09:33:51.970279 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application with Lock( Oct 27 09:33:51.970279 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 09:33:51.970279 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._enter() Oct 27 09:33:51.970279 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 09:33:51.970279 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 09:33:51.971106 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 09:33:51.971106 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.creator() Oct 27 09:33:51.971106 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 09:33:51.971106 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application created_value = creator( Oct 27 09:33:51.971106 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 27 09:33:51.971106 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 27 09:33:51.971106 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 27 09:33:51.971106 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 27 09:33:51.971106 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 27 09:33:51.971106 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 27 09:33:51.971106 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 27 09:33:51.971106 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application Oct 27 09:33:51.971677 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 210/443] 10.222.0.65 () {56 vars in 1108 bytes} [Thu Oct 27 09:33:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 09:33:51.971677 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40694d6-b795-4ea6-a724-8036e8dda0c0 None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:33:51.974179 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 234/444] 10.222.0.65 () {56 vars in 1102 bytes} [Thu Oct 27 09:33:51 2022] GET /identity/v3/roles/service => generated 85 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 09:33:51.975116 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaef3bbc-61bf-49cc-a183-50442defdce1 None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:33:52.044384 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:33:52.076587 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaef3bbc-61bf-49cc-a183-50442defdce1 None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:33:52.078342 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40694d6-b795-4ea6-a724-8036e8dda0c0 None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:33:52.112103 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c13631-dfdc-4ca7-8f0d-6312a0a582aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:33:52.112733 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c13631-dfdc-4ca7-8f0d-6312a0a582aa None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:33:52.113014 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c13631-dfdc-4ca7-8f0d-6312a0a582aa None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:33:52.113104 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8ca1b1-f750-4b36-9ab5-c4004045af45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:33:52.113283 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c13631-dfdc-4ca7-8f0d-6312a0a582aa None admin] PATH_INFO: `/v3/projects/service` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:33:52.113620 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8ca1b1-f750-4b36-9ab5-c4004045af45 None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:33:52.113905 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8ca1b1-f750-4b36-9ab5-c4004045af45 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:33:52.114442 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8ca1b1-f750-4b36-9ab5-c4004045af45 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:33:52.120305 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c13631-dfdc-4ca7-8f0d-6312a0a582aa None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:33:52.122295 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c13631-dfdc-4ca7-8f0d-6312a0a582aa None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:33:52.133471 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application [None req-b0c13631-dfdc-4ca7-8f0d-6312a0a582aa None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 27 09:33:52.133471 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 09:33:52.133471 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 09:33:52.133471 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 09:33:52.133471 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 09:33:52.133471 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 09:33:52.133471 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 09:33:52.133471 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 09:33:52.133471 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 09:33:52.133471 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 09:33:52.133471 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 09:33:52.133471 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 09:33:52.133471 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 27 09:33:52.133471 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 27 09:33:52.133471 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 27 09:33:52.134333 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 27 09:33:52.134333 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 09:33:52.134333 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 09:33:52.134333 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 09:33:52.134333 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 09:33:52.134333 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 09:33:52.134333 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 09:33:52.134333 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 09:33:52.134333 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application with Lock( Oct 27 09:33:52.134333 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 09:33:52.134333 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._enter() Oct 27 09:33:52.134333 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 09:33:52.134333 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 09:33:52.134333 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 09:33:52.134333 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.creator() Oct 27 09:33:52.134333 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 09:33:52.134333 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application created_value = creator( Oct 27 09:33:52.135239 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 27 09:33:52.135239 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 27 09:33:52.135239 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 27 09:33:52.135239 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 27 09:33:52.135239 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 27 09:33:52.135239 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 27 09:33:52.135239 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 27 09:33:52.135239 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application Oct 27 09:33:52.135239 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 235/445] 10.222.0.65 () {56 vars in 1111 bytes} [Thu Oct 27 09:33:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 09:33:52.135816 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8c3cfb-8d77-4894-bf66-0f3d10bb42a6 None None] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:33:52.136702 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8c3cfb-8d77-4894-bf66-0f3d10bb42a6 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:33:52.136967 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8c3cfb-8d77-4894-bf66-0f3d10bb42a6 None None] PATH_INFO: `/` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:33:52.138496 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 236/446] 10.222.0.65 () {54 vars in 927 bytes} [Thu Oct 27 09:33:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 09:33:52.140765 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8c3cfb-8d77-4894-bf66-0f3d10bb42a6 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:33:52.189000 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8ca1b1-f750-4b36-9ab5-c4004045af45 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:33:52.190493 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8ca1b1-f750-4b36-9ab5-c4004045af45 None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:33:52.193671 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:33:52.244491 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8c3cfb-8d77-4894-bf66-0f3d10bb42a6 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:33:52.255635 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:33:52.279578 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323e6b08-567d-4c8c-9013-748ad6b79b12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:33:52.280184 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323e6b08-567d-4c8c-9013-748ad6b79b12 None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:33:52.280463 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323e6b08-567d-4c8c-9013-748ad6b79b12 None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:33:52.280732 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323e6b08-567d-4c8c-9013-748ad6b79b12 None admin] PATH_INFO: `/v3/domains` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:33:52.281364 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323e6b08-567d-4c8c-9013-748ad6b79b12 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 09:33:52.281665 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323e6b08-567d-4c8c-9013-748ad6b79b12 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:33:52.283102 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323e6b08-567d-4c8c-9013-748ad6b79b12 None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:33:52.294678 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 211/447] 10.222.0.65 () {58 vars in 1282 bytes} [Thu Oct 27 09:33:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 27 09:33:52.295201 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 237/448] 10.222.0.65 () {56 vars in 1109 bytes} [Thu Oct 27 09:33:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 09:33:52.295647 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323e6b08-567d-4c8c-9013-748ad6b79b12 None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:33:52.296198 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8ca1b1-f750-4b36-9ab5-c4004045af45 None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:33:52.396267 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8ca1b1-f750-4b36-9ab5-c4004045af45 None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:33:52.397251 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323e6b08-567d-4c8c-9013-748ad6b79b12 None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:33:52.408439 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:33:52.431769 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8834ad-4da6-4eab-8369-d28b7adee884 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:33:52.432365 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8834ad-4da6-4eab-8369-d28b7adee884 None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:33:52.432493 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ff2302-b3ed-4dc0-846d-8982e6b6f16d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:33:52.432642 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8834ad-4da6-4eab-8369-d28b7adee884 None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:33:52.432916 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8834ad-4da6-4eab-8369-d28b7adee884 None admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:33:52.433089 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ff2302-b3ed-4dc0-846d-8982e6b6f16d None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:33:52.433373 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ff2302-b3ed-4dc0-846d-8982e6b6f16d None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:33:52.433561 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8834ad-4da6-4eab-8369-d28b7adee884 None admin] RBAC: Adding query filter params (name=service) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 09:33:52.433770 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ff2302-b3ed-4dc0-846d-8982e6b6f16d None admin] PATH_INFO: `/v3/projects` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:33:52.433864 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8834ad-4da6-4eab-8369-d28b7adee884 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:33:52.434309 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ff2302-b3ed-4dc0-846d-8982e6b6f16d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 09:33:52.434652 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ff2302-b3ed-4dc0-846d-8982e6b6f16d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:33:52.435245 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8834ad-4da6-4eab-8369-d28b7adee884 None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:33:52.436125 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ff2302-b3ed-4dc0-846d-8982e6b6f16d None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:33:52.451067 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 238/449] 10.222.0.65 () {56 vars in 1103 bytes} [Thu Oct 27 09:33:52 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 09:33:52.451067 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82965e01-058d-4b7b-880b-a02646da3ae0 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:33:52.451067 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82965e01-058d-4b7b-880b-a02646da3ae0 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:33:52.451067 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82965e01-058d-4b7b-880b-a02646da3ae0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:33:52.451444 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 212/450] 10.222.0.65 () {56 vars in 1148 bytes} [Thu Oct 27 09:33:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 09:33:52.451444 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ff2302-b3ed-4dc0-846d-8982e6b6f16d None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:33:52.467191 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-82965e01-058d-4b7b-880b-a02646da3ae0 None None] MFA Rules not processed for user `b5065084bf664b99bdeac46067cb0f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:33:52.468411 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-82965e01-058d-4b7b-880b-a02646da3ae0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:33:52.479181 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:33:52.542460 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 239/451] 10.222.0.65 () {58 vars in 1024 bytes} [Thu Oct 27 09:33:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 27 09:33:52.543455 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82965e01-058d-4b7b-880b-a02646da3ae0 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:33:52.564383 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ff2302-b3ed-4dc0-846d-8982e6b6f16d None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:33:52.601582 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe1286f-f9d0-402d-971a-b42794589f6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:33:52.602223 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe1286f-f9d0-402d-971a-b42794589f6f None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:33:52.602493 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe1286f-f9d0-402d-971a-b42794589f6f None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:33:52.602794 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe1286f-f9d0-402d-971a-b42794589f6f None admin] PATH_INFO: `/v3/users/glance` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:33:52.610797 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe1286f-f9d0-402d-971a-b42794589f6f None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:33:52.612234 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe1286f-f9d0-402d-971a-b42794589f6f None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:33:52.624781 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application [None req-5fe1286f-f9d0-402d-971a-b42794589f6f None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Oct 27 09:33:52.624781 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 09:33:52.624781 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 09:33:52.624781 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 09:33:52.624781 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 09:33:52.624781 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 09:33:52.624781 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 09:33:52.624781 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 09:33:52.624781 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 09:33:52.624781 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 09:33:52.624781 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 09:33:52.624781 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 09:33:52.624781 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 27 09:33:52.624781 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 27 09:33:52.624781 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 27 09:33:52.624781 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 27 09:33:52.625705 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 09:33:52.625705 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 09:33:52.625705 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 27 09:33:52.625705 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 27 09:33:52.625705 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 27 09:33:52.625705 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 27 09:33:52.625705 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 09:33:52.625705 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 09:33:52.625705 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 09:33:52.625705 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 09:33:52.625705 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 09:33:52.625705 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application with Lock( Oct 27 09:33:52.625705 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 09:33:52.625705 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._enter() Oct 27 09:33:52.625705 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 09:33:52.625705 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 09:33:52.625705 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 09:33:52.625705 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.creator() Oct 27 09:33:52.626973 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 09:33:52.626973 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application created_value = creator( Oct 27 09:33:52.626973 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 27 09:33:52.626973 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 27 09:33:52.626973 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 27 09:33:52.626973 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 27 09:33:52.626973 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 27 09:33:52.626973 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 27 09:33:52.626973 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Oct 27 09:33:52.626973 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application Oct 27 09:33:52.626973 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 213/452] 10.222.0.65 () {56 vars in 1099 bytes} [Thu Oct 27 09:33:52 2022] GET /identity/v3/users/glance => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 09:33:52.626973 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe1286f-f9d0-402d-971a-b42794589f6f None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:33:52.659538 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82965e01-058d-4b7b-880b-a02646da3ae0 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:33:52.661315 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:33:52.697700 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094c8726-a010-4010-a2db-13f09bce7296 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:33:52.698330 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094c8726-a010-4010-a2db-13f09bce7296 None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:33:52.699194 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094c8726-a010-4010-a2db-13f09bce7296 None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:33:52.699857 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094c8726-a010-4010-a2db-13f09bce7296 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:33:52.710358 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094c8726-a010-4010-a2db-13f09bce7296 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:33:52.711829 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094c8726-a010-4010-a2db-13f09bce7296 None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:33:52.724114 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:33:52.726726 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application [None req-094c8726-a010-4010-a2db-13f09bce7296 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 09:33:52.726726 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 09:33:52.726726 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 09:33:52.726726 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 09:33:52.726726 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 09:33:52.726726 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 09:33:52.726726 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 09:33:52.726726 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 09:33:52.726726 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 09:33:52.726726 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 09:33:52.726726 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 09:33:52.726726 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 09:33:52.726726 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 27 09:33:52.726726 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 27 09:33:52.726726 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 27 09:33:52.726726 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 27 09:33:52.727917 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 09:33:52.727917 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 09:33:52.727917 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 09:33:52.727917 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 09:33:52.727917 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 09:33:52.727917 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 09:33:52.727917 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 09:33:52.727917 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application with Lock( Oct 27 09:33:52.727917 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 09:33:52.727917 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._enter() Oct 27 09:33:52.727917 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 09:33:52.727917 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 09:33:52.727917 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 09:33:52.727917 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.creator() Oct 27 09:33:52.727917 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 09:33:52.727917 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application created_value = creator( Oct 27 09:33:52.727917 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 27 09:33:52.729259 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 27 09:33:52.729259 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 09:33:52.729259 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application Oct 27 09:33:52.729259 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 240/453] 10.222.0.65 () {56 vars in 1108 bytes} [Thu Oct 27 09:33:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 09:33:52.729259 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094c8726-a010-4010-a2db-13f09bce7296 None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:33:52.744825 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe1286f-f9d0-402d-971a-b42794589f6f None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:33:52.787124 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218558a0-bef6-4c0b-b981-e608979de7d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:33:52.787771 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218558a0-bef6-4c0b-b981-e608979de7d2 None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:33:52.788436 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218558a0-bef6-4c0b-b981-e608979de7d2 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:33:52.788722 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218558a0-bef6-4c0b-b981-e608979de7d2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:33:52.809599 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218558a0-bef6-4c0b-b981-e608979de7d2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:33:52.811127 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218558a0-bef6-4c0b-b981-e608979de7d2 None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:33:52.827613 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application [None req-218558a0-bef6-4c0b-b981-e608979de7d2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 09:33:52.827613 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 09:33:52.827613 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 09:33:52.827613 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 09:33:52.827613 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 09:33:52.827613 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 09:33:52.827613 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 09:33:52.827613 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 09:33:52.827613 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 09:33:52.827613 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 09:33:52.827613 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 09:33:52.827613 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 09:33:52.827613 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 27 09:33:52.827613 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 27 09:33:52.827613 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 27 09:33:52.827613 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 27 09:33:52.828649 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 09:33:52.828649 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 09:33:52.828649 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 09:33:52.828649 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 09:33:52.828649 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 09:33:52.828649 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 09:33:52.828649 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 09:33:52.828649 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application with Lock( Oct 27 09:33:52.828649 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 09:33:52.828649 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._enter() Oct 27 09:33:52.828649 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 09:33:52.828649 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 09:33:52.828649 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 09:33:52.828649 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.creator() Oct 27 09:33:52.828649 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 09:33:52.828649 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application created_value = creator( Oct 27 09:33:52.828649 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 27 09:33:52.829977 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 27 09:33:52.829977 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 09:33:52.829977 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application Oct 27 09:33:52.829977 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 214/454] 10.222.0.65 () {56 vars in 1108 bytes} [Thu Oct 27 09:33:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 09:33:52.829977 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218558a0-bef6-4c0b-b981-e608979de7d2 None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:33:52.863096 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094c8726-a010-4010-a2db-13f09bce7296 None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:33:52.899151 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a37959-ee61-4333-8873-90274b4760fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:33:52.899815 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a37959-ee61-4333-8873-90274b4760fa None admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:33:52.900096 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a37959-ee61-4333-8873-90274b4760fa None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:33:52.900369 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a37959-ee61-4333-8873-90274b4760fa None admin] PATH_INFO: `/v3/projects/dc2e3a7a1bcc480891c0b433291c00b1/users/01e32fc35c8b467e9604b325cf1527aa/roles/8d728ccbaa534a949df6711b47151356` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:33:52.918292 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a37959-ee61-4333-8873-90274b4760fa None admin] RBAC: Authorizing `identity:create_grant(project_id=dc2e3a7a1bcc480891c0b433291c00b1, user_id=01e32fc35c8b467e9604b325cf1527aa, role_id=8d728ccbaa534a949df6711b47151356)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:33:52.919834 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a37959-ee61-4333-8873-90274b4760fa None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:33:52.936995 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218558a0-bef6-4c0b-b981-e608979de7d2 None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:33:52.970394 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a46430-60ae-4b33-81c1-ad7797a8adf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:33:52.971031 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a46430-60ae-4b33-81c1-ad7797a8adf7 None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:33:52.971315 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a46430-60ae-4b33-81c1-ad7797a8adf7 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:33:52.971589 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a46430-60ae-4b33-81c1-ad7797a8adf7 None admin] PATH_INFO: `/v3/users` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:33:52.972315 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a46430-60ae-4b33-81c1-ad7797a8adf7 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 09:33:52.972623 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a46430-60ae-4b33-81c1-ad7797a8adf7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:33:52.974100 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a46430-60ae-4b33-81c1-ad7797a8adf7 None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:33:52.984370 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:33:52.993060 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 215/455] 10.222.0.65 () {56 vars in 1137 bytes} [Thu Oct 27 09:33:52 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 09:33:52.993877 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a46430-60ae-4b33-81c1-ad7797a8adf7 None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:33:53.004566 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 241/456] 10.222.0.65 () {58 vars in 1439 bytes} [Thu Oct 27 09:33:52 2022] PUT /identity/v3/projects/dc2e3a7a1bcc480891c0b433291c00b1/users/01e32fc35c8b467e9604b325cf1527aa/roles/8d728ccbaa534a949df6711b47151356 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 09:33:53.005420 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a37959-ee61-4333-8873-90274b4760fa None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:33:53.009344 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:33:53.138221 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a46430-60ae-4b33-81c1-ad7797a8adf7 None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:33:53.141675 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a37959-ee61-4333-8873-90274b4760fa None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:33:53.181750 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99f2ef3-228d-4f16-a251-dfa874b90fde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:33:53.182641 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99f2ef3-228d-4f16-a251-dfa874b90fde None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:33:53.182928 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99f2ef3-228d-4f16-a251-dfa874b90fde None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:33:53.183145 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4306ead5-c0ae-4117-8c92-8cc37b9812c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:33:53.183297 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99f2ef3-228d-4f16-a251-dfa874b90fde None admin] PATH_INFO: `/v3/domains` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:33:53.183942 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4306ead5-c0ae-4117-8c92-8cc37b9812c8 None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:33:53.184075 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99f2ef3-228d-4f16-a251-dfa874b90fde None admin] RBAC: Adding query filter params (name=Default) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 09:33:53.184316 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4306ead5-c0ae-4117-8c92-8cc37b9812c8 None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:33:53.184415 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99f2ef3-228d-4f16-a251-dfa874b90fde None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:33:53.184617 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4306ead5-c0ae-4117-8c92-8cc37b9812c8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:33:53.186461 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99f2ef3-228d-4f16-a251-dfa874b90fde None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:33:53.198444 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4306ead5-c0ae-4117-8c92-8cc37b9812c8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 09:33:53.200843 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 216/457] 10.222.0.65 () {56 vars in 1109 bytes} [Thu Oct 27 09:33:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 09:33:53.201543 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99f2ef3-228d-4f16-a251-dfa874b90fde None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:33:53.204981 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application [None req-4306ead5-c0ae-4117-8c92-8cc37b9812c8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 27 09:33:53.204981 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 09:33:53.204981 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 09:33:53.204981 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 09:33:53.204981 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 09:33:53.204981 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 09:33:53.204981 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 09:33:53.204981 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 09:33:53.204981 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 09:33:53.204981 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 09:33:53.204981 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 09:33:53.204981 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 09:33:53.204981 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 27 09:33:53.204981 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 27 09:33:53.204981 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 27 09:33:53.204981 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 27 09:33:53.205985 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 27 09:33:53.205985 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 27 09:33:53.205985 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 27 09:33:53.205985 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 27 09:33:53.205985 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 09:33:53.205985 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 09:33:53.205985 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 09:33:53.205985 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 09:33:53.205985 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 09:33:53.205985 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 09:33:53.205985 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 09:33:53.205985 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application with Lock( Oct 27 09:33:53.205985 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 09:33:53.205985 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._enter() Oct 27 09:33:53.205985 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 09:33:53.205985 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 09:33:53.206849 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 09:33:53.206849 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.creator() Oct 27 09:33:53.206849 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 09:33:53.206849 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application created_value = creator( Oct 27 09:33:53.206849 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 27 09:33:53.206849 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 27 09:33:53.206849 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 27 09:33:53.206849 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 27 09:33:53.206849 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 27 09:33:53.206849 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 27 09:33:53.206849 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 27 09:33:53.206849 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application Oct 27 09:33:53.206849 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 242/458] 10.222.0.65 () {56 vars in 1102 bytes} [Thu Oct 27 09:33:53 2022] GET /identity/v3/roles/service => generated 85 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 09:33:53.207482 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4306ead5-c0ae-4117-8c92-8cc37b9812c8 None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:33:53.281898 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:33:53.298672 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:33:53.328284 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4306ead5-c0ae-4117-8c92-8cc37b9812c8 None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:33:53.345805 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99f2ef3-228d-4f16-a251-dfa874b90fde None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:33:53.382632 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f49feff-4a15-4b8c-accb-f218f6458556 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:33:53.383566 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f49feff-4a15-4b8c-accb-f218f6458556 None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:33:53.383991 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f49feff-4a15-4b8c-accb-f218f6458556 None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:33:53.384420 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f49feff-4a15-4b8c-accb-f218f6458556 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:33:53.407052 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0574c012-a3c5-4342-bb97-c4d61f98da4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:33:53.407926 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0574c012-a3c5-4342-bb97-c4d61f98da4c None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:33:53.408335 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0574c012-a3c5-4342-bb97-c4d61f98da4c None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:33:53.409891 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0574c012-a3c5-4342-bb97-c4d61f98da4c None admin] PATH_INFO: `/v3/domains` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:33:53.409891 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0574c012-a3c5-4342-bb97-c4d61f98da4c None admin] RBAC: Adding query filter params (name=Default) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 09:33:53.410408 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0574c012-a3c5-4342-bb97-c4d61f98da4c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:33:53.412975 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0574c012-a3c5-4342-bb97-c4d61f98da4c None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:33:53.439757 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 217/459] 10.222.0.65 () {56 vars in 1109 bytes} [Thu Oct 27 09:33:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 09:33:53.439757 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0574c012-a3c5-4342-bb97-c4d61f98da4c None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:33:53.510492 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f49feff-4a15-4b8c-accb-f218f6458556 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:33:53.512312 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f49feff-4a15-4b8c-accb-f218f6458556 None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:33:53.601281 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0574c012-a3c5-4342-bb97-c4d61f98da4c None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:33:53.608084 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:33:53.630952 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:33:53.658228 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57d34ea-4e16-4170-aa38-1002d406344d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:33:53.660801 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57d34ea-4e16-4170-aa38-1002d406344d None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:33:53.660801 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57d34ea-4e16-4170-aa38-1002d406344d None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:33:53.660801 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57d34ea-4e16-4170-aa38-1002d406344d None admin] PATH_INFO: `/v3/projects/service` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:33:53.671365 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 243/460] 10.222.0.65 () {58 vars in 1282 bytes} [Thu Oct 27 09:33:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 459 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 27 09:33:53.671365 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f49feff-4a15-4b8c-accb-f218f6458556 None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:33:53.672632 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57d34ea-4e16-4170-aa38-1002d406344d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:33:53.674339 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57d34ea-4e16-4170-aa38-1002d406344d None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:33:53.691409 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application [None req-f57d34ea-4e16-4170-aa38-1002d406344d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 27 09:33:53.691409 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 09:33:53.691409 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 09:33:53.691409 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 09:33:53.691409 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 09:33:53.691409 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 09:33:53.691409 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 09:33:53.691409 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 09:33:53.691409 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 09:33:53.691409 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 09:33:53.691409 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 09:33:53.691409 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 09:33:53.691409 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 27 09:33:53.691409 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 27 09:33:53.691409 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 27 09:33:53.692756 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 27 09:33:53.692756 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 09:33:53.692756 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 09:33:53.692756 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 09:33:53.692756 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 09:33:53.692756 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 09:33:53.692756 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 09:33:53.692756 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 09:33:53.692756 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application with Lock( Oct 27 09:33:53.692756 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 09:33:53.692756 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._enter() Oct 27 09:33:53.692756 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 09:33:53.692756 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 09:33:53.692756 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 09:33:53.692756 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.creator() Oct 27 09:33:53.692756 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 09:33:53.692756 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application created_value = creator( Oct 27 09:33:53.694436 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 27 09:33:53.694436 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 27 09:33:53.694436 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 27 09:33:53.694436 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 27 09:33:53.694436 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 27 09:33:53.694436 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 27 09:33:53.694436 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 27 09:33:53.694436 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application Oct 27 09:33:53.694436 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 218/461] 10.222.0.65 () {56 vars in 1111 bytes} [Thu Oct 27 09:33:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 09:33:53.694436 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57d34ea-4e16-4170-aa38-1002d406344d None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:33:53.837956 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f49feff-4a15-4b8c-accb-f218f6458556 None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:33:53.860363 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57d34ea-4e16-4170-aa38-1002d406344d None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:33:53.893793 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4534ce52-ae32-44e4-894b-7dd9f30f1bb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:33:53.894509 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4534ce52-ae32-44e4-894b-7dd9f30f1bb6 None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:33:53.894867 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4534ce52-ae32-44e4-894b-7dd9f30f1bb6 None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:33:53.895329 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4534ce52-ae32-44e4-894b-7dd9f30f1bb6 None admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:33:53.895756 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4534ce52-ae32-44e4-894b-7dd9f30f1bb6 None admin] RBAC: Adding query filter params (name=service) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 09:33:53.896132 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4534ce52-ae32-44e4-894b-7dd9f30f1bb6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:33:53.897507 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4534ce52-ae32-44e4-894b-7dd9f30f1bb6 None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:33:53.907359 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d512e2d3-4419-4b05-b959-d0c86b7f3b10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:33:53.908024 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d512e2d3-4419-4b05-b959-d0c86b7f3b10 None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:33:53.908307 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d512e2d3-4419-4b05-b959-d0c86b7f3b10 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:33:53.908721 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d512e2d3-4419-4b05-b959-d0c86b7f3b10 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:33:53.919817 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 244/462] 10.222.0.65 () {56 vars in 1103 bytes} [Thu Oct 27 09:33:53 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 09:33:53.919817 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4534ce52-ae32-44e4-894b-7dd9f30f1bb6 None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:33:53.920084 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d512e2d3-4419-4b05-b959-d0c86b7f3b10 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:33:53.920347 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d512e2d3-4419-4b05-b959-d0c86b7f3b10 None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:33:53.935415 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application [None req-d512e2d3-4419-4b05-b959-d0c86b7f3b10 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Oct 27 09:33:53.935415 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 09:33:53.935415 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 09:33:53.935415 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 09:33:53.935415 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 09:33:53.935415 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 09:33:53.935415 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 09:33:53.935415 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 09:33:53.935415 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 09:33:53.935415 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 09:33:53.935415 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 09:33:53.935415 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 09:33:53.935415 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 27 09:33:53.935415 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 27 09:33:53.935415 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 27 09:33:53.935415 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 27 09:33:53.936434 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 09:33:53.936434 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 09:33:53.936434 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 27 09:33:53.936434 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 27 09:33:53.936434 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 27 09:33:53.936434 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 27 09:33:53.936434 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 09:33:53.936434 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 09:33:53.936434 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 09:33:53.936434 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 09:33:53.936434 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 09:33:53.936434 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application with Lock( Oct 27 09:33:53.936434 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 09:33:53.936434 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._enter() Oct 27 09:33:53.936434 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 09:33:53.936434 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 09:33:53.936434 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 09:33:53.936434 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.creator() Oct 27 09:33:53.937830 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 09:33:53.937830 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application created_value = creator( Oct 27 09:33:53.937830 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 27 09:33:53.937830 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 27 09:33:53.937830 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 27 09:33:53.937830 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 27 09:33:53.937830 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 27 09:33:53.937830 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 27 09:33:53.937830 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Oct 27 09:33:53.937830 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application Oct 27 09:33:53.937830 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 219/463] 10.222.0.65 () {56 vars in 1099 bytes} [Thu Oct 27 09:33:53 2022] GET /identity/v3/users/cinder => generated 84 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 09:33:53.938418 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d512e2d3-4419-4b05-b959-d0c86b7f3b10 None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:33:53.973237 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:33:54.004495 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:33:54.069478 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4534ce52-ae32-44e4-894b-7dd9f30f1bb6 None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:33:54.103480 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d512e2d3-4419-4b05-b959-d0c86b7f3b10 None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:33:54.119634 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b79cbc2-55f5-47e3-9017-5dfd4a640240 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:33:54.121152 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b79cbc2-55f5-47e3-9017-5dfd4a640240 None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:33:54.121427 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b79cbc2-55f5-47e3-9017-5dfd4a640240 None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:33:54.121697 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b79cbc2-55f5-47e3-9017-5dfd4a640240 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:33:54.141599 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b79cbc2-55f5-47e3-9017-5dfd4a640240 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:33:54.144299 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b79cbc2-55f5-47e3-9017-5dfd4a640240 None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:33:54.148865 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736bcae5-cf9d-4df9-b4a4-9af5904fcbc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:33:54.149478 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736bcae5-cf9d-4df9-b4a4-9af5904fcbc1 None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:33:54.149756 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736bcae5-cf9d-4df9-b4a4-9af5904fcbc1 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:33:54.150029 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736bcae5-cf9d-4df9-b4a4-9af5904fcbc1 None admin] PATH_INFO: `/v3/projects` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:33:54.150747 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736bcae5-cf9d-4df9-b4a4-9af5904fcbc1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 09:33:54.151059 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736bcae5-cf9d-4df9-b4a4-9af5904fcbc1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:33:54.152892 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736bcae5-cf9d-4df9-b4a4-9af5904fcbc1 None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:33:54.162509 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application [None req-9b79cbc2-55f5-47e3-9017-5dfd4a640240 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 09:33:54.162509 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 09:33:54.162509 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 09:33:54.162509 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 09:33:54.162509 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 09:33:54.162509 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 09:33:54.162509 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 09:33:54.162509 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 09:33:54.162509 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 09:33:54.162509 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 09:33:54.162509 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 09:33:54.162509 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 09:33:54.162509 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 27 09:33:54.162509 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 27 09:33:54.162509 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 27 09:33:54.162509 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 27 09:33:54.163694 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 09:33:54.163694 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 09:33:54.163694 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 09:33:54.163694 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 09:33:54.163694 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 09:33:54.163694 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 09:33:54.163694 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 09:33:54.163694 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application with Lock( Oct 27 09:33:54.163694 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 09:33:54.163694 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._enter() Oct 27 09:33:54.163694 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 09:33:54.163694 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 09:33:54.163694 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 09:33:54.163694 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.creator() Oct 27 09:33:54.163694 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 09:33:54.163694 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application created_value = creator( Oct 27 09:33:54.163694 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 27 09:33:54.164770 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 27 09:33:54.164770 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 09:33:54.164770 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application Oct 27 09:33:54.170899 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 245/464] 10.222.0.65 () {56 vars in 1108 bytes} [Thu Oct 27 09:33:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 09:33:54.177700 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 220/465] 10.222.0.65 () {56 vars in 1148 bytes} [Thu Oct 27 09:33:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 09:33:54.177859 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b79cbc2-55f5-47e3-9017-5dfd4a640240 None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:33:54.177952 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736bcae5-cf9d-4df9-b4a4-9af5904fcbc1 None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:33:54.284552 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:33:54.310190 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b79cbc2-55f5-47e3-9017-5dfd4a640240 None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:33:54.312429 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:33:54.317333 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736bcae5-cf9d-4df9-b4a4-9af5904fcbc1 None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:33:54.357425 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0582c47-9048-427c-871f-8190ffc21670 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:33:54.358037 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0582c47-9048-427c-871f-8190ffc21670 None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:33:54.358159 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1450a48-01de-4b6b-8c4a-2a5361e6638a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:33:54.358367 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0582c47-9048-427c-871f-8190ffc21670 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:33:54.358612 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0582c47-9048-427c-871f-8190ffc21670 None admin] PATH_INFO: `/v3/users` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:33:54.358733 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1450a48-01de-4b6b-8c4a-2a5361e6638a None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:33:54.358995 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1450a48-01de-4b6b-8c4a-2a5361e6638a None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:33:54.359271 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1450a48-01de-4b6b-8c4a-2a5361e6638a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:33:54.359362 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0582c47-9048-427c-871f-8190ffc21670 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 09:33:54.359650 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0582c47-9048-427c-871f-8190ffc21670 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:33:54.361096 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0582c47-9048-427c-871f-8190ffc21670 None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:33:54.377194 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1450a48-01de-4b6b-8c4a-2a5361e6638a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:33:54.378702 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1450a48-01de-4b6b-8c4a-2a5361e6638a None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:33:54.382557 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 221/466] 10.222.0.65 () {56 vars in 1137 bytes} [Thu Oct 27 09:33:54 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 09:33:54.383615 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0582c47-9048-427c-871f-8190ffc21670 None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:33:54.398391 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application [None req-d1450a48-01de-4b6b-8c4a-2a5361e6638a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 09:33:54.398391 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 09:33:54.398391 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 09:33:54.398391 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 09:33:54.398391 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 09:33:54.398391 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 09:33:54.398391 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 09:33:54.398391 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 09:33:54.398391 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 09:33:54.398391 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 09:33:54.398391 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 09:33:54.398391 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 09:33:54.398391 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 27 09:33:54.398391 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 27 09:33:54.398391 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 27 09:33:54.398391 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 27 09:33:54.399484 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 09:33:54.399484 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 09:33:54.399484 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 09:33:54.399484 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 09:33:54.399484 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 09:33:54.399484 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 09:33:54.399484 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 09:33:54.399484 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application with Lock( Oct 27 09:33:54.399484 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 09:33:54.399484 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._enter() Oct 27 09:33:54.399484 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 09:33:54.399484 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 09:33:54.399484 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 09:33:54.399484 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.creator() Oct 27 09:33:54.399484 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 09:33:54.399484 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application created_value = creator( Oct 27 09:33:54.399484 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 27 09:33:54.400337 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 27 09:33:54.400337 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 09:33:54.400337 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application Oct 27 09:33:54.400337 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 246/467] 10.222.0.65 () {56 vars in 1108 bytes} [Thu Oct 27 09:33:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 09:33:54.400337 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1450a48-01de-4b6b-8c4a-2a5361e6638a None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:33:54.509492 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0582c47-9048-427c-871f-8190ffc21670 None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:33:54.520163 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1450a48-01de-4b6b-8c4a-2a5361e6638a None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:33:54.553670 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55eaa514-9a9d-4f73-9c8c-9c7191452fce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:33:54.554173 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55eaa514-9a9d-4f73-9c8c-9c7191452fce None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:33:54.554450 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55eaa514-9a9d-4f73-9c8c-9c7191452fce None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:33:54.554752 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55eaa514-9a9d-4f73-9c8c-9c7191452fce None admin] PATH_INFO: `/v3/domains` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:33:54.555463 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55eaa514-9a9d-4f73-9c8c-9c7191452fce None admin] RBAC: Adding query filter params (name=Default) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 09:33:54.555739 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55eaa514-9a9d-4f73-9c8c-9c7191452fce None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:33:54.556258 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:33:54.557126 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55eaa514-9a9d-4f73-9c8c-9c7191452fce None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:33:54.563922 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa62def7-d660-419a-917c-73dfc0747da6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:33:54.564607 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa62def7-d660-419a-917c-73dfc0747da6 None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:33:54.565406 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa62def7-d660-419a-917c-73dfc0747da6 None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:33:54.565684 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa62def7-d660-419a-917c-73dfc0747da6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:33:54.566411 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa62def7-d660-419a-917c-73dfc0747da6 None admin] RBAC: Adding query filter params (role.id=8d728ccbaa534a949df6711b47151356, scope.project.id=dc2e3a7a1bcc480891c0b433291c00b1, user.id=fd0d23ef039d4f1591a589d302ef165f) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 09:33:54.567201 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa62def7-d660-419a-917c-73dfc0747da6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:33:54.568644 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa62def7-d660-419a-917c-73dfc0747da6 None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:33:54.574858 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 222/468] 10.222.0.65 () {56 vars in 1109 bytes} [Thu Oct 27 09:33:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 09:33:54.575733 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55eaa514-9a9d-4f73-9c8c-9c7191452fce None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:33:54.575846 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 247/469] 10.222.0.65 () {56 vars in 1374 bytes} [Thu Oct 27 09:33:54 2022] GET /identity/v3/role_assignments?user.id=fd0d23ef039d4f1591a589d302ef165f&scope.project.id=dc2e3a7a1bcc480891c0b433291c00b1&role.id=8d728ccbaa534a949df6711b47151356 => generated 608 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 09:33:54.588206 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa62def7-d660-419a-917c-73dfc0747da6 None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:33:54.599170 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:33:54.712413 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55eaa514-9a9d-4f73-9c8c-9c7191452fce None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:33:54.734474 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa62def7-d660-419a-917c-73dfc0747da6 None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:33:54.756048 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92aabb04-6a7c-4e71-9482-d4d536d060f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:33:54.756822 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92aabb04-6a7c-4e71-9482-d4d536d060f9 None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:33:54.757196 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92aabb04-6a7c-4e71-9482-d4d536d060f9 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:33:54.757570 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92aabb04-6a7c-4e71-9482-d4d536d060f9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:33:54.787548 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f94844-8146-4e12-98fb-c1c61b58d16c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:33:54.788519 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f94844-8146-4e12-98fb-c1c61b58d16c None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:33:54.788920 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f94844-8146-4e12-98fb-c1c61b58d16c None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:33:54.789345 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f94844-8146-4e12-98fb-c1c61b58d16c None admin] PATH_INFO: `/v3/domains` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:33:54.789986 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f94844-8146-4e12-98fb-c1c61b58d16c None admin] RBAC: Adding query filter params (name=Default) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 09:33:54.790481 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f94844-8146-4e12-98fb-c1c61b58d16c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:33:54.793216 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f94844-8146-4e12-98fb-c1c61b58d16c None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:33:54.809773 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 248/470] 10.222.0.65 () {56 vars in 1109 bytes} [Thu Oct 27 09:33:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 09:33:54.811261 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f94844-8146-4e12-98fb-c1c61b58d16c None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:33:54.858548 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92aabb04-6a7c-4e71-9482-d4d536d060f9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:33:54.858548 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92aabb04-6a7c-4e71-9482-d4d536d060f9 None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:33:54.881845 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:33:54.887967 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:33:54.944068 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f94844-8146-4e12-98fb-c1c61b58d16c None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:33:54.977594 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 223/471] 10.222.0.65 () {58 vars in 1282 bytes} [Thu Oct 27 09:33:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 27 09:33:54.978497 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92aabb04-6a7c-4e71-9482-d4d536d060f9 None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:33:54.983187 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a29d437-ef22-41eb-b15e-91ff7212cf8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:33:54.984165 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a29d437-ef22-41eb-b15e-91ff7212cf8f None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:33:54.984637 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a29d437-ef22-41eb-b15e-91ff7212cf8f None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:33:54.985104 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a29d437-ef22-41eb-b15e-91ff7212cf8f None admin] PATH_INFO: `/v3/projects/service` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:33:54.993201 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a29d437-ef22-41eb-b15e-91ff7212cf8f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:33:54.994953 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a29d437-ef22-41eb-b15e-91ff7212cf8f None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:33:55.008077 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application [None req-0a29d437-ef22-41eb-b15e-91ff7212cf8f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 27 09:33:55.008077 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 09:33:55.008077 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 09:33:55.008077 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 09:33:55.008077 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 09:33:55.008077 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 09:33:55.008077 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 09:33:55.008077 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 09:33:55.008077 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 09:33:55.008077 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 09:33:55.008077 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 09:33:55.008077 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 09:33:55.008077 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 27 09:33:55.008077 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 27 09:33:55.008077 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 27 09:33:55.008919 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 27 09:33:55.008919 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 09:33:55.008919 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 09:33:55.008919 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 09:33:55.008919 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 09:33:55.008919 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 09:33:55.008919 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 09:33:55.008919 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 09:33:55.008919 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application with Lock( Oct 27 09:33:55.008919 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 09:33:55.008919 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._enter() Oct 27 09:33:55.008919 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 09:33:55.008919 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 09:33:55.008919 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 09:33:55.008919 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.creator() Oct 27 09:33:55.008919 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 09:33:55.008919 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application created_value = creator( Oct 27 09:33:55.009722 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 27 09:33:55.009722 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 27 09:33:55.009722 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 27 09:33:55.009722 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 27 09:33:55.009722 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 27 09:33:55.009722 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 27 09:33:55.009722 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 27 09:33:55.009722 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application Oct 27 09:33:55.016977 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 249/472] 10.222.0.65 () {56 vars in 1111 bytes} [Thu Oct 27 09:33:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 09:33:55.018238 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a29d437-ef22-41eb-b15e-91ff7212cf8f None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:33:55.091720 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92aabb04-6a7c-4e71-9482-d4d536d060f9 None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:33:55.118716 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:33:55.135768 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b29850-e4df-4e10-b399-3797368c5203 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:33:55.136525 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a29d437-ef22-41eb-b15e-91ff7212cf8f None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:33:55.137467 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b29850-e4df-4e10-b399-3797368c5203 None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:33:55.137467 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b29850-e4df-4e10-b399-3797368c5203 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:33:55.137631 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b29850-e4df-4e10-b399-3797368c5203 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:33:55.145283 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b29850-e4df-4e10-b399-3797368c5203 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:33:55.146815 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b29850-e4df-4e10-b399-3797368c5203 None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:33:55.162701 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application [None req-60b29850-e4df-4e10-b399-3797368c5203 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Oct 27 09:33:55.162701 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 09:33:55.162701 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 09:33:55.162701 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 09:33:55.162701 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 09:33:55.162701 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 09:33:55.162701 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 09:33:55.162701 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 09:33:55.162701 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 09:33:55.162701 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 09:33:55.162701 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 09:33:55.162701 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 09:33:55.162701 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 27 09:33:55.162701 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 27 09:33:55.162701 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 27 09:33:55.162701 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 27 09:33:55.163640 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 09:33:55.163640 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 09:33:55.163640 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 27 09:33:55.163640 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 27 09:33:55.163640 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 27 09:33:55.163640 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 27 09:33:55.163640 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 09:33:55.163640 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 09:33:55.163640 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 09:33:55.163640 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 09:33:55.163640 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 09:33:55.163640 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application with Lock( Oct 27 09:33:55.163640 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 09:33:55.163640 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._enter() Oct 27 09:33:55.163640 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 09:33:55.163640 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 09:33:55.163640 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 09:33:55.163640 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.creator() Oct 27 09:33:55.164492 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 09:33:55.164492 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application created_value = creator( Oct 27 09:33:55.164492 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 27 09:33:55.164492 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 27 09:33:55.164492 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 27 09:33:55.164492 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 27 09:33:55.164492 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 27 09:33:55.164492 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 27 09:33:55.164492 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Oct 27 09:33:55.164492 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application Oct 27 09:33:55.166659 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 224/473] 10.222.0.65 () {56 vars in 1102 bytes} [Thu Oct 27 09:33:54 2022] GET /identity/v3/users/neutron => generated 85 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 09:33:55.168933 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b29850-e4df-4e10-b399-3797368c5203 None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:33:55.169047 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:33:55.181812 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1a2d11-03cb-4084-8cb6-9faa9e1d7771 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:33:55.184320 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1a2d11-03cb-4084-8cb6-9faa9e1d7771 None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:33:55.184819 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1a2d11-03cb-4084-8cb6-9faa9e1d7771 None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:33:55.185433 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1a2d11-03cb-4084-8cb6-9faa9e1d7771 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:33:55.197563 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1a2d11-03cb-4084-8cb6-9faa9e1d7771 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:33:55.200534 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1a2d11-03cb-4084-8cb6-9faa9e1d7771 None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:33:55.220770 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application [None req-3e1a2d11-03cb-4084-8cb6-9faa9e1d7771 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 09:33:55.220770 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 09:33:55.220770 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 09:33:55.220770 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 09:33:55.220770 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 09:33:55.220770 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 09:33:55.220770 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 09:33:55.220770 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 09:33:55.220770 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 09:33:55.220770 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 09:33:55.220770 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 09:33:55.220770 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 09:33:55.220770 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 27 09:33:55.220770 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 27 09:33:55.220770 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 27 09:33:55.220770 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 27 09:33:55.221933 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 09:33:55.221933 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 09:33:55.221933 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 09:33:55.221933 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 09:33:55.221933 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 09:33:55.221933 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 09:33:55.221933 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 09:33:55.221933 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application with Lock( Oct 27 09:33:55.221933 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 09:33:55.221933 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._enter() Oct 27 09:33:55.221933 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 09:33:55.221933 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 09:33:55.221933 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 09:33:55.221933 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.creator() Oct 27 09:33:55.221933 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 09:33:55.221933 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application created_value = creator( Oct 27 09:33:55.221933 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 27 09:33:55.222988 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 27 09:33:55.222988 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 09:33:55.222988 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application Oct 27 09:33:55.225199 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 250/474] 10.222.0.65 () {56 vars in 1108 bytes} [Thu Oct 27 09:33:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 09:33:55.226220 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1a2d11-03cb-4084-8cb6-9faa9e1d7771 None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:33:55.302299 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b29850-e4df-4e10-b399-3797368c5203 None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:33:55.344383 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b752a40-4a9e-4499-90c5-1008a9458845 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:33:55.345003 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b752a40-4a9e-4499-90c5-1008a9458845 None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:33:55.345363 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b752a40-4a9e-4499-90c5-1008a9458845 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:33:55.345740 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b752a40-4a9e-4499-90c5-1008a9458845 None admin] PATH_INFO: `/v3/projects` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:33:55.346591 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b752a40-4a9e-4499-90c5-1008a9458845 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 09:33:55.347166 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b752a40-4a9e-4499-90c5-1008a9458845 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:33:55.348761 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b752a40-4a9e-4499-90c5-1008a9458845 None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:33:55.363537 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 225/475] 10.222.0.65 () {56 vars in 1148 bytes} [Thu Oct 27 09:33:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 09:33:55.366292 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1a2d11-03cb-4084-8cb6-9faa9e1d7771 None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:33:55.370013 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b752a40-4a9e-4499-90c5-1008a9458845 None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:33:55.410390 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:33:55.415414 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea95b95f-bf64-447f-90f8-1ce3b57f7817 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:33:55.416028 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea95b95f-bf64-447f-90f8-1ce3b57f7817 None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:33:55.416308 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea95b95f-bf64-447f-90f8-1ce3b57f7817 None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:33:55.416583 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea95b95f-bf64-447f-90f8-1ce3b57f7817 None admin] PATH_INFO: `/v3/users` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:33:55.417395 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea95b95f-bf64-447f-90f8-1ce3b57f7817 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 09:33:55.417660 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea95b95f-bf64-447f-90f8-1ce3b57f7817 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:33:55.419179 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea95b95f-bf64-447f-90f8-1ce3b57f7817 None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:33:55.442238 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 251/476] 10.222.0.65 () {56 vars in 1139 bytes} [Thu Oct 27 09:33:55 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 09:33:55.442238 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea95b95f-bf64-447f-90f8-1ce3b57f7817 None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:33:55.467714 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:33:55.490089 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b752a40-4a9e-4499-90c5-1008a9458845 None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:33:55.526387 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdf484a-8a8c-44f6-916f-0bfafd1e5f69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:33:55.528041 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdf484a-8a8c-44f6-916f-0bfafd1e5f69 None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:33:55.529083 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdf484a-8a8c-44f6-916f-0bfafd1e5f69 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:33:55.529361 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdf484a-8a8c-44f6-916f-0bfafd1e5f69 None admin] PATH_INFO: `/v3/domains` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:33:55.530015 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcdf484a-8a8c-44f6-916f-0bfafd1e5f69 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 09:33:55.530320 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcdf484a-8a8c-44f6-916f-0bfafd1e5f69 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:33:55.531733 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcdf484a-8a8c-44f6-916f-0bfafd1e5f69 None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:33:55.549604 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 226/477] 10.222.0.65 () {56 vars in 1109 bytes} [Thu Oct 27 09:33:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 09:33:55.550921 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5361c03d-4d7c-45a2-aa88-d96fd8b8837f None None] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:33:55.551215 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5361c03d-4d7c-45a2-aa88-d96fd8b8837f None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:33:55.551496 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5361c03d-4d7c-45a2-aa88-d96fd8b8837f None None] PATH_INFO: `/` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:33:55.552057 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea95b95f-bf64-447f-90f8-1ce3b57f7817 None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:33:55.557338 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 227/478] 10.222.0.65 () {54 vars in 927 bytes} [Thu Oct 27 09:33:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 09:33:55.557338 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5361c03d-4d7c-45a2-aa88-d96fd8b8837f None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:33:55.599717 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bce80cf-82d6-48e7-879a-bd2cf74d52ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:33:55.599717 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bce80cf-82d6-48e7-879a-bd2cf74d52ef None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:33:55.599717 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bce80cf-82d6-48e7-879a-bd2cf74d52ef None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:33:55.599717 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bce80cf-82d6-48e7-879a-bd2cf74d52ef None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:33:55.600844 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bce80cf-82d6-48e7-879a-bd2cf74d52ef None admin] RBAC: Adding query filter params (role.id=8d728ccbaa534a949df6711b47151356, scope.project.id=dc2e3a7a1bcc480891c0b433291c00b1, user.id=c4b0886666584397be686ee02a505269) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 09:33:55.601158 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bce80cf-82d6-48e7-879a-bd2cf74d52ef None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:33:55.602622 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bce80cf-82d6-48e7-879a-bd2cf74d52ef None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:33:55.618719 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 252/479] 10.222.0.65 () {56 vars in 1374 bytes} [Thu Oct 27 09:33:55 2022] GET /identity/v3/role_assignments?user.id=c4b0886666584397be686ee02a505269&scope.project.id=dc2e3a7a1bcc480891c0b433291c00b1&role.id=8d728ccbaa534a949df6711b47151356 => generated 608 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 09:33:55.618719 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bce80cf-82d6-48e7-879a-bd2cf74d52ef None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:33:55.711496 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:33:55.720860 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5361c03d-4d7c-45a2-aa88-d96fd8b8837f None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:33:55.769142 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d5d9f7-f88a-4e84-8ff0-15c12afc5ff3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:33:55.770757 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d5d9f7-f88a-4e84-8ff0-15c12afc5ff3 None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:33:55.771256 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d5d9f7-f88a-4e84-8ff0-15c12afc5ff3 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:33:55.771708 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d5d9f7-f88a-4e84-8ff0-15c12afc5ff3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:33:55.796119 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:33:55.824773 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bce80cf-82d6-48e7-879a-bd2cf74d52ef None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:33:55.879179 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d5d9f7-f88a-4e84-8ff0-15c12afc5ff3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:33:55.880601 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d5d9f7-f88a-4e84-8ff0-15c12afc5ff3 None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:33:55.884118 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c030c7c2-9520-40e0-a8ec-d1bb35a58aa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:33:55.884575 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c030c7c2-9520-40e0-a8ec-d1bb35a58aa9 None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:33:55.884857 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c030c7c2-9520-40e0-a8ec-d1bb35a58aa9 None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:33:55.885129 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c030c7c2-9520-40e0-a8ec-d1bb35a58aa9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:33:55.894881 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c030c7c2-9520-40e0-a8ec-d1bb35a58aa9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:33:55.896350 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c030c7c2-9520-40e0-a8ec-d1bb35a58aa9 None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:33:55.908573 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application [None req-c030c7c2-9520-40e0-a8ec-d1bb35a58aa9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 27 09:33:55.908573 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 09:33:55.908573 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 09:33:55.908573 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 09:33:55.908573 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 09:33:55.908573 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 09:33:55.908573 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 09:33:55.908573 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 09:33:55.908573 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 09:33:55.908573 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 09:33:55.908573 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 09:33:55.908573 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 09:33:55.908573 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 27 09:33:55.908573 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 27 09:33:55.908573 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 27 09:33:55.909537 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 27 09:33:55.909537 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 09:33:55.909537 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 09:33:55.909537 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 09:33:55.909537 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 09:33:55.909537 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 09:33:55.909537 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 09:33:55.909537 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 09:33:55.909537 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application with Lock( Oct 27 09:33:55.909537 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 09:33:55.909537 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._enter() Oct 27 09:33:55.909537 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 09:33:55.909537 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 09:33:55.909537 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 09:33:55.909537 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.creator() Oct 27 09:33:55.909537 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 09:33:55.909537 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application created_value = creator( Oct 27 09:33:55.910363 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 27 09:33:55.910363 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 27 09:33:55.910363 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 27 09:33:55.910363 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 27 09:33:55.910363 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 27 09:33:55.910363 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 27 09:33:55.910363 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 27 09:33:55.910363 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application Oct 27 09:33:55.911260 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 253/480] 10.222.0.65 () {56 vars in 1111 bytes} [Thu Oct 27 09:33:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 301 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 09:33:55.912501 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5058e3b9-f0ab-48c6-9d4d-11ba4886b34c None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:33:55.912501 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5058e3b9-f0ab-48c6-9d4d-11ba4886b34c None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:33:55.912681 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5058e3b9-f0ab-48c6-9d4d-11ba4886b34c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:33:55.935625 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-5058e3b9-f0ab-48c6-9d4d-11ba4886b34c None None] MFA Rules not processed for user `b5065084bf664b99bdeac46067cb0f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:33:55.936864 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-5058e3b9-f0ab-48c6-9d4d-11ba4886b34c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:33:56.011836 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:33:56.014655 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 254/481] 10.222.0.65 () {58 vars in 1024 bytes} [Thu Oct 27 09:33:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 27 09:33:56.015514 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5058e3b9-f0ab-48c6-9d4d-11ba4886b34c None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:33:56.020276 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 228/482] 10.222.0.65 () {58 vars in 1282 bytes} [Thu Oct 27 09:33:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 467 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 27 09:33:56.026043 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d5d9f7-f88a-4e84-8ff0-15c12afc5ff3 None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:33:56.146924 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:33:56.170347 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d5d9f7-f88a-4e84-8ff0-15c12afc5ff3 None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:33:56.211668 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b1f975-bd56-4fef-9350-01e60633302a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:33:56.212310 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b1f975-bd56-4fef-9350-01e60633302a None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:33:56.212595 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b1f975-bd56-4fef-9350-01e60633302a None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:33:56.212875 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b1f975-bd56-4fef-9350-01e60633302a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:33:56.218964 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5058e3b9-f0ab-48c6-9d4d-11ba4886b34c None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:33:56.225408 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b1f975-bd56-4fef-9350-01e60633302a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:33:56.228028 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b1f975-bd56-4fef-9350-01e60633302a None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:33:56.247350 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application [None req-30b1f975-bd56-4fef-9350-01e60633302a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 09:33:56.247350 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 09:33:56.247350 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 09:33:56.247350 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 09:33:56.247350 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 09:33:56.247350 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 09:33:56.247350 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 09:33:56.247350 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 09:33:56.247350 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 09:33:56.247350 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 09:33:56.247350 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 09:33:56.247350 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 09:33:56.247350 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 27 09:33:56.247350 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 27 09:33:56.247350 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 27 09:33:56.247350 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 27 09:33:56.248367 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 09:33:56.248367 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 09:33:56.248367 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 09:33:56.248367 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 09:33:56.248367 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 09:33:56.248367 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 09:33:56.248367 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 09:33:56.248367 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application with Lock( Oct 27 09:33:56.248367 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 09:33:56.248367 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._enter() Oct 27 09:33:56.248367 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 09:33:56.248367 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 09:33:56.248367 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 09:33:56.248367 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.creator() Oct 27 09:33:56.248367 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 09:33:56.248367 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application created_value = creator( Oct 27 09:33:56.248367 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 27 09:33:56.249181 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 27 09:33:56.249181 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 09:33:56.249181 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application Oct 27 09:33:56.249181 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 229/483] 10.222.0.65 () {56 vars in 1108 bytes} [Thu Oct 27 09:33:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 09:33:56.254548 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b1f975-bd56-4fef-9350-01e60633302a None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:33:56.322950 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:33:56.329837 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13b6056-a2ef-4775-aca9-ff2ef42bc5f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:33:56.330477 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13b6056-a2ef-4775-aca9-ff2ef42bc5f2 None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:33:56.330785 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13b6056-a2ef-4775-aca9-ff2ef42bc5f2 None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:33:56.331059 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13b6056-a2ef-4775-aca9-ff2ef42bc5f2 None admin] PATH_INFO: `/v3/projects` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:33:56.331762 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13b6056-a2ef-4775-aca9-ff2ef42bc5f2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 09:33:56.332069 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13b6056-a2ef-4775-aca9-ff2ef42bc5f2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:33:56.333602 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13b6056-a2ef-4775-aca9-ff2ef42bc5f2 None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:33:56.351977 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 255/484] 10.222.0.65 () {56 vars in 1148 bytes} [Thu Oct 27 09:33:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 337 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 09:33:56.353238 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13b6056-a2ef-4775-aca9-ff2ef42bc5f2 None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:33:56.378212 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b1f975-bd56-4fef-9350-01e60633302a None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:33:56.429726 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9f8d4e-5bfe-4855-ab28-694d6c0d5acd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:33:56.430701 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9f8d4e-5bfe-4855-ab28-694d6c0d5acd None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:33:56.430995 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9f8d4e-5bfe-4855-ab28-694d6c0d5acd None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:33:56.431267 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9f8d4e-5bfe-4855-ab28-694d6c0d5acd None admin] PATH_INFO: `/v3/domains` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:33:56.432071 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9f8d4e-5bfe-4855-ab28-694d6c0d5acd None admin] RBAC: Adding query filter params (name=Default) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 09:33:56.432498 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9f8d4e-5bfe-4855-ab28-694d6c0d5acd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:33:56.433923 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9f8d4e-5bfe-4855-ab28-694d6c0d5acd None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:33:56.454560 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 230/485] 10.222.0.65 () {56 vars in 1109 bytes} [Thu Oct 27 09:33:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 09:33:56.455971 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9f8d4e-5bfe-4855-ab28-694d6c0d5acd None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:33:56.478946 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13b6056-a2ef-4775-aca9-ff2ef42bc5f2 None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:33:56.525653 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e90c7a-f6ff-4a92-a54c-fec3193291c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:33:56.527235 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e90c7a-f6ff-4a92-a54c-fec3193291c5 None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:33:56.527707 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e90c7a-f6ff-4a92-a54c-fec3193291c5 None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:33:56.528183 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e90c7a-f6ff-4a92-a54c-fec3193291c5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:33:56.539120 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:33:56.546197 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e90c7a-f6ff-4a92-a54c-fec3193291c5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 09:33:56.552489 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application [None req-20e90c7a-f6ff-4a92-a54c-fec3193291c5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 27 09:33:56.552489 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 09:33:56.552489 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 09:33:56.552489 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 09:33:56.552489 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 09:33:56.552489 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 09:33:56.552489 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 09:33:56.552489 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 09:33:56.552489 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 09:33:56.552489 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 09:33:56.552489 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 09:33:56.552489 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 09:33:56.552489 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 27 09:33:56.552489 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 27 09:33:56.552489 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 27 09:33:56.552489 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 27 09:33:56.553982 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 27 09:33:56.553982 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 27 09:33:56.553982 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 27 09:33:56.553982 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 27 09:33:56.553982 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 09:33:56.553982 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 09:33:56.553982 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 09:33:56.553982 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 09:33:56.553982 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 09:33:56.553982 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 09:33:56.553982 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 09:33:56.553982 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application with Lock( Oct 27 09:33:56.553982 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 09:33:56.553982 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._enter() Oct 27 09:33:56.553982 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 09:33:56.553982 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 09:33:56.554962 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 09:33:56.554962 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.creator() Oct 27 09:33:56.554962 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 09:33:56.554962 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application created_value = creator( Oct 27 09:33:56.554962 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 27 09:33:56.554962 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 27 09:33:56.554962 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 27 09:33:56.554962 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 27 09:33:56.554962 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 27 09:33:56.554962 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 27 09:33:56.554962 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 27 09:33:56.554962 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application Oct 27 09:33:56.557845 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 256/486] 10.222.0.65 () {56 vars in 1102 bytes} [Thu Oct 27 09:33:56 2022] GET /identity/v3/roles/service => generated 85 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 09:33:56.558888 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e90c7a-f6ff-4a92-a54c-fec3193291c5 None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:33:56.589892 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9f8d4e-5bfe-4855-ab28-694d6c0d5acd None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:33:56.601335 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:33:56.637464 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2257b479-682d-4a2f-b19b-8935fe3e296f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:33:56.638628 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2257b479-682d-4a2f-b19b-8935fe3e296f None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:33:56.639079 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2257b479-682d-4a2f-b19b-8935fe3e296f None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:33:56.639744 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2257b479-682d-4a2f-b19b-8935fe3e296f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:33:56.641031 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2257b479-682d-4a2f-b19b-8935fe3e296f None admin] RBAC: Adding query filter params (role.id=8d728ccbaa534a949df6711b47151356, scope.project.id=dc2e3a7a1bcc480891c0b433291c00b1, user.id=b8e5d5f04c4741bb86ca4a0f667d4ec0) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 09:33:56.642651 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2257b479-682d-4a2f-b19b-8935fe3e296f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:33:56.644485 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2257b479-682d-4a2f-b19b-8935fe3e296f None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:33:56.653558 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 231/487] 10.222.0.65 () {56 vars in 1374 bytes} [Thu Oct 27 09:33:56 2022] GET /identity/v3/role_assignments?user.id=b8e5d5f04c4741bb86ca4a0f667d4ec0&scope.project.id=dc2e3a7a1bcc480891c0b433291c00b1&role.id=8d728ccbaa534a949df6711b47151356 => generated 608 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 09:33:56.654677 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2257b479-682d-4a2f-b19b-8935fe3e296f None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:33:56.732572 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e90c7a-f6ff-4a92-a54c-fec3193291c5 None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:33:56.785214 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2257b479-682d-4a2f-b19b-8935fe3e296f None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:33:56.827956 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b73b7cb-248d-4dbd-8174-5e2175efd2e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:33:56.828872 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b73b7cb-248d-4dbd-8174-5e2175efd2e5 None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:33:56.829292 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b73b7cb-248d-4dbd-8174-5e2175efd2e5 None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:33:56.829663 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b73b7cb-248d-4dbd-8174-5e2175efd2e5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:33:56.830493 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e26efe0-fd52-4e21-905f-9331d97f6ad9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:33:56.831300 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e26efe0-fd52-4e21-905f-9331d97f6ad9 None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:33:56.831709 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e26efe0-fd52-4e21-905f-9331d97f6ad9 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:33:56.832115 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e26efe0-fd52-4e21-905f-9331d97f6ad9 None admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:33:56.832960 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e26efe0-fd52-4e21-905f-9331d97f6ad9 None admin] RBAC: Adding query filter params (name=service) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 09:33:56.833388 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e26efe0-fd52-4e21-905f-9331d97f6ad9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:33:56.835072 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e26efe0-fd52-4e21-905f-9331d97f6ad9 None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:33:56.846436 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 232/488] 10.222.0.65 () {56 vars in 1103 bytes} [Thu Oct 27 09:33:56 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 09:33:56.848336 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b73b7cb-248d-4dbd-8174-5e2175efd2e5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:33:56.849851 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b73b7cb-248d-4dbd-8174-5e2175efd2e5 None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:33:56.857778 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e26efe0-fd52-4e21-905f-9331d97f6ad9 None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:33:56.880312 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application [None req-5b73b7cb-248d-4dbd-8174-5e2175efd2e5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 27 09:33:56.880312 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 09:33:56.880312 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 09:33:56.880312 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 09:33:56.880312 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 09:33:56.880312 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 09:33:56.880312 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 09:33:56.880312 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 09:33:56.880312 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 09:33:56.880312 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 09:33:56.880312 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 09:33:56.880312 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 09:33:56.880312 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 27 09:33:56.880312 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 27 09:33:56.880312 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 27 09:33:56.881227 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 27 09:33:56.881227 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 09:33:56.881227 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 09:33:56.881227 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 09:33:56.881227 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 09:33:56.881227 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 09:33:56.881227 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 09:33:56.881227 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 09:33:56.881227 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application with Lock( Oct 27 09:33:56.881227 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 09:33:56.881227 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._enter() Oct 27 09:33:56.881227 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 09:33:56.881227 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 09:33:56.881227 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 09:33:56.881227 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.creator() Oct 27 09:33:56.881227 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 09:33:56.881227 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application created_value = creator( Oct 27 09:33:56.882038 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 27 09:33:56.882038 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 27 09:33:56.882038 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 27 09:33:56.882038 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 27 09:33:56.882038 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 27 09:33:56.882038 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 27 09:33:56.882038 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 27 09:33:56.882038 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application Oct 27 09:33:56.887008 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 257/489] 10.222.0.65 () {56 vars in 1111 bytes} [Thu Oct 27 09:33:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 328 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 09:33:56.892926 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b73b7cb-248d-4dbd-8174-5e2175efd2e5 None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:33:56.909209 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:33:56.994304 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e26efe0-fd52-4e21-905f-9331d97f6ad9 None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:33:57.016646 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:33:57.046416 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3d0113-90c0-4edf-8cc7-3632bf2ea4a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:33:57.047103 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3d0113-90c0-4edf-8cc7-3632bf2ea4a9 None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:33:57.047427 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3d0113-90c0-4edf-8cc7-3632bf2ea4a9 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:33:57.047699 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3d0113-90c0-4edf-8cc7-3632bf2ea4a9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:33:57.060376 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3d0113-90c0-4edf-8cc7-3632bf2ea4a9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:33:57.061851 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3d0113-90c0-4edf-8cc7-3632bf2ea4a9 None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:33:57.072373 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b73b7cb-248d-4dbd-8174-5e2175efd2e5 None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:33:57.077692 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application [None req-ee3d0113-90c0-4edf-8cc7-3632bf2ea4a9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 09:33:57.077692 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 09:33:57.077692 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 09:33:57.077692 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 09:33:57.077692 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 09:33:57.077692 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 09:33:57.077692 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 09:33:57.077692 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 09:33:57.077692 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 09:33:57.077692 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 09:33:57.077692 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 09:33:57.077692 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 09:33:57.077692 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 27 09:33:57.077692 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 27 09:33:57.077692 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 27 09:33:57.077692 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 27 09:33:57.079179 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 09:33:57.079179 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 09:33:57.079179 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 09:33:57.079179 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 09:33:57.079179 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 09:33:57.079179 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 09:33:57.079179 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 09:33:57.079179 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application with Lock( Oct 27 09:33:57.079179 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 09:33:57.079179 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._enter() Oct 27 09:33:57.079179 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 09:33:57.079179 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 09:33:57.079179 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 09:33:57.079179 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.creator() Oct 27 09:33:57.079179 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 09:33:57.079179 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application created_value = creator( Oct 27 09:33:57.079179 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 27 09:33:57.080183 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 27 09:33:57.080183 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 09:33:57.080183 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application Oct 27 09:33:57.080183 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 233/490] 10.222.0.65 () {56 vars in 1108 bytes} [Thu Oct 27 09:33:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 09:33:57.080407 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f75e0b0-49f9-4efa-998c-7fb07712ce74 None None] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:33:57.080900 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f75e0b0-49f9-4efa-998c-7fb07712ce74 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:33:57.080900 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f75e0b0-49f9-4efa-998c-7fb07712ce74 None None] PATH_INFO: `/` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:33:57.084108 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 234/491] 10.222.0.65 () {54 vars in 927 bytes} [Thu Oct 27 09:33:57 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 09:33:57.087751 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0baa91f3-a070-41da-81c3-673e400b2430 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:33:57.088107 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0baa91f3-a070-41da-81c3-673e400b2430 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:33:57.088450 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0baa91f3-a070-41da-81c3-673e400b2430 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:33:57.108207 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-0baa91f3-a070-41da-81c3-673e400b2430 None None] MFA Rules not processed for user `b5065084bf664b99bdeac46067cb0f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:33:57.109615 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-0baa91f3-a070-41da-81c3-673e400b2430 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:33:57.115347 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f30578-ca01-4993-bedb-ebbf9eb3a71a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:33:57.116271 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f30578-ca01-4993-bedb-ebbf9eb3a71a None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:33:57.116728 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f30578-ca01-4993-bedb-ebbf9eb3a71a None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:33:57.117211 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f30578-ca01-4993-bedb-ebbf9eb3a71a None admin] PATH_INFO: `/v3/projects` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:33:57.118074 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f30578-ca01-4993-bedb-ebbf9eb3a71a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 09:33:57.118960 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f30578-ca01-4993-bedb-ebbf9eb3a71a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:33:57.122443 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f30578-ca01-4993-bedb-ebbf9eb3a71a None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:33:57.145573 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 258/492] 10.222.0.65 () {56 vars in 1148 bytes} [Thu Oct 27 09:33:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 09:33:57.147305 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f30578-ca01-4993-bedb-ebbf9eb3a71a None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:33:57.190559 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 235/493] 10.222.0.65 () {58 vars in 1024 bytes} [Thu Oct 27 09:33:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 27 09:33:57.190559 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0baa91f3-a070-41da-81c3-673e400b2430 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:33:57.205629 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:33:57.293319 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0baa91f3-a070-41da-81c3-673e400b2430 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:33:57.331675 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f30578-ca01-4993-bedb-ebbf9eb3a71a None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:33:57.335843 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe8c2de-d9c0-4aa9-9ec4-f9b59728bc1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:33:57.336449 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe8c2de-d9c0-4aa9-9ec4-f9b59728bc1e None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:33:57.336823 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe8c2de-d9c0-4aa9-9ec4-f9b59728bc1e None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:33:57.337210 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe8c2de-d9c0-4aa9-9ec4-f9b59728bc1e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:33:57.338033 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe8c2de-d9c0-4aa9-9ec4-f9b59728bc1e None admin] RBAC: Adding query filter params (role.id=8d728ccbaa534a949df6711b47151356, scope.project.id=dc2e3a7a1bcc480891c0b433291c00b1, user.id=6191cc41efa74f46b49022cf387f7a4c) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 09:33:57.338438 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe8c2de-d9c0-4aa9-9ec4-f9b59728bc1e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:33:57.346541 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe8c2de-d9c0-4aa9-9ec4-f9b59728bc1e None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:33:57.351105 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 236/494] 10.222.0.65 () {56 vars in 1374 bytes} [Thu Oct 27 09:33:57 2022] GET /identity/v3/role_assignments?user.id=6191cc41efa74f46b49022cf387f7a4c&scope.project.id=dc2e3a7a1bcc480891c0b433291c00b1&role.id=8d728ccbaa534a949df6711b47151356 => generated 608 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 09:33:57.371483 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:33:57.421110 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8066dc0-5377-4e18-81b7-05071499d572 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:33:57.421738 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8066dc0-5377-4e18-81b7-05071499d572 None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:33:57.422020 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8066dc0-5377-4e18-81b7-05071499d572 None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:33:57.422293 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8066dc0-5377-4e18-81b7-05071499d572 None admin] PATH_INFO: `/v3/domains` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:33:57.423011 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8066dc0-5377-4e18-81b7-05071499d572 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 09:33:57.423314 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8066dc0-5377-4e18-81b7-05071499d572 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:33:57.424722 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8066dc0-5377-4e18-81b7-05071499d572 None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:33:57.446454 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 259/495] 10.222.0.65 () {56 vars in 1109 bytes} [Thu Oct 27 09:33:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 09:33:57.452329 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe8c2de-d9c0-4aa9-9ec4-f9b59728bc1e None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:33:57.557416 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:33:57.578912 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe8c2de-d9c0-4aa9-9ec4-f9b59728bc1e None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:33:57.586104 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8066dc0-5377-4e18-81b7-05071499d572 None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:33:57.627731 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df52f6ad-185e-456f-8991-28332804f217 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:33:57.628592 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df52f6ad-185e-456f-8991-28332804f217 None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:33:57.628964 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df52f6ad-185e-456f-8991-28332804f217 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:33:57.629136 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df52f6ad-185e-456f-8991-28332804f217 None admin] PATH_INFO: `/v3/users/swift` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:33:57.638051 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df52f6ad-185e-456f-8991-28332804f217 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:33:57.639659 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df52f6ad-185e-456f-8991-28332804f217 None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:33:57.653039 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application [None req-df52f6ad-185e-456f-8991-28332804f217 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 27 09:33:57.653039 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 09:33:57.653039 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 09:33:57.653039 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 09:33:57.653039 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 09:33:57.653039 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 09:33:57.653039 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 09:33:57.653039 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 09:33:57.653039 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 09:33:57.653039 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 09:33:57.653039 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 09:33:57.653039 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 09:33:57.653039 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 27 09:33:57.653039 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 27 09:33:57.653039 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 27 09:33:57.653039 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 27 09:33:57.653991 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 09:33:57.653991 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 09:33:57.653991 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 27 09:33:57.653991 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 27 09:33:57.653991 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 27 09:33:57.653991 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 27 09:33:57.653991 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 09:33:57.653991 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 09:33:57.653991 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 09:33:57.653991 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 09:33:57.653991 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 09:33:57.653991 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application with Lock( Oct 27 09:33:57.653991 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 09:33:57.653991 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._enter() Oct 27 09:33:57.653991 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 09:33:57.653991 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 09:33:57.653991 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 09:33:57.653991 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.creator() Oct 27 09:33:57.654986 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 09:33:57.654986 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application created_value = creator( Oct 27 09:33:57.654986 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 27 09:33:57.654986 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 27 09:33:57.654986 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 27 09:33:57.654986 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 27 09:33:57.654986 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 27 09:33:57.654986 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 27 09:33:57.654986 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 27 09:33:57.654986 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application Oct 27 09:33:57.658534 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 237/496] 10.222.0.65 () {56 vars in 1096 bytes} [Thu Oct 27 09:33:57 2022] GET /identity/v3/users/swift => generated 83 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 09:33:57.660371 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df52f6ad-185e-456f-8991-28332804f217 None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:33:57.716432 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8066dc0-5377-4e18-81b7-05071499d572 None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:33:57.758983 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b63d5e9-2edf-47f2-96f1-e564031c1373 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:33:57.759982 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b63d5e9-2edf-47f2-96f1-e564031c1373 None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:33:57.760479 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b63d5e9-2edf-47f2-96f1-e564031c1373 None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:33:57.761464 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b63d5e9-2edf-47f2-96f1-e564031c1373 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:33:57.774905 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b63d5e9-2edf-47f2-96f1-e564031c1373 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 09:33:57.780670 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df52f6ad-185e-456f-8991-28332804f217 None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:33:57.781745 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application [None req-9b63d5e9-2edf-47f2-96f1-e564031c1373 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 27 09:33:57.781745 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 09:33:57.781745 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 09:33:57.781745 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 09:33:57.781745 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 09:33:57.781745 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 09:33:57.781745 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 09:33:57.781745 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 09:33:57.781745 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 09:33:57.781745 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 09:33:57.781745 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 09:33:57.781745 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 09:33:57.781745 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 27 09:33:57.781745 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 27 09:33:57.781745 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 27 09:33:57.781745 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 27 09:33:57.782640 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 27 09:33:57.782640 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 27 09:33:57.782640 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 27 09:33:57.782640 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 27 09:33:57.782640 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 09:33:57.782640 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 09:33:57.782640 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 09:33:57.782640 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 09:33:57.782640 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 09:33:57.782640 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 09:33:57.782640 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 09:33:57.782640 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application with Lock( Oct 27 09:33:57.782640 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 09:33:57.782640 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._enter() Oct 27 09:33:57.782640 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 09:33:57.782640 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 09:33:57.783428 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 09:33:57.783428 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.creator() Oct 27 09:33:57.783428 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 09:33:57.783428 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application created_value = creator( Oct 27 09:33:57.783428 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 27 09:33:57.783428 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 27 09:33:57.783428 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 27 09:33:57.783428 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 27 09:33:57.783428 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 27 09:33:57.783428 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 27 09:33:57.783428 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 27 09:33:57.783428 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application Oct 27 09:33:57.786042 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 260/497] 10.222.0.65 () {56 vars in 1096 bytes} [Thu Oct 27 09:33:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 27 09:33:57.793249 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b63d5e9-2edf-47f2-96f1-e564031c1373 None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:33:57.829554 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4101e2ce-88cb-4e6c-b357-62b299882bbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:33:57.830691 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4101e2ce-88cb-4e6c-b357-62b299882bbe None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:33:57.831190 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4101e2ce-88cb-4e6c-b357-62b299882bbe None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:33:57.831652 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4101e2ce-88cb-4e6c-b357-62b299882bbe None admin] PATH_INFO: `/v3/users` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:33:57.832636 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4101e2ce-88cb-4e6c-b357-62b299882bbe None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 09:33:57.833132 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4101e2ce-88cb-4e6c-b357-62b299882bbe None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:33:57.834984 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4101e2ce-88cb-4e6c-b357-62b299882bbe None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:33:57.855991 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:33:57.869915 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 238/498] 10.222.0.65 () {56 vars in 1135 bytes} [Thu Oct 27 09:33:57 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 09:33:57.876338 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4101e2ce-88cb-4e6c-b357-62b299882bbe None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:33:57.895741 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:33:57.977264 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b63d5e9-2edf-47f2-96f1-e564031c1373 None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:33:58.013136 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667a6fa6-0b62-421c-8984-daabbe33be7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:33:58.013764 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667a6fa6-0b62-421c-8984-daabbe33be7b None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:33:58.014040 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667a6fa6-0b62-421c-8984-daabbe33be7b None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:33:58.014319 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667a6fa6-0b62-421c-8984-daabbe33be7b None admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:33:58.015022 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667a6fa6-0b62-421c-8984-daabbe33be7b None admin] RBAC: Adding query filter params (name=admin) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 09:33:58.015325 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667a6fa6-0b62-421c-8984-daabbe33be7b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:33:58.016870 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667a6fa6-0b62-421c-8984-daabbe33be7b None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:33:58.027747 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 261/499] 10.222.0.65 () {56 vars in 1099 bytes} [Thu Oct 27 09:33:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 09:33:58.034687 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667a6fa6-0b62-421c-8984-daabbe33be7b None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:33:58.094311 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4101e2ce-88cb-4e6c-b357-62b299882bbe None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:33:58.132010 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4bd7e3-fc9c-4fa5-b100-ce4ec69835f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:33:58.132639 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4bd7e3-fc9c-4fa5-b100-ce4ec69835f0 None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:33:58.132923 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4bd7e3-fc9c-4fa5-b100-ce4ec69835f0 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:33:58.133204 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4bd7e3-fc9c-4fa5-b100-ce4ec69835f0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:33:58.155941 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667a6fa6-0b62-421c-8984-daabbe33be7b None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:33:58.168014 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:33:58.210862 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50aea1a-6473-42a6-b48a-1e4716ecd8ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:33:58.211639 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50aea1a-6473-42a6-b48a-1e4716ecd8ff None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:33:58.211927 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50aea1a-6473-42a6-b48a-1e4716ecd8ff None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:33:58.212203 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50aea1a-6473-42a6-b48a-1e4716ecd8ff None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:33:58.221909 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:33:58.225771 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4bd7e3-fc9c-4fa5-b100-ce4ec69835f0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:33:58.225894 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50aea1a-6473-42a6-b48a-1e4716ecd8ff None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:33:58.227423 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50aea1a-6473-42a6-b48a-1e4716ecd8ff None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:33:58.227537 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4bd7e3-fc9c-4fa5-b100-ce4ec69835f0 None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:33:58.243762 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application [None req-d50aea1a-6473-42a6-b48a-1e4716ecd8ff None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 09:33:58.243762 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 09:33:58.243762 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 09:33:58.243762 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 09:33:58.243762 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 09:33:58.243762 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 09:33:58.243762 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 09:33:58.243762 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 09:33:58.243762 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 09:33:58.243762 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 09:33:58.243762 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 09:33:58.243762 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 09:33:58.243762 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 27 09:33:58.243762 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 27 09:33:58.243762 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 27 09:33:58.243762 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 27 09:33:58.257060 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 09:33:58.257060 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 09:33:58.257060 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 09:33:58.257060 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 09:33:58.257060 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 09:33:58.257060 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 09:33:58.257060 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 09:33:58.257060 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application with Lock( Oct 27 09:33:58.257060 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 09:33:58.257060 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._enter() Oct 27 09:33:58.257060 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 09:33:58.257060 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 09:33:58.257060 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 09:33:58.257060 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.creator() Oct 27 09:33:58.257060 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 09:33:58.257060 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application created_value = creator( Oct 27 09:33:58.257060 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 27 09:33:58.257921 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 27 09:33:58.257921 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 09:33:58.257921 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application Oct 27 09:33:58.257921 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 262/500] 10.222.0.65 () {56 vars in 1108 bytes} [Thu Oct 27 09:33:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 27 09:33:58.257921 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93334630-8cee-4307-b2b1-0e898a5f1401 None None] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:33:58.257921 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93334630-8cee-4307-b2b1-0e898a5f1401 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:33:58.257921 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93334630-8cee-4307-b2b1-0e898a5f1401 None None] PATH_INFO: `/` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:33:58.257921 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 263/501] 10.222.0.65 () {54 vars in 927 bytes} [Thu Oct 27 09:33:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 09:33:58.257921 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2932f6-510a-4ef6-82a0-d91ea3590be6 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:33:58.258413 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2932f6-510a-4ef6-82a0-d91ea3590be6 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:33:58.258413 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2932f6-510a-4ef6-82a0-d91ea3590be6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:33:58.276029 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-4d2932f6-510a-4ef6-82a0-d91ea3590be6 None None] MFA Rules not processed for user `b5065084bf664b99bdeac46067cb0f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:33:58.278425 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-4d2932f6-510a-4ef6-82a0-d91ea3590be6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:33:58.353415 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 239/502] 10.222.0.65 () {58 vars in 1282 bytes} [Thu Oct 27 09:33:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 473 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 27 09:33:58.355085 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4bd7e3-fc9c-4fa5-b100-ce4ec69835f0 None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:33:58.362112 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 264/503] 10.222.0.65 () {58 vars in 1024 bytes} [Thu Oct 27 09:33:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 27 09:33:58.363243 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2932f6-510a-4ef6-82a0-d91ea3590be6 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:33:58.476397 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4bd7e3-fc9c-4fa5-b100-ce4ec69835f0 None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:33:58.482837 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:33:58.499163 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:33:58.517124 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2932f6-510a-4ef6-82a0-d91ea3590be6 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:33:58.559203 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5046cd-6c38-44ed-84f0-017fc3243a2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:33:58.559945 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5046cd-6c38-44ed-84f0-017fc3243a2e None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:33:58.560358 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5046cd-6c38-44ed-84f0-017fc3243a2e None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:33:58.560700 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5046cd-6c38-44ed-84f0-017fc3243a2e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:33:58.572834 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5046cd-6c38-44ed-84f0-017fc3243a2e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:33:58.575610 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5046cd-6c38-44ed-84f0-017fc3243a2e None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:33:58.592773 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application [None req-ad5046cd-6c38-44ed-84f0-017fc3243a2e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 09:33:58.592773 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 09:33:58.592773 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 09:33:58.592773 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 09:33:58.592773 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 09:33:58.592773 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 09:33:58.592773 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 09:33:58.592773 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 09:33:58.592773 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 09:33:58.592773 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 09:33:58.592773 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 09:33:58.592773 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 09:33:58.592773 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 27 09:33:58.592773 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 27 09:33:58.592773 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 27 09:33:58.592773 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 27 09:33:58.600062 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 09:33:58.600062 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 09:33:58.600062 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 09:33:58.600062 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 09:33:58.600062 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 09:33:58.600062 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 09:33:58.600062 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 09:33:58.600062 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application with Lock( Oct 27 09:33:58.600062 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 09:33:58.600062 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._enter() Oct 27 09:33:58.600062 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 09:33:58.600062 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 09:33:58.600062 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 09:33:58.600062 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.creator() Oct 27 09:33:58.600062 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 09:33:58.600062 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application created_value = creator( Oct 27 09:33:58.600062 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 27 09:33:58.601001 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 27 09:33:58.601001 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 09:33:58.601001 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application Oct 27 09:33:58.601001 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 265/504] 10.222.0.65 () {56 vars in 1108 bytes} [Thu Oct 27 09:33:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 09:33:58.601001 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5046cd-6c38-44ed-84f0-017fc3243a2e None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:33:58.601290 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f477aff-2c3e-49b5-a81d-fe1ec6357fb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:33:58.606679 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f477aff-2c3e-49b5-a81d-fe1ec6357fb2 None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:33:58.606679 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f477aff-2c3e-49b5-a81d-fe1ec6357fb2 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:33:58.606679 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f477aff-2c3e-49b5-a81d-fe1ec6357fb2 None admin] PATH_INFO: `/v3/domains` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:33:58.606679 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f477aff-2c3e-49b5-a81d-fe1ec6357fb2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 09:33:58.606679 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f477aff-2c3e-49b5-a81d-fe1ec6357fb2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:33:58.607900 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f477aff-2c3e-49b5-a81d-fe1ec6357fb2 None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:33:58.635563 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 240/505] 10.222.0.65 () {56 vars in 1109 bytes} [Thu Oct 27 09:33:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 09:33:58.642354 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f477aff-2c3e-49b5-a81d-fe1ec6357fb2 None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:33:58.792749 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5046cd-6c38-44ed-84f0-017fc3243a2e None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:33:58.794151 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f477aff-2c3e-49b5-a81d-fe1ec6357fb2 None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:33:58.833696 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6155fb1-8e58-4886-95df-6c48ff4590a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:33:58.834328 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6155fb1-8e58-4886-95df-6c48ff4590a3 None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:33:58.834639 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6155fb1-8e58-4886-95df-6c48ff4590a3 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:33:58.834914 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6155fb1-8e58-4886-95df-6c48ff4590a3 None admin] PATH_INFO: `/v3/users/nova` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:33:58.839913 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1725b55f-be56-4ca3-9868-2f02978a743b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:33:58.840534 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1725b55f-be56-4ca3-9868-2f02978a743b None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:33:58.843622 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1725b55f-be56-4ca3-9868-2f02978a743b None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:33:58.843622 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1725b55f-be56-4ca3-9868-2f02978a743b None admin] PATH_INFO: `/v3/domains` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:33:58.843622 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1725b55f-be56-4ca3-9868-2f02978a743b None admin] RBAC: Adding query filter params (name=Default) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 09:33:58.843622 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1725b55f-be56-4ca3-9868-2f02978a743b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:33:58.843622 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1725b55f-be56-4ca3-9868-2f02978a743b None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:33:58.846861 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:33:58.848823 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6155fb1-8e58-4886-95df-6c48ff4590a3 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:33:58.855996 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6155fb1-8e58-4886-95df-6c48ff4590a3 None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:33:58.858332 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 266/506] 10.222.0.65 () {56 vars in 1109 bytes} [Thu Oct 27 09:33:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 09:33:58.859544 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1725b55f-be56-4ca3-9868-2f02978a743b None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:33:58.870837 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application [None req-b6155fb1-8e58-4886-95df-6c48ff4590a3 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 27 09:33:58.870837 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 09:33:58.870837 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 09:33:58.870837 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 09:33:58.870837 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 09:33:58.870837 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 09:33:58.870837 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 09:33:58.870837 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 09:33:58.870837 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 09:33:58.870837 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 09:33:58.870837 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 09:33:58.870837 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 09:33:58.870837 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 27 09:33:58.870837 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 27 09:33:58.870837 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 27 09:33:58.870837 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 27 09:33:58.871947 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 09:33:58.871947 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 09:33:58.871947 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 27 09:33:58.871947 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 27 09:33:58.871947 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 27 09:33:58.871947 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 27 09:33:58.871947 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 09:33:58.871947 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 09:33:58.871947 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 09:33:58.871947 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 09:33:58.871947 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 09:33:58.871947 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application with Lock( Oct 27 09:33:58.871947 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 09:33:58.871947 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._enter() Oct 27 09:33:58.871947 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 09:33:58.871947 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 09:33:58.871947 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 09:33:58.871947 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.creator() Oct 27 09:33:58.872881 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 09:33:58.872881 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application created_value = creator( Oct 27 09:33:58.872881 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 27 09:33:58.872881 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 27 09:33:58.872881 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 27 09:33:58.872881 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 27 09:33:58.872881 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 27 09:33:58.872881 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 27 09:33:58.872881 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 27 09:33:58.872881 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application Oct 27 09:33:58.875751 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 241/507] 10.222.0.65 () {56 vars in 1093 bytes} [Thu Oct 27 09:33:58 2022] GET /identity/v3/users/nova => generated 82 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 09:33:58.877381 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6155fb1-8e58-4886-95df-6c48ff4590a3 None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:33:58.900578 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:33:58.998127 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6155fb1-8e58-4886-95df-6c48ff4590a3 None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:33:59.007336 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1725b55f-be56-4ca3-9868-2f02978a743b None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:33:59.044409 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c1083e-017d-4449-bd53-8a59592f1714 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:33:59.045162 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c1083e-017d-4449-bd53-8a59592f1714 None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:33:59.045448 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c1083e-017d-4449-bd53-8a59592f1714 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:33:59.045726 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c1083e-017d-4449-bd53-8a59592f1714 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:33:59.046261 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d3c6c3-8120-4767-9539-fe0f5f41f6a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:33:59.047249 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d3c6c3-8120-4767-9539-fe0f5f41f6a9 None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:33:59.047726 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d3c6c3-8120-4767-9539-fe0f5f41f6a9 None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:33:59.048190 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d3c6c3-8120-4767-9539-fe0f5f41f6a9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:33:59.053944 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c1083e-017d-4449-bd53-8a59592f1714 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:33:59.055437 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c1083e-017d-4449-bd53-8a59592f1714 None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:33:59.060435 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d3c6c3-8120-4767-9539-fe0f5f41f6a9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:33:59.062102 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d3c6c3-8120-4767-9539-fe0f5f41f6a9 None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:33:59.069419 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application [None req-51c1083e-017d-4449-bd53-8a59592f1714 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 27 09:33:59.069419 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 09:33:59.069419 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 09:33:59.069419 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 09:33:59.069419 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 09:33:59.069419 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 09:33:59.069419 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 09:33:59.069419 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 09:33:59.069419 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 09:33:59.069419 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 09:33:59.069419 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 09:33:59.069419 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 09:33:59.069419 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 27 09:33:59.069419 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 27 09:33:59.069419 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 27 09:33:59.070295 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 27 09:33:59.070295 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 09:33:59.070295 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 09:33:59.070295 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 09:33:59.070295 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 09:33:59.070295 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 09:33:59.070295 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 09:33:59.070295 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 09:33:59.070295 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application with Lock( Oct 27 09:33:59.070295 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 09:33:59.070295 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._enter() Oct 27 09:33:59.070295 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 09:33:59.070295 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 09:33:59.070295 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 09:33:59.070295 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.creator() Oct 27 09:33:59.070295 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 09:33:59.070295 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application created_value = creator( Oct 27 09:33:59.071214 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 27 09:33:59.071214 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 27 09:33:59.071214 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 27 09:33:59.071214 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 27 09:33:59.071214 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 27 09:33:59.071214 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 27 09:33:59.071214 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 27 09:33:59.071214 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application Oct 27 09:33:59.071214 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 242/508] 10.222.0.65 () {56 vars in 1111 bytes} [Thu Oct 27 09:33:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 09:33:59.071698 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c1083e-017d-4449-bd53-8a59592f1714 None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:33:59.085302 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application [None req-19d3c6c3-8120-4767-9539-fe0f5f41f6a9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 09:33:59.085302 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 09:33:59.085302 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 09:33:59.085302 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 09:33:59.085302 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 09:33:59.085302 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 09:33:59.085302 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 09:33:59.085302 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 09:33:59.085302 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 09:33:59.085302 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 09:33:59.085302 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 09:33:59.085302 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 09:33:59.085302 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 27 09:33:59.085302 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 27 09:33:59.085302 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 27 09:33:59.085302 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 27 09:33:59.086335 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 09:33:59.086335 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 09:33:59.086335 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 09:33:59.086335 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 09:33:59.086335 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 09:33:59.086335 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 09:33:59.086335 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 09:33:59.086335 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application with Lock( Oct 27 09:33:59.086335 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 09:33:59.086335 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._enter() Oct 27 09:33:59.086335 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 09:33:59.086335 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 09:33:59.086335 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 09:33:59.086335 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.creator() Oct 27 09:33:59.086335 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 09:33:59.086335 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application created_value = creator( Oct 27 09:33:59.086335 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 27 09:33:59.087230 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 27 09:33:59.087230 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 09:33:59.087230 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application Oct 27 09:33:59.089616 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 267/509] 10.222.0.65 () {56 vars in 1108 bytes} [Thu Oct 27 09:33:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 09:33:59.090642 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d3c6c3-8120-4767-9539-fe0f5f41f6a9 None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:33:59.140611 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:33:59.181278 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:33:59.216131 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d3c6c3-8120-4767-9539-fe0f5f41f6a9 None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:33:59.219682 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c1083e-017d-4449-bd53-8a59592f1714 None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:33:59.257441 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcf67e7-54dd-4875-8c13-881c41d56bc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:33:59.258048 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcf67e7-54dd-4875-8c13-881c41d56bc9 None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:33:59.258331 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcf67e7-54dd-4875-8c13-881c41d56bc9 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:33:59.258661 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcf67e7-54dd-4875-8c13-881c41d56bc9 None admin] PATH_INFO: `/v3/users` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:33:59.259395 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bcf67e7-54dd-4875-8c13-881c41d56bc9 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 09:33:59.259703 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bcf67e7-54dd-4875-8c13-881c41d56bc9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:33:59.261698 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bcf67e7-54dd-4875-8c13-881c41d56bc9 None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:33:59.265130 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be61866c-84b6-4bef-872b-77780e984e41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:33:59.266053 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be61866c-84b6-4bef-872b-77780e984e41 None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:33:59.266556 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be61866c-84b6-4bef-872b-77780e984e41 None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:33:59.267028 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be61866c-84b6-4bef-872b-77780e984e41 None admin] PATH_INFO: `/v3/projects` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:33:59.267909 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be61866c-84b6-4bef-872b-77780e984e41 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 09:33:59.268413 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be61866c-84b6-4bef-872b-77780e984e41 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:33:59.270374 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be61866c-84b6-4bef-872b-77780e984e41 None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:33:59.285722 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 243/510] 10.222.0.65 () {56 vars in 1133 bytes} [Thu Oct 27 09:33:59 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 09:33:59.286671 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcf67e7-54dd-4875-8c13-881c41d56bc9 None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:33:59.292285 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 268/511] 10.222.0.65 () {56 vars in 1148 bytes} [Thu Oct 27 09:33:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 09:33:59.292285 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be61866c-84b6-4bef-872b-77780e984e41 None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:33:59.406662 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be61866c-84b6-4bef-872b-77780e984e41 None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:33:59.407827 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcf67e7-54dd-4875-8c13-881c41d56bc9 None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:33:59.415409 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:33:59.444544 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08777a23-0691-4746-be91-bf5cd27d2715 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:33:59.445186 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08777a23-0691-4746-be91-bf5cd27d2715 None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:33:59.445479 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08777a23-0691-4746-be91-bf5cd27d2715 None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:33:59.445759 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08777a23-0691-4746-be91-bf5cd27d2715 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:33:59.447883 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df891fc-5829-4c36-af81-b0d5c7f5dec6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:33:59.448714 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df891fc-5829-4c36-af81-b0d5c7f5dec6 None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:33:59.449228 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df891fc-5829-4c36-af81-b0d5c7f5dec6 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:33:59.449666 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df891fc-5829-4c36-af81-b0d5c7f5dec6 None admin] PATH_INFO: `/v3/domains` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:33:59.450451 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df891fc-5829-4c36-af81-b0d5c7f5dec6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 09:33:59.450919 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df891fc-5829-4c36-af81-b0d5c7f5dec6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:33:59.452574 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df891fc-5829-4c36-af81-b0d5c7f5dec6 None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:33:59.455254 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:33:59.456792 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08777a23-0691-4746-be91-bf5cd27d2715 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:33:59.458302 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08777a23-0691-4746-be91-bf5cd27d2715 None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:33:59.470610 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 244/512] 10.222.0.65 () {56 vars in 1109 bytes} [Thu Oct 27 09:33:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 09:33:59.470610 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df891fc-5829-4c36-af81-b0d5c7f5dec6 None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:33:59.480663 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application [None req-08777a23-0691-4746-be91-bf5cd27d2715 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 09:33:59.480663 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 09:33:59.480663 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 09:33:59.480663 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 09:33:59.480663 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 09:33:59.480663 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 09:33:59.480663 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 09:33:59.480663 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 09:33:59.480663 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 09:33:59.480663 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 09:33:59.480663 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 09:33:59.480663 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 09:33:59.480663 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 27 09:33:59.480663 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 27 09:33:59.480663 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 27 09:33:59.480663 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 27 09:33:59.481893 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 09:33:59.481893 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 09:33:59.481893 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 09:33:59.481893 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 09:33:59.481893 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 09:33:59.481893 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 09:33:59.481893 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 09:33:59.481893 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application with Lock( Oct 27 09:33:59.481893 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 09:33:59.481893 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._enter() Oct 27 09:33:59.481893 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 09:33:59.481893 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 09:33:59.481893 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 09:33:59.481893 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.creator() Oct 27 09:33:59.481893 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 09:33:59.481893 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application created_value = creator( Oct 27 09:33:59.481893 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 27 09:33:59.482761 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 27 09:33:59.482761 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 09:33:59.482761 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application Oct 27 09:33:59.482761 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 269/513] 10.222.0.65 () {56 vars in 1108 bytes} [Thu Oct 27 09:33:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 09:33:59.483418 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd80527-d5b5-4cb2-a816-1bf212f30a8e None None] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:33:59.483885 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd80527-d5b5-4cb2-a816-1bf212f30a8e None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:33:59.483987 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd80527-d5b5-4cb2-a816-1bf212f30a8e None None] PATH_INFO: `/` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:33:59.489653 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 270/514] 10.222.0.65 () {54 vars in 927 bytes} [Thu Oct 27 09:33:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 09:33:59.489653 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd80527-d5b5-4cb2-a816-1bf212f30a8e None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:33:59.586149 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df891fc-5829-4c36-af81-b0d5c7f5dec6 None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:33:59.595722 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd80527-d5b5-4cb2-a816-1bf212f30a8e None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:33:59.628671 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0549e360-eb28-4fa1-a8a2-c3ef389f2e28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:33:59.629690 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0549e360-eb28-4fa1-a8a2-c3ef389f2e28 None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:33:59.629821 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0549e360-eb28-4fa1-a8a2-c3ef389f2e28 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:33:59.630099 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0549e360-eb28-4fa1-a8a2-c3ef389f2e28 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:33:59.632516 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0549e360-eb28-4fa1-a8a2-c3ef389f2e28 None admin] RBAC: Adding query filter params (role.id=8d728ccbaa534a949df6711b47151356, scope.project.id=dc2e3a7a1bcc480891c0b433291c00b1, user.id=01e32fc35c8b467e9604b325cf1527aa) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 09:33:59.632516 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0549e360-eb28-4fa1-a8a2-c3ef389f2e28 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:33:59.633228 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b0026a-9bf6-43a3-a9ae-73a47871e6d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:33:59.633626 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0549e360-eb28-4fa1-a8a2-c3ef389f2e28 None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:33:59.633924 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b0026a-9bf6-43a3-a9ae-73a47871e6d1 None admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:33:59.634204 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b0026a-9bf6-43a3-a9ae-73a47871e6d1 None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:33:59.634478 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b0026a-9bf6-43a3-a9ae-73a47871e6d1 None admin] PATH_INFO: `/v3/users` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:33:59.635240 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b0026a-9bf6-43a3-a9ae-73a47871e6d1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:33:59.638261 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b0026a-9bf6-43a3-a9ae-73a47871e6d1 None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:33:59.640629 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 245/515] 10.222.0.65 () {56 vars in 1374 bytes} [Thu Oct 27 09:33:59 2022] GET /identity/v3/role_assignments?user.id=01e32fc35c8b467e9604b325cf1527aa&scope.project.id=dc2e3a7a1bcc480891c0b433291c00b1&role.id=8d728ccbaa534a949df6711b47151356 => generated 608 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 09:33:59.641728 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0549e360-eb28-4fa1-a8a2-c3ef389f2e28 None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:33:59.836267 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:33:59.836267 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0549e360-eb28-4fa1-a8a2-c3ef389f2e28 None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:33:59.836267 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad845072-892c-4c1c-a8d5-0022fab51d12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:33:59.836267 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad845072-892c-4c1c-a8d5-0022fab51d12 None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:33:59.836769 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad845072-892c-4c1c-a8d5-0022fab51d12 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:33:59.836769 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad845072-892c-4c1c-a8d5-0022fab51d12 None admin] PATH_INFO: `/v3/domains` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:33:59.836769 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad845072-892c-4c1c-a8d5-0022fab51d12 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 09:33:59.836769 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad845072-892c-4c1c-a8d5-0022fab51d12 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:33:59.836769 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad845072-892c-4c1c-a8d5-0022fab51d12 None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:33:59.836769 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 246/516] 10.222.0.65 () {56 vars in 1109 bytes} [Thu Oct 27 09:33:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 09:33:59.837147 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b06647-cf90-4bb4-b1ba-d0b0b93ddb51 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:33:59.837147 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b06647-cf90-4bb4-b1ba-d0b0b93ddb51 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:33:59.837147 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b06647-cf90-4bb4-b1ba-d0b0b93ddb51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:33:59.843096 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-54b06647-cf90-4bb4-b1ba-d0b0b93ddb51 None None] MFA Rules not processed for user `b5065084bf664b99bdeac46067cb0f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:33:59.843925 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-54b06647-cf90-4bb4-b1ba-d0b0b93ddb51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:33:59.923321 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 247/517] 10.222.0.65 () {58 vars in 1024 bytes} [Thu Oct 27 09:33:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 27 09:33:59.924646 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b06647-cf90-4bb4-b1ba-d0b0b93ddb51 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:34:00.031923 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b06647-cf90-4bb4-b1ba-d0b0b93ddb51 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:34:00.066433 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f59035f-10ad-42cb-a785-28816d3cad6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:34:00.067095 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f59035f-10ad-42cb-a785-28816d3cad6e None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:34:00.067381 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f59035f-10ad-42cb-a785-28816d3cad6e None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:34:00.067655 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f59035f-10ad-42cb-a785-28816d3cad6e None admin] PATH_INFO: `/v3/projects/service` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:34:00.074486 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f59035f-10ad-42cb-a785-28816d3cad6e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:34:00.076093 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f59035f-10ad-42cb-a785-28816d3cad6e None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:34:00.087486 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application [None req-6f59035f-10ad-42cb-a785-28816d3cad6e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 27 09:34:00.087486 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 09:34:00.087486 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 09:34:00.087486 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 09:34:00.087486 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 09:34:00.087486 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 09:34:00.087486 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 09:34:00.087486 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 09:34:00.087486 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 09:34:00.087486 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 09:34:00.087486 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 09:34:00.087486 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 09:34:00.087486 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 27 09:34:00.087486 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 27 09:34:00.087486 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 27 09:34:00.088408 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 27 09:34:00.088408 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 09:34:00.088408 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 09:34:00.088408 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 09:34:00.088408 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 09:34:00.088408 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 09:34:00.088408 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 09:34:00.088408 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 09:34:00.088408 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application with Lock( Oct 27 09:34:00.088408 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 09:34:00.088408 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._enter() Oct 27 09:34:00.088408 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 09:34:00.088408 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 09:34:00.088408 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 09:34:00.088408 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.creator() Oct 27 09:34:00.088408 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 09:34:00.088408 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application created_value = creator( Oct 27 09:34:00.089975 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 27 09:34:00.089975 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 27 09:34:00.089975 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 27 09:34:00.089975 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 27 09:34:00.089975 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 27 09:34:00.089975 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 27 09:34:00.089975 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 27 09:34:00.089975 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application Oct 27 09:34:00.093748 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 248/518] 10.222.0.65 () {56 vars in 1111 bytes} [Thu Oct 27 09:33:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 09:34:00.095025 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73b24de-b3b8-4a1c-9e2a-e4f202a5da40 None None] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:34:00.095314 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73b24de-b3b8-4a1c-9e2a-e4f202a5da40 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:34:00.095594 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73b24de-b3b8-4a1c-9e2a-e4f202a5da40 None None] PATH_INFO: `/` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:34:00.098698 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 249/519] 10.222.0.65 () {54 vars in 927 bytes} [Thu Oct 27 09:34:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 09:34:00.098698 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73b24de-b3b8-4a1c-9e2a-e4f202a5da40 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:34:00.182543 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 271/520] 10.222.0.65 () {60 vars in 1132 bytes} [Thu Oct 27 09:33:59 2022] POST /identity/v3/users => generated 254 bytes in 689 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 09:34:00.190380 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6aef86-b56d-4f8e-aa0e-abd0e87e5a42 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:34:00.190380 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6aef86-b56d-4f8e-aa0e-abd0e87e5a42 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:34:00.190380 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6aef86-b56d-4f8e-aa0e-abd0e87e5a42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:34:00.207448 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-4a6aef86-b56d-4f8e-aa0e-abd0e87e5a42 None None] MFA Rules not processed for user `b5065084bf664b99bdeac46067cb0f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:34:00.208966 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-4a6aef86-b56d-4f8e-aa0e-abd0e87e5a42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:34:00.216114 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:34:00.224986 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:34:00.237157 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73b24de-b3b8-4a1c-9e2a-e4f202a5da40 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:34:00.254280 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:34:00.287752 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8671e4-fcc9-4134-844e-6ddd65d30c7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:34:00.288867 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8671e4-fcc9-4134-844e-6ddd65d30c7b None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:34:00.289665 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8671e4-fcc9-4134-844e-6ddd65d30c7b None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:34:00.290116 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8671e4-fcc9-4134-844e-6ddd65d30c7b None admin] PATH_INFO: `/v3/projects` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:34:00.291085 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8671e4-fcc9-4134-844e-6ddd65d30c7b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 09:34:00.291584 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8671e4-fcc9-4134-844e-6ddd65d30c7b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:34:00.294481 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8671e4-fcc9-4134-844e-6ddd65d30c7b None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:34:00.312044 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 250/521] 10.222.0.65 () {56 vars in 1148 bytes} [Thu Oct 27 09:34:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 09:34:00.312695 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 272/522] 10.222.0.65 () {58 vars in 1024 bytes} [Thu Oct 27 09:34:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 27 09:34:00.313548 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8671e4-fcc9-4134-844e-6ddd65d30c7b None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:34:00.320351 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6aef86-b56d-4f8e-aa0e-abd0e87e5a42 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:34:00.443482 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6aef86-b56d-4f8e-aa0e-abd0e87e5a42 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:34:00.459412 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8671e4-fcc9-4134-844e-6ddd65d30c7b None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:34:00.485461 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b237bb7a-d250-4119-8929-b8299254768f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:34:00.486598 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b237bb7a-d250-4119-8929-b8299254768f None admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:34:00.487085 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b237bb7a-d250-4119-8929-b8299254768f None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:34:00.487575 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b237bb7a-d250-4119-8929-b8299254768f None admin] PATH_INFO: `/v3/projects/dc2e3a7a1bcc480891c0b433291c00b1/users/fd0d23ef039d4f1591a589d302ef165f/roles/6ad17b9f9dea4b66ab2da3677d7e715d` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:34:00.489996 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b237bb7a-d250-4119-8929-b8299254768f None admin] RBAC: Authorizing `identity:create_grant(project_id=dc2e3a7a1bcc480891c0b433291c00b1, user_id=fd0d23ef039d4f1591a589d302ef165f, role_id=6ad17b9f9dea4b66ab2da3677d7e715d)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:34:00.491766 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b237bb7a-d250-4119-8929-b8299254768f None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:34:00.498397 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4eaad27-2af4-4fac-a3a6-0de2cec488b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:34:00.499058 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4eaad27-2af4-4fac-a3a6-0de2cec488b5 None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:34:00.499338 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4eaad27-2af4-4fac-a3a6-0de2cec488b5 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:34:00.500199 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4eaad27-2af4-4fac-a3a6-0de2cec488b5 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:34:00.500199 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4eaad27-2af4-4fac-a3a6-0de2cec488b5 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:34:00.501529 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4eaad27-2af4-4fac-a3a6-0de2cec488b5 None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:34:00.512940 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application [None req-a4eaad27-2af4-4fac-a3a6-0de2cec488b5 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 27 09:34:00.512940 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 09:34:00.512940 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 27 09:34:00.512940 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 27 09:34:00.512940 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 27 09:34:00.512940 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 27 09:34:00.512940 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 27 09:34:00.512940 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 27 09:34:00.512940 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 27 09:34:00.512940 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application Oct 27 09:34:00.512940 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 27 09:34:00.512940 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application Oct 27 09:34:00.512940 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 09:34:00.512940 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 09:34:00.512940 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 09:34:00.512940 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 09:34:00.512940 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 09:34:00.514036 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 09:34:00.514036 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 09:34:00.514036 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 09:34:00.514036 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 09:34:00.514036 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 09:34:00.514036 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 09:34:00.514036 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 27 09:34:00.514036 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 27 09:34:00.514036 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 27 09:34:00.514036 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 27 09:34:00.514036 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 09:34:00.514036 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 09:34:00.514036 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 09:34:00.514036 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 09:34:00.514036 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 09:34:00.514036 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 09:34:00.514931 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 09:34:00.514931 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application with Lock( Oct 27 09:34:00.514931 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 09:34:00.514931 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._enter() Oct 27 09:34:00.514931 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 09:34:00.514931 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 09:34:00.514931 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 09:34:00.514931 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.creator() Oct 27 09:34:00.514931 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 09:34:00.514931 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application created_value = creator( Oct 27 09:34:00.514931 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 27 09:34:00.514931 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 27 09:34:00.514931 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 27 09:34:00.514931 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application Oct 27 09:34:00.514931 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 251/523] 10.222.0.65 () {56 vars in 1129 bytes} [Thu Oct 27 09:34:00 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 09:34:00.519907 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4eaad27-2af4-4fac-a3a6-0de2cec488b5 None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:34:00.568866 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 273/524] 10.222.0.65 () {58 vars in 1439 bytes} [Thu Oct 27 09:34:00 2022] PUT /identity/v3/projects/dc2e3a7a1bcc480891c0b433291c00b1/users/fd0d23ef039d4f1591a589d302ef165f/roles/6ad17b9f9dea4b66ab2da3677d7e715d => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 09:34:00.570381 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:34:00.661027 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4eaad27-2af4-4fac-a3a6-0de2cec488b5 None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:34:00.675652 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b237bb7a-d250-4119-8929-b8299254768f None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:34:00.681161 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:34:00.728397 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8448f96e-f423-4c8c-bdcf-964038a6a038 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:34:00.729110 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8448f96e-f423-4c8c-bdcf-964038a6a038 None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:34:00.729497 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8448f96e-f423-4c8c-bdcf-964038a6a038 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:34:00.730482 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8448f96e-f423-4c8c-bdcf-964038a6a038 None admin] PATH_INFO: `/v3/services` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:34:00.731189 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8448f96e-f423-4c8c-bdcf-964038a6a038 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 09:34:00.731503 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8448f96e-f423-4c8c-bdcf-964038a6a038 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:34:00.734081 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8448f96e-f423-4c8c-bdcf-964038a6a038 None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:34:00.742045 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 252/525] 10.222.0.65 () {56 vars in 1124 bytes} [Thu Oct 27 09:34:00 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 09:34:00.748136 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8448f96e-f423-4c8c-bdcf-964038a6a038 None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:34:00.838711 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b237bb7a-d250-4119-8929-b8299254768f None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:34:00.886170 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30a6473-2ab0-417b-8fe9-59f8345ca1cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:34:00.887171 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30a6473-2ab0-417b-8fe9-59f8345ca1cf None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:34:00.890685 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30a6473-2ab0-417b-8fe9-59f8345ca1cf None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:34:00.891001 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30a6473-2ab0-417b-8fe9-59f8345ca1cf None admin] PATH_INFO: `/v3/services/network` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:34:00.891606 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30a6473-2ab0-417b-8fe9-59f8345ca1cf None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:34:00.892994 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30a6473-2ab0-417b-8fe9-59f8345ca1cf None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:34:00.896997 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:34:00.902790 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8448f96e-f423-4c8c-bdcf-964038a6a038 None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:34:00.912218 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application [None req-d30a6473-2ab0-417b-8fe9-59f8345ca1cf None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Oct 27 09:34:00.912218 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 09:34:00.912218 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 27 09:34:00.912218 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 27 09:34:00.912218 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 27 09:34:00.912218 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 27 09:34:00.912218 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 27 09:34:00.912218 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 27 09:34:00.912218 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 27 09:34:00.912218 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application Oct 27 09:34:00.912218 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 27 09:34:00.912218 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application Oct 27 09:34:00.912218 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 09:34:00.912218 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 09:34:00.912218 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 09:34:00.912218 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 09:34:00.912218 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 09:34:00.913217 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 09:34:00.913217 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 09:34:00.913217 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 09:34:00.913217 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 09:34:00.913217 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 09:34:00.913217 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 09:34:00.913217 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 27 09:34:00.913217 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 27 09:34:00.913217 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 27 09:34:00.913217 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 27 09:34:00.913217 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 09:34:00.913217 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 09:34:00.913217 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 09:34:00.913217 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 09:34:00.913217 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 09:34:00.913217 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 09:34:00.914726 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 09:34:00.914726 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application with Lock( Oct 27 09:34:00.914726 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 09:34:00.914726 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._enter() Oct 27 09:34:00.914726 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 09:34:00.914726 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 09:34:00.914726 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 09:34:00.914726 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.creator() Oct 27 09:34:00.914726 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 09:34:00.914726 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application created_value = creator( Oct 27 09:34:00.914726 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 27 09:34:00.914726 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 27 09:34:00.914726 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 27 09:34:00.914726 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application Oct 27 09:34:00.914726 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 274/526] 10.222.0.65 () {56 vars in 1111 bytes} [Thu Oct 27 09:34:00 2022] GET /identity/v3/services/network => generated 88 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 09:34:00.919461 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30a6473-2ab0-417b-8fe9-59f8345ca1cf None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:34:00.995593 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:34:01.027456 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30a6473-2ab0-417b-8fe9-59f8345ca1cf None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:34:01.029191 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe3228c-1f45-4e04-8f8f-0e4d6f59de22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:34:01.029998 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe3228c-1f45-4e04-8f8f-0e4d6f59de22 None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:34:01.030444 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe3228c-1f45-4e04-8f8f-0e4d6f59de22 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:34:01.030890 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe3228c-1f45-4e04-8f8f-0e4d6f59de22 None admin] PATH_INFO: `/v3/services` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:34:01.031678 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe3228c-1f45-4e04-8f8f-0e4d6f59de22 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 09:34:01.032148 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe3228c-1f45-4e04-8f8f-0e4d6f59de22 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:34:01.034456 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe3228c-1f45-4e04-8f8f-0e4d6f59de22 None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:34:01.060089 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 253/527] 10.222.0.65 () {56 vars in 1124 bytes} [Thu Oct 27 09:34:00 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 09:34:01.067037 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29b659b-8689-4796-8a86-0063f1face5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:34:01.067696 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29b659b-8689-4796-8a86-0063f1face5f None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:34:01.067976 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29b659b-8689-4796-8a86-0063f1face5f None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:34:01.068255 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29b659b-8689-4796-8a86-0063f1face5f None admin] PATH_INFO: `/v3/services` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:34:01.069509 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29b659b-8689-4796-8a86-0063f1face5f None admin] RBAC: Adding query filter params (name=network) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 09:34:01.069509 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29b659b-8689-4796-8a86-0063f1face5f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:34:01.072074 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29b659b-8689-4796-8a86-0063f1face5f None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:34:01.077051 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 275/528] 10.222.0.65 () {56 vars in 1112 bytes} [Thu Oct 27 09:34:00 2022] GET /identity/v3/services?name=network => generated 124 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 09:34:01.082878 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe3228c-1f45-4e04-8f8f-0e4d6f59de22 None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:34:01.198266 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe3228c-1f45-4e04-8f8f-0e4d6f59de22 None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:34:01.246017 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec46bd3-8072-4288-a63a-ceb5aebdbec6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:34:01.247049 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec46bd3-8072-4288-a63a-ceb5aebdbec6 None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:34:01.247544 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec46bd3-8072-4288-a63a-ceb5aebdbec6 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:34:01.248046 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec46bd3-8072-4288-a63a-ceb5aebdbec6 None admin] PATH_INFO: `/v3/services` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:34:01.248886 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec46bd3-8072-4288-a63a-ceb5aebdbec6 None admin] RBAC: Adding query filter params (type=network) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 09:34:01.249398 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec46bd3-8072-4288-a63a-ceb5aebdbec6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:34:01.251080 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec46bd3-8072-4288-a63a-ceb5aebdbec6 None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:34:01.259944 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 254/529] 10.222.0.65 () {56 vars in 1112 bytes} [Thu Oct 27 09:34:01 2022] GET /identity/v3/services?type=network => generated 124 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 09:34:02.142601 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46333ea-1285-4666-aa74-8a5fd6ac1b0a None None] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:34:02.143113 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46333ea-1285-4666-aa74-8a5fd6ac1b0a None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:34:02.143113 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46333ea-1285-4666-aa74-8a5fd6ac1b0a None None] PATH_INFO: `/` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:34:02.144657 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 276/530] 10.222.0.65 () {54 vars in 927 bytes} [Thu Oct 27 09:34:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 09:34:02.149777 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f110a2c1-77a6-4706-bbee-0f9f63c1d3ea None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:34:02.150212 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f110a2c1-77a6-4706-bbee-0f9f63c1d3ea None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:34:02.150395 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f110a2c1-77a6-4706-bbee-0f9f63c1d3ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:34:02.173255 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-f110a2c1-77a6-4706-bbee-0f9f63c1d3ea None None] MFA Rules not processed for user `b5065084bf664b99bdeac46067cb0f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:34:02.174438 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-f110a2c1-77a6-4706-bbee-0f9f63c1d3ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:34:02.201918 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:34:02.262740 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 255/531] 10.222.0.65 () {58 vars in 1024 bytes} [Thu Oct 27 09:34:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 27 09:34:02.659979 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46333ea-1285-4666-aa74-8a5fd6ac1b0a None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:34:02.788122 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46333ea-1285-4666-aa74-8a5fd6ac1b0a None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:34:02.832541 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:34:02.849412 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e15f34-e64a-44d9-9a05-790159c275ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:34:02.849412 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e15f34-e64a-44d9-9a05-790159c275ec None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:34:02.849412 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e15f34-e64a-44d9-9a05-790159c275ec None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:34:02.849412 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e15f34-e64a-44d9-9a05-790159c275ec None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:34:02.866849 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e15f34-e64a-44d9-9a05-790159c275ec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 09:34:02.873057 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application [None req-78e15f34-e64a-44d9-9a05-790159c275ec None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 27 09:34:02.873057 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 09:34:02.873057 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 09:34:02.873057 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 09:34:02.873057 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 09:34:02.873057 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 09:34:02.873057 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 09:34:02.873057 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 09:34:02.873057 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 09:34:02.873057 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 09:34:02.873057 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 09:34:02.873057 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 09:34:02.873057 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 27 09:34:02.873057 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 27 09:34:02.873057 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 27 09:34:02.873057 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 27 09:34:02.874002 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 27 09:34:02.874002 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 27 09:34:02.874002 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 27 09:34:02.874002 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 27 09:34:02.874002 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 09:34:02.874002 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 09:34:02.874002 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 09:34:02.874002 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 09:34:02.874002 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 09:34:02.874002 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 09:34:02.874002 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 09:34:02.874002 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application with Lock( Oct 27 09:34:02.874002 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 09:34:02.874002 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._enter() Oct 27 09:34:02.874002 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 09:34:02.874002 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 09:34:02.875160 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 09:34:02.875160 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.creator() Oct 27 09:34:02.875160 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 09:34:02.875160 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application created_value = creator( Oct 27 09:34:02.875160 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 27 09:34:02.875160 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 27 09:34:02.875160 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 27 09:34:02.875160 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 27 09:34:02.875160 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 27 09:34:02.875160 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 27 09:34:02.875160 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 27 09:34:02.875160 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application Oct 27 09:34:02.875160 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 277/532] 10.222.0.65 () {56 vars in 1096 bytes} [Thu Oct 27 09:34:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 09:34:02.880428 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f110a2c1-77a6-4706-bbee-0f9f63c1d3ea None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:34:03.019460 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f110a2c1-77a6-4706-bbee-0f9f63c1d3ea None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:34:03.067757 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f58a7b-1722-4ab5-a9e9-777218547f73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:34:03.068378 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f58a7b-1722-4ab5-a9e9-777218547f73 None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:34:03.068666 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f58a7b-1722-4ab5-a9e9-777218547f73 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:34:03.068945 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f58a7b-1722-4ab5-a9e9-777218547f73 None admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:34:03.069632 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f58a7b-1722-4ab5-a9e9-777218547f73 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 09:34:03.069940 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f58a7b-1722-4ab5-a9e9-777218547f73 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:34:03.071394 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f58a7b-1722-4ab5-a9e9-777218547f73 None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:34:03.087302 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 256/533] 10.222.0.65 () {56 vars in 1099 bytes} [Thu Oct 27 09:34:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 09:34:03.094142 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e15f34-e64a-44d9-9a05-790159c275ec None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:34:03.193370 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c90c3bd-1952-4abf-90bb-b63e4f3d9017 None None] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:34:03.193881 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c90c3bd-1952-4abf-90bb-b63e4f3d9017 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:34:03.193983 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c90c3bd-1952-4abf-90bb-b63e4f3d9017 None None] PATH_INFO: `/` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:34:03.195280 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 257/534] 10.222.0.65 () {54 vars in 927 bytes} [Thu Oct 27 09:34:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 27 09:34:03.203885 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13f2b96-9b69-4047-a0d1-9313de8dc926 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:34:03.204181 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13f2b96-9b69-4047-a0d1-9313de8dc926 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:34:03.204451 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13f2b96-9b69-4047-a0d1-9313de8dc926 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:34:03.223701 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e15f34-e64a-44d9-9a05-790159c275ec None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:34:03.239599 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-a13f2b96-9b69-4047-a0d1-9313de8dc926 None None] MFA Rules not processed for user `b5065084bf664b99bdeac46067cb0f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:34:03.240840 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-a13f2b96-9b69-4047-a0d1-9313de8dc926 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:34:03.266484 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:34:03.270292 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab34f0da-70f5-47a8-a30f-061ac39d7630 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:34:03.271338 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab34f0da-70f5-47a8-a30f-061ac39d7630 None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:34:03.273023 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab34f0da-70f5-47a8-a30f-061ac39d7630 None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:34:03.277261 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab34f0da-70f5-47a8-a30f-061ac39d7630 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:34:03.294169 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab34f0da-70f5-47a8-a30f-061ac39d7630 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:34:03.297092 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab34f0da-70f5-47a8-a30f-061ac39d7630 None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:34:03.320886 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application [None req-ab34f0da-70f5-47a8-a30f-061ac39d7630 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 09:34:03.320886 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 09:34:03.320886 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 09:34:03.320886 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 09:34:03.320886 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 09:34:03.320886 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 09:34:03.320886 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 09:34:03.320886 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 09:34:03.320886 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 09:34:03.320886 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 09:34:03.320886 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 09:34:03.320886 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 09:34:03.320886 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 27 09:34:03.320886 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 27 09:34:03.320886 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 27 09:34:03.320886 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 27 09:34:03.321917 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 09:34:03.321917 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 09:34:03.321917 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 09:34:03.321917 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 09:34:03.321917 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 09:34:03.321917 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 09:34:03.321917 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 09:34:03.321917 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application with Lock( Oct 27 09:34:03.321917 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 09:34:03.321917 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._enter() Oct 27 09:34:03.321917 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 09:34:03.321917 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 09:34:03.321917 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 09:34:03.321917 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.creator() Oct 27 09:34:03.321917 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 09:34:03.321917 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application created_value = creator( Oct 27 09:34:03.321917 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 27 09:34:03.323077 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 27 09:34:03.323077 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 09:34:03.323077 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application Oct 27 09:34:03.326382 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 278/535] 10.222.0.65 () {56 vars in 1108 bytes} [Thu Oct 27 09:34:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 09:34:03.333263 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab34f0da-70f5-47a8-a30f-061ac39d7630 None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:34:03.398637 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 258/536] 10.222.0.65 () {58 vars in 1024 bytes} [Thu Oct 27 09:34:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 27 09:34:03.428316 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:34:03.520661 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab34f0da-70f5-47a8-a30f-061ac39d7630 None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:34:03.601713 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f479c18-e6dc-478d-bf74-7a3bff2d5a12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:34:03.603145 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f479c18-e6dc-478d-bf74-7a3bff2d5a12 None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:34:03.604719 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f479c18-e6dc-478d-bf74-7a3bff2d5a12 None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:34:03.605497 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f479c18-e6dc-478d-bf74-7a3bff2d5a12 None admin] PATH_INFO: `/v3/domains` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:34:03.606968 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f479c18-e6dc-478d-bf74-7a3bff2d5a12 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 09:34:03.607759 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f479c18-e6dc-478d-bf74-7a3bff2d5a12 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:34:03.610499 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f479c18-e6dc-478d-bf74-7a3bff2d5a12 None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:34:03.634179 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 279/537] 10.222.0.65 () {56 vars in 1109 bytes} [Thu Oct 27 09:34:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 09:34:03.643348 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13f2b96-9b69-4047-a0d1-9313de8dc926 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:34:03.672178 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91fdfd2-b3e9-4432-b0d6-77d5f57a6b04 None None] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:34:03.672467 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91fdfd2-b3e9-4432-b0d6-77d5f57a6b04 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:34:03.672777 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91fdfd2-b3e9-4432-b0d6-77d5f57a6b04 None None] PATH_INFO: `/` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:34:03.674294 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 280/538] 10.222.0.65 () {54 vars in 927 bytes} [Thu Oct 27 09:34:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 27 09:34:03.694410 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b87bbac-ea73-47c8-ba23-117919060260 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:34:03.694901 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b87bbac-ea73-47c8-ba23-117919060260 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:34:03.695076 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b87bbac-ea73-47c8-ba23-117919060260 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:34:03.727679 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-6b87bbac-ea73-47c8-ba23-117919060260 None None] MFA Rules not processed for user `b5065084bf664b99bdeac46067cb0f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:34:03.729486 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-6b87bbac-ea73-47c8-ba23-117919060260 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:34:03.798643 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 281/539] 10.222.0.65 () {58 vars in 1024 bytes} [Thu Oct 27 09:34:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 27 09:34:03.799412 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b87bbac-ea73-47c8-ba23-117919060260 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:34:03.833252 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13f2b96-9b69-4047-a0d1-9313de8dc926 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:34:03.897986 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82defc3b-22ff-472c-ac95-ff66aa3d52bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:34:03.899104 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82defc3b-22ff-472c-ac95-ff66aa3d52bd None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:34:03.899652 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82defc3b-22ff-472c-ac95-ff66aa3d52bd None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:34:03.900133 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82defc3b-22ff-472c-ac95-ff66aa3d52bd None admin] PATH_INFO: `/v3/users/swift` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:34:03.913826 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82defc3b-22ff-472c-ac95-ff66aa3d52bd None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:34:03.914973 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:34:03.916602 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82defc3b-22ff-472c-ac95-ff66aa3d52bd None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:34:03.940963 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application [None req-82defc3b-22ff-472c-ac95-ff66aa3d52bd None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 27 09:34:03.940963 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 09:34:03.940963 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 09:34:03.940963 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 09:34:03.940963 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 09:34:03.940963 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 09:34:03.940963 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 09:34:03.940963 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 09:34:03.940963 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 09:34:03.940963 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 09:34:03.940963 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 09:34:03.940963 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 09:34:03.940963 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 27 09:34:03.940963 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 27 09:34:03.940963 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 27 09:34:03.940963 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 27 09:34:03.943004 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 09:34:03.943004 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 09:34:03.943004 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 27 09:34:03.943004 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 27 09:34:03.943004 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 27 09:34:03.943004 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 27 09:34:03.943004 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 09:34:03.943004 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 09:34:03.943004 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 09:34:03.943004 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 09:34:03.943004 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 09:34:03.943004 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application with Lock( Oct 27 09:34:03.943004 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 09:34:03.943004 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._enter() Oct 27 09:34:03.943004 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 09:34:03.943004 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 09:34:03.943004 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 09:34:03.943004 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.creator() Oct 27 09:34:03.944844 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 09:34:03.944844 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application created_value = creator( Oct 27 09:34:03.944844 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 27 09:34:03.944844 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 27 09:34:03.944844 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 27 09:34:03.944844 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 27 09:34:03.944844 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 27 09:34:03.944844 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 27 09:34:03.944844 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 27 09:34:03.944844 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application Oct 27 09:34:03.944844 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 259/540] 10.222.0.65 () {56 vars in 1096 bytes} [Thu Oct 27 09:34:03 2022] GET /identity/v3/users/swift => generated 83 bytes in 301 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 09:34:03.952765 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82defc3b-22ff-472c-ac95-ff66aa3d52bd None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:34:03.973083 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:34:04.044066 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b87bbac-ea73-47c8-ba23-117919060260 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:34:04.085082 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37a492b-d0fc-4e3c-9d2e-0eee5b8c43d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:34:04.086071 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37a492b-d0fc-4e3c-9d2e-0eee5b8c43d5 None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:34:04.086357 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37a492b-d0fc-4e3c-9d2e-0eee5b8c43d5 None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:34:04.086661 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37a492b-d0fc-4e3c-9d2e-0eee5b8c43d5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:34:04.098751 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37a492b-d0fc-4e3c-9d2e-0eee5b8c43d5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 09:34:04.104252 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application [None req-d37a492b-d0fc-4e3c-9d2e-0eee5b8c43d5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 27 09:34:04.104252 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 09:34:04.104252 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 09:34:04.104252 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 09:34:04.104252 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 09:34:04.104252 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 09:34:04.104252 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 09:34:04.104252 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 09:34:04.104252 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 09:34:04.104252 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 09:34:04.104252 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 09:34:04.104252 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 09:34:04.104252 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 27 09:34:04.104252 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 27 09:34:04.104252 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 27 09:34:04.104252 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 27 09:34:04.106018 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 27 09:34:04.106018 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 27 09:34:04.106018 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 27 09:34:04.106018 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 27 09:34:04.106018 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 09:34:04.106018 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 09:34:04.106018 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 09:34:04.106018 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 09:34:04.106018 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 09:34:04.106018 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 09:34:04.106018 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 09:34:04.106018 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application with Lock( Oct 27 09:34:04.106018 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 09:34:04.106018 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._enter() Oct 27 09:34:04.106018 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 09:34:04.106018 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 09:34:04.107621 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 09:34:04.107621 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.creator() Oct 27 09:34:04.107621 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 09:34:04.107621 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application created_value = creator( Oct 27 09:34:04.107621 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 27 09:34:04.107621 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 27 09:34:04.107621 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 27 09:34:04.107621 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 27 09:34:04.107621 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 27 09:34:04.107621 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 27 09:34:04.107621 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 27 09:34:04.107621 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application Oct 27 09:34:04.107621 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 282/541] 10.222.0.65 () {56 vars in 1102 bytes} [Thu Oct 27 09:34:03 2022] GET /identity/v3/roles/service => generated 85 bytes in 307 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 09:34:04.112005 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37a492b-d0fc-4e3c-9d2e-0eee5b8c43d5 None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:34:04.177918 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82defc3b-22ff-472c-ac95-ff66aa3d52bd None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:34:04.234282 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529ae20a-d447-48a1-bb6a-cc6cdd371628 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:34:04.235260 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529ae20a-d447-48a1-bb6a-cc6cdd371628 None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:34:04.235590 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529ae20a-d447-48a1-bb6a-cc6cdd371628 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:34:04.236038 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529ae20a-d447-48a1-bb6a-cc6cdd371628 None admin] PATH_INFO: `/v3/users` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:34:04.237274 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529ae20a-d447-48a1-bb6a-cc6cdd371628 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 09:34:04.237762 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529ae20a-d447-48a1-bb6a-cc6cdd371628 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:34:04.240577 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529ae20a-d447-48a1-bb6a-cc6cdd371628 None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:34:04.263780 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 260/542] 10.222.0.65 () {56 vars in 1135 bytes} [Thu Oct 27 09:34:03 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 09:34:04.265034 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81848df9-ff40-4d8e-b03b-f7de724f072e None None] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:34:04.265322 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81848df9-ff40-4d8e-b03b-f7de724f072e None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:34:04.265598 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81848df9-ff40-4d8e-b03b-f7de724f072e None None] PATH_INFO: `/` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:34:04.267611 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 261/543] 10.222.0.65 () {54 vars in 927 bytes} [Thu Oct 27 09:34:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 09:34:04.269037 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fc1e61-812c-4198-b9e7-b54e0bc89f79 None None] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:34:04.269329 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fc1e61-812c-4198-b9e7-b54e0bc89f79 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:34:04.269605 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fc1e61-812c-4198-b9e7-b54e0bc89f79 None None] PATH_INFO: `/` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:34:04.275187 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 262/544] 10.222.0.65 () {54 vars in 927 bytes} [Thu Oct 27 09:34:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 09:34:04.275187 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fc1e61-812c-4198-b9e7-b54e0bc89f79 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:34:04.287935 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:34:04.295381 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37a492b-d0fc-4e3c-9d2e-0eee5b8c43d5 None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:34:04.330619 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2082861-0cb1-4797-80a8-c6ad96cbc43f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:34:04.331225 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2082861-0cb1-4797-80a8-c6ad96cbc43f None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:34:04.331512 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2082861-0cb1-4797-80a8-c6ad96cbc43f None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:34:04.331809 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2082861-0cb1-4797-80a8-c6ad96cbc43f None admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:34:04.332464 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2082861-0cb1-4797-80a8-c6ad96cbc43f None admin] RBAC: Adding query filter params (name=service) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 09:34:04.332765 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2082861-0cb1-4797-80a8-c6ad96cbc43f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:34:04.334113 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2082861-0cb1-4797-80a8-c6ad96cbc43f None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:34:04.342368 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 283/545] 10.222.0.65 () {56 vars in 1103 bytes} [Thu Oct 27 09:34:04 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 09:34:04.343516 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b7b4f9-5d6a-4fc0-9e87-ddfa7e46bf8a None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:34:04.343855 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b7b4f9-5d6a-4fc0-9e87-ddfa7e46bf8a None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:34:04.344132 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b7b4f9-5d6a-4fc0-9e87-ddfa7e46bf8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:34:04.353616 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:34:04.361983 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-e4b7b4f9-5d6a-4fc0-9e87-ddfa7e46bf8a None None] MFA Rules not processed for user `b5065084bf664b99bdeac46067cb0f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:34:04.365223 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-e4b7b4f9-5d6a-4fc0-9e87-ddfa7e46bf8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:34:04.393178 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fc1e61-812c-4198-b9e7-b54e0bc89f79 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:34:04.428193 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0e3fe7-d909-4ef8-ba13-2a984ef5193f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:34:04.429059 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0e3fe7-d909-4ef8-ba13-2a984ef5193f None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:34:04.429342 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0e3fe7-d909-4ef8-ba13-2a984ef5193f None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:34:04.429615 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0e3fe7-d909-4ef8-ba13-2a984ef5193f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:34:04.434215 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 284/546] 10.222.0.65 () {58 vars in 1024 bytes} [Thu Oct 27 09:34:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 27 09:34:04.435492 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4ff273-ffe1-4ad5-97a2-9dab0b6f4c4d None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:34:04.435801 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4ff273-ffe1-4ad5-97a2-9dab0b6f4c4d None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:34:04.436067 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4ff273-ffe1-4ad5-97a2-9dab0b6f4c4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:34:04.451531 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0e3fe7-d909-4ef8-ba13-2a984ef5193f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:34:04.452946 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0e3fe7-d909-4ef8-ba13-2a984ef5193f None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:34:04.454372 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-ed4ff273-ffe1-4ad5-97a2-9dab0b6f4c4d None None] MFA Rules not processed for user `b5065084bf664b99bdeac46067cb0f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:34:04.455870 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-ed4ff273-ffe1-4ad5-97a2-9dab0b6f4c4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:34:04.469690 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application [None req-2a0e3fe7-d909-4ef8-ba13-2a984ef5193f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 09:34:04.469690 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 09:34:04.469690 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 09:34:04.469690 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 09:34:04.469690 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 09:34:04.469690 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 09:34:04.469690 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 09:34:04.469690 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 09:34:04.469690 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 09:34:04.469690 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 09:34:04.469690 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 09:34:04.469690 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 09:34:04.469690 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 27 09:34:04.469690 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 27 09:34:04.469690 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 27 09:34:04.469690 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 27 09:34:04.470709 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 09:34:04.470709 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 09:34:04.470709 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 09:34:04.470709 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 09:34:04.470709 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 09:34:04.470709 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 09:34:04.470709 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 09:34:04.470709 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application with Lock( Oct 27 09:34:04.470709 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 09:34:04.470709 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._enter() Oct 27 09:34:04.470709 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 09:34:04.470709 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 09:34:04.470709 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 09:34:04.470709 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.creator() Oct 27 09:34:04.470709 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 09:34:04.470709 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application created_value = creator( Oct 27 09:34:04.470709 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 27 09:34:04.471584 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 27 09:34:04.471584 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 09:34:04.471584 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application Oct 27 09:34:04.471584 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 263/547] 10.222.0.65 () {56 vars in 1108 bytes} [Thu Oct 27 09:34:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 09:34:04.471813 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0e3fe7-d909-4ef8-ba13-2a984ef5193f None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:34:04.535121 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 285/548] 10.222.0.65 () {58 vars in 1024 bytes} [Thu Oct 27 09:34:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 27 09:34:04.535950 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4ff273-ffe1-4ad5-97a2-9dab0b6f4c4d None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:34:04.569525 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:34:04.590715 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0e3fe7-d909-4ef8-ba13-2a984ef5193f None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:34:04.613067 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:34:04.636250 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563ff1bb-376e-4cfa-a7f3-d2835daa7e63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:34:04.637078 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563ff1bb-376e-4cfa-a7f3-d2835daa7e63 None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:34:04.637423 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563ff1bb-376e-4cfa-a7f3-d2835daa7e63 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:34:04.637796 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563ff1bb-376e-4cfa-a7f3-d2835daa7e63 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:34:04.656553 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563ff1bb-376e-4cfa-a7f3-d2835daa7e63 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 09:34:04.663033 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application [None req-563ff1bb-376e-4cfa-a7f3-d2835daa7e63 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 27 09:34:04.663033 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 09:34:04.663033 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 09:34:04.663033 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 09:34:04.663033 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 09:34:04.663033 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 09:34:04.663033 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 09:34:04.663033 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 09:34:04.663033 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 09:34:04.663033 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 09:34:04.663033 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 09:34:04.663033 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 09:34:04.663033 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 27 09:34:04.663033 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 27 09:34:04.663033 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 27 09:34:04.663033 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 27 09:34:04.663919 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 27 09:34:04.663919 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 27 09:34:04.663919 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 27 09:34:04.663919 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 27 09:34:04.663919 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 09:34:04.663919 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 09:34:04.663919 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 09:34:04.663919 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 09:34:04.663919 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 09:34:04.663919 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 09:34:04.663919 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 09:34:04.663919 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application with Lock( Oct 27 09:34:04.663919 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 09:34:04.663919 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._enter() Oct 27 09:34:04.663919 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 09:34:04.663919 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 09:34:04.664772 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 09:34:04.664772 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.creator() Oct 27 09:34:04.664772 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 09:34:04.664772 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application created_value = creator( Oct 27 09:34:04.664772 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 27 09:34:04.664772 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 27 09:34:04.664772 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 27 09:34:04.664772 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 27 09:34:04.664772 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 27 09:34:04.664772 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 27 09:34:04.664772 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 27 09:34:04.664772 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application Oct 27 09:34:04.670447 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 264/549] 10.222.0.65 () {56 vars in 1096 bytes} [Thu Oct 27 09:34:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 09:34:04.671539 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563ff1bb-376e-4cfa-a7f3-d2835daa7e63 None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:34:04.684329 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4ff273-ffe1-4ad5-97a2-9dab0b6f4c4d None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:34:04.721577 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60eb92e-5249-42fa-910d-ff508c2e01cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:34:04.722349 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60eb92e-5249-42fa-910d-ff508c2e01cb None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:34:04.722758 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60eb92e-5249-42fa-910d-ff508c2e01cb None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:34:04.723128 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60eb92e-5249-42fa-910d-ff508c2e01cb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:34:04.734767 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60eb92e-5249-42fa-910d-ff508c2e01cb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:34:04.736524 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60eb92e-5249-42fa-910d-ff508c2e01cb None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:34:04.754294 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application [None req-c60eb92e-5249-42fa-910d-ff508c2e01cb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 09:34:04.754294 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 09:34:04.754294 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 09:34:04.754294 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 09:34:04.754294 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 09:34:04.754294 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 09:34:04.754294 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 09:34:04.754294 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 09:34:04.754294 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 09:34:04.754294 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 09:34:04.754294 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 09:34:04.754294 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 09:34:04.754294 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 27 09:34:04.754294 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 27 09:34:04.754294 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 27 09:34:04.754294 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 27 09:34:04.755530 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 09:34:04.755530 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 09:34:04.755530 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 09:34:04.755530 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 09:34:04.755530 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 09:34:04.755530 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 09:34:04.755530 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 09:34:04.755530 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application with Lock( Oct 27 09:34:04.755530 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 09:34:04.755530 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._enter() Oct 27 09:34:04.755530 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 09:34:04.755530 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 09:34:04.755530 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 09:34:04.755530 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.creator() Oct 27 09:34:04.755530 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 09:34:04.755530 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application created_value = creator( Oct 27 09:34:04.755530 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 27 09:34:04.756604 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 27 09:34:04.756604 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 09:34:04.756604 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application Oct 27 09:34:04.761357 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 286/550] 10.222.0.65 () {56 vars in 1108 bytes} [Thu Oct 27 09:34:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 09:34:04.762151 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60eb92e-5249-42fa-910d-ff508c2e01cb None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:34:04.797632 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563ff1bb-376e-4cfa-a7f3-d2835daa7e63 None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:34:04.834265 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:34:04.836514 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a528fe-69b7-4cfa-8a7b-001b5d6757de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:34:04.837130 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a528fe-69b7-4cfa-8a7b-001b5d6757de None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:34:04.837417 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a528fe-69b7-4cfa-8a7b-001b5d6757de None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:34:04.837689 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a528fe-69b7-4cfa-8a7b-001b5d6757de None admin] PATH_INFO: `/v3/domains` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:34:04.838391 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a528fe-69b7-4cfa-8a7b-001b5d6757de None admin] RBAC: Adding query filter params (name=Default) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 09:34:04.838722 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a528fe-69b7-4cfa-8a7b-001b5d6757de None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:34:04.840103 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a528fe-69b7-4cfa-8a7b-001b5d6757de None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:34:04.859346 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 265/551] 10.222.0.65 () {56 vars in 1109 bytes} [Thu Oct 27 09:34:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 09:34:04.860116 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a528fe-69b7-4cfa-8a7b-001b5d6757de None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:34:04.872112 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60eb92e-5249-42fa-910d-ff508c2e01cb None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:34:04.902405 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:34:04.908534 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b710fd32-fd04-4f93-a82a-4fbebac8228a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:34:04.909318 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b710fd32-fd04-4f93-a82a-4fbebac8228a None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:34:04.909582 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b710fd32-fd04-4f93-a82a-4fbebac8228a None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:34:04.909781 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b710fd32-fd04-4f93-a82a-4fbebac8228a None admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:34:04.918188 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b710fd32-fd04-4f93-a82a-4fbebac8228a None admin] RBAC: Adding query filter params (name=admin) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 09:34:04.918188 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b710fd32-fd04-4f93-a82a-4fbebac8228a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:34:04.918188 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b710fd32-fd04-4f93-a82a-4fbebac8228a None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:34:04.921436 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 287/552] 10.222.0.65 () {56 vars in 1099 bytes} [Thu Oct 27 09:34:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 09:34:04.922254 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b710fd32-fd04-4f93-a82a-4fbebac8228a None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:34:04.963018 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a528fe-69b7-4cfa-8a7b-001b5d6757de None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:34:04.998095 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab9c171-446e-40e1-b047-360027182379 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:34:04.998733 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab9c171-446e-40e1-b047-360027182379 None admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:34:04.999019 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab9c171-446e-40e1-b047-360027182379 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:34:04.999296 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab9c171-446e-40e1-b047-360027182379 None admin] PATH_INFO: `/v3/services` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:34:04.999948 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab9c171-446e-40e1-b047-360027182379 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:34:05.001317 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab9c171-446e-40e1-b047-360027182379 None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:34:05.026850 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b710fd32-fd04-4f93-a82a-4fbebac8228a None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:34:05.054697 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:34:05.061013 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1c275a-34c7-4b3e-a8a4-120047b54317 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:34:05.061615 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1c275a-34c7-4b3e-a8a4-120047b54317 None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:34:05.061892 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1c275a-34c7-4b3e-a8a4-120047b54317 None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:34:05.062165 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1c275a-34c7-4b3e-a8a4-120047b54317 None admin] PATH_INFO: `/v3/domains` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:34:05.062827 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1c275a-34c7-4b3e-a8a4-120047b54317 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 09:34:05.063130 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1c275a-34c7-4b3e-a8a4-120047b54317 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:34:05.064492 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1c275a-34c7-4b3e-a8a4-120047b54317 None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:34:05.076006 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 288/553] 10.222.0.65 () {56 vars in 1109 bytes} [Thu Oct 27 09:34:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 09:34:05.076763 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1c275a-34c7-4b3e-a8a4-120047b54317 None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:34:05.132108 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 266/554] 10.222.0.65 () {60 vars in 1141 bytes} [Thu Oct 27 09:34:04 2022] POST /identity/v3/services => generated 251 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 09:34:05.133361 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab9c171-446e-40e1-b047-360027182379 None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:34:05.195100 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1c275a-34c7-4b3e-a8a4-120047b54317 None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:34:05.253485 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f152e9-96ea-4af6-9cd2-e581bf66ec56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:34:05.254114 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f152e9-96ea-4af6-9cd2-e581bf66ec56 None admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:34:05.254419 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f152e9-96ea-4af6-9cd2-e581bf66ec56 None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:34:05.254742 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:34:05.255841 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f152e9-96ea-4af6-9cd2-e581bf66ec56 None admin] PATH_INFO: `/v3/services` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:34:05.256527 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f152e9-96ea-4af6-9cd2-e581bf66ec56 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:34:05.257957 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f152e9-96ea-4af6-9cd2-e581bf66ec56 None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:34:05.259292 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab9c171-446e-40e1-b047-360027182379 None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:34:05.298253 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81618f97-271f-4d82-804d-64557ee1c30e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:34:05.298936 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81618f97-271f-4d82-804d-64557ee1c30e None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:34:05.299215 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81618f97-271f-4d82-804d-64557ee1c30e None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:34:05.299485 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81618f97-271f-4d82-804d-64557ee1c30e None admin] PATH_INFO: `/v3/projects/service` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:34:05.307571 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81618f97-271f-4d82-804d-64557ee1c30e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:34:05.309031 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81618f97-271f-4d82-804d-64557ee1c30e None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:34:05.322111 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application [None req-81618f97-271f-4d82-804d-64557ee1c30e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 27 09:34:05.322111 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 09:34:05.322111 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 09:34:05.322111 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 09:34:05.322111 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 09:34:05.322111 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 09:34:05.322111 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 09:34:05.322111 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 09:34:05.322111 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 09:34:05.322111 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 09:34:05.322111 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 09:34:05.322111 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 09:34:05.322111 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 27 09:34:05.322111 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 27 09:34:05.322111 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 27 09:34:05.323374 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 27 09:34:05.323374 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 09:34:05.323374 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 09:34:05.323374 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 09:34:05.323374 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 09:34:05.323374 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 09:34:05.323374 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 09:34:05.323374 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 09:34:05.323374 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application with Lock( Oct 27 09:34:05.323374 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 09:34:05.323374 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._enter() Oct 27 09:34:05.323374 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 09:34:05.323374 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 09:34:05.323374 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 09:34:05.323374 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.creator() Oct 27 09:34:05.323374 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 09:34:05.323374 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application created_value = creator( Oct 27 09:34:05.325299 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 27 09:34:05.325299 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 27 09:34:05.325299 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 27 09:34:05.325299 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 27 09:34:05.325299 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 27 09:34:05.325299 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 27 09:34:05.325299 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 27 09:34:05.325299 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application Oct 27 09:34:05.327259 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 267/555] 10.222.0.65 () {56 vars in 1111 bytes} [Thu Oct 27 09:34:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 09:34:05.327587 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81618f97-271f-4d82-804d-64557ee1c30e None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:34:05.348677 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 289/556] 10.222.0.65 () {60 vars in 1141 bytes} [Thu Oct 27 09:34:05 2022] POST /identity/v3/services => generated 240 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 09:34:05.349695 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f152e9-96ea-4af6-9cd2-e581bf66ec56 None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:34:05.427774 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:34:05.477413 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81618f97-271f-4d82-804d-64557ee1c30e None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:34:05.518045 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f152e9-96ea-4af6-9cd2-e581bf66ec56 None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:34:05.522102 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d654def2-0119-4064-bd38-de5cf8153464 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:34:05.522337 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d654def2-0119-4064-bd38-de5cf8153464 None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:34:05.522730 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d654def2-0119-4064-bd38-de5cf8153464 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:34:05.523076 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d654def2-0119-4064-bd38-de5cf8153464 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:34:05.536114 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d654def2-0119-4064-bd38-de5cf8153464 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:34:05.537996 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d654def2-0119-4064-bd38-de5cf8153464 None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:34:05.560608 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application [None req-d654def2-0119-4064-bd38-de5cf8153464 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 09:34:05.560608 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 09:34:05.560608 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 09:34:05.560608 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 09:34:05.560608 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 09:34:05.560608 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 09:34:05.560608 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 09:34:05.560608 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 09:34:05.560608 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 09:34:05.560608 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 09:34:05.560608 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 09:34:05.560608 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 09:34:05.560608 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 27 09:34:05.560608 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 27 09:34:05.560608 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 27 09:34:05.560608 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 27 09:34:05.561798 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 09:34:05.561798 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 09:34:05.561798 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 09:34:05.561798 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 09:34:05.561798 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 09:34:05.561798 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 09:34:05.561798 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 09:34:05.561798 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application with Lock( Oct 27 09:34:05.561798 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 09:34:05.561798 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._enter() Oct 27 09:34:05.561798 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 09:34:05.561798 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 09:34:05.561798 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 09:34:05.561798 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.creator() Oct 27 09:34:05.561798 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 09:34:05.561798 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application created_value = creator( Oct 27 09:34:05.561798 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 27 09:34:05.562901 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 27 09:34:05.562901 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 09:34:05.562901 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application Oct 27 09:34:05.564639 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 268/557] 10.222.0.65 () {56 vars in 1108 bytes} [Thu Oct 27 09:34:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 09:34:05.565511 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d654def2-0119-4064-bd38-de5cf8153464 None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:34:05.571021 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd4e592-e4a8-44e1-97b8-9bde4bb3b1fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:34:05.571916 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd4e592-e4a8-44e1-97b8-9bde4bb3b1fa None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:34:05.572346 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd4e592-e4a8-44e1-97b8-9bde4bb3b1fa None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:34:05.573163 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd4e592-e4a8-44e1-97b8-9bde4bb3b1fa None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:34:05.581229 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:34:05.584290 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd4e592-e4a8-44e1-97b8-9bde4bb3b1fa None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:34:05.585747 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd4e592-e4a8-44e1-97b8-9bde4bb3b1fa None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:34:05.600320 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application [None req-1fd4e592-e4a8-44e1-97b8-9bde4bb3b1fa None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 27 09:34:05.600320 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 09:34:05.600320 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 09:34:05.600320 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 09:34:05.600320 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 09:34:05.600320 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 09:34:05.600320 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 09:34:05.600320 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 09:34:05.600320 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 09:34:05.600320 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 09:34:05.600320 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 09:34:05.600320 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 09:34:05.600320 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 27 09:34:05.600320 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 27 09:34:05.600320 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 27 09:34:05.600320 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 27 09:34:05.601409 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 09:34:05.601409 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 09:34:05.601409 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 27 09:34:05.601409 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 27 09:34:05.601409 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 27 09:34:05.601409 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 27 09:34:05.601409 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 09:34:05.601409 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 09:34:05.601409 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 09:34:05.601409 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 09:34:05.601409 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 09:34:05.601409 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application with Lock( Oct 27 09:34:05.601409 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 09:34:05.601409 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._enter() Oct 27 09:34:05.601409 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 09:34:05.601409 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 09:34:05.601409 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 09:34:05.601409 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.creator() Oct 27 09:34:05.602556 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 09:34:05.602556 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application created_value = creator( Oct 27 09:34:05.602556 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 27 09:34:05.602556 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 27 09:34:05.602556 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 27 09:34:05.602556 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 27 09:34:05.602556 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 27 09:34:05.602556 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 27 09:34:05.602556 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 27 09:34:05.602556 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application Oct 27 09:34:05.604557 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 290/558] 10.222.0.65 () {56 vars in 1117 bytes} [Thu Oct 27 09:34:05 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 09:34:05.605480 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd4e592-e4a8-44e1-97b8-9bde4bb3b1fa None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:34:05.693208 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d654def2-0119-4064-bd38-de5cf8153464 None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:34:05.731067 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50818cbd-14c3-444f-ab94-7a2aebf78110 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:34:05.731955 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50818cbd-14c3-444f-ab94-7a2aebf78110 None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:34:05.732378 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50818cbd-14c3-444f-ab94-7a2aebf78110 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:34:05.732791 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50818cbd-14c3-444f-ab94-7a2aebf78110 None admin] PATH_INFO: `/v3/projects` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:34:05.733625 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50818cbd-14c3-444f-ab94-7a2aebf78110 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 09:34:05.734070 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50818cbd-14c3-444f-ab94-7a2aebf78110 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:34:05.735768 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50818cbd-14c3-444f-ab94-7a2aebf78110 None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:34:05.740684 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd4e592-e4a8-44e1-97b8-9bde4bb3b1fa None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:34:05.742249 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:34:05.756160 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 269/559] 10.222.0.65 () {56 vars in 1148 bytes} [Thu Oct 27 09:34:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 09:34:05.762603 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50818cbd-14c3-444f-ab94-7a2aebf78110 None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:34:05.787296 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b53633-e3d9-4d59-a9c8-657b9d58dbc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:34:05.788140 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b53633-e3d9-4d59-a9c8-657b9d58dbc6 None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:34:05.788429 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b53633-e3d9-4d59-a9c8-657b9d58dbc6 None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:34:05.788709 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b53633-e3d9-4d59-a9c8-657b9d58dbc6 None admin] PATH_INFO: `/v3/domains` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:34:05.789612 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b53633-e3d9-4d59-a9c8-657b9d58dbc6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 09:34:05.789928 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b53633-e3d9-4d59-a9c8-657b9d58dbc6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:34:05.792091 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b53633-e3d9-4d59-a9c8-657b9d58dbc6 None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:34:05.810576 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 291/560] 10.222.0.65 () {56 vars in 1109 bytes} [Thu Oct 27 09:34:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 09:34:05.810576 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b53633-e3d9-4d59-a9c8-657b9d58dbc6 None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:34:05.858441 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:34:05.894377 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50818cbd-14c3-444f-ab94-7a2aebf78110 None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:34:05.936859 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08c633a-895a-4666-92e1-b419a0266d16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:34:05.937636 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08c633a-895a-4666-92e1-b419a0266d16 None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:34:05.937917 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08c633a-895a-4666-92e1-b419a0266d16 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:34:05.938192 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08c633a-895a-4666-92e1-b419a0266d16 None admin] PATH_INFO: `/v3/users` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:34:05.938967 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08c633a-895a-4666-92e1-b419a0266d16 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 09:34:05.939276 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08c633a-895a-4666-92e1-b419a0266d16 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:34:05.940032 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b53633-e3d9-4d59-a9c8-657b9d58dbc6 None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:34:05.940707 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08c633a-895a-4666-92e1-b419a0266d16 None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:34:05.964250 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 270/561] 10.222.0.65 () {56 vars in 1149 bytes} [Thu Oct 27 09:34:05 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 09:34:05.966021 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08c633a-895a-4666-92e1-b419a0266d16 None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:34:05.988688 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0b51d8-2b5e-44f4-8523-838825ec24d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:34:05.989353 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0b51d8-2b5e-44f4-8523-838825ec24d7 None admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:34:05.989636 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0b51d8-2b5e-44f4-8523-838825ec24d7 None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:34:05.989913 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0b51d8-2b5e-44f4-8523-838825ec24d7 None admin] PATH_INFO: `/v3/projects/dc2e3a7a1bcc480891c0b433291c00b1/users/01e32fc35c8b467e9604b325cf1527aa/roles/6ad17b9f9dea4b66ab2da3677d7e715d` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:34:05.992637 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0b51d8-2b5e-44f4-8523-838825ec24d7 None admin] RBAC: Authorizing `identity:create_grant(project_id=dc2e3a7a1bcc480891c0b433291c00b1, user_id=01e32fc35c8b467e9604b325cf1527aa, role_id=6ad17b9f9dea4b66ab2da3677d7e715d)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:34:05.995791 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0b51d8-2b5e-44f4-8523-838825ec24d7 None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:34:06.083323 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08c633a-895a-4666-92e1-b419a0266d16 None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:34:06.092042 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 292/562] 10.222.0.65 () {58 vars in 1439 bytes} [Thu Oct 27 09:34:05 2022] PUT /identity/v3/projects/dc2e3a7a1bcc480891c0b433291c00b1/users/01e32fc35c8b467e9604b325cf1527aa/roles/6ad17b9f9dea4b66ab2da3677d7e715d => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 09:34:06.093597 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0b51d8-2b5e-44f4-8523-838825ec24d7 None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:34:06.128426 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:34:06.137422 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:34:06.162211 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a61ae99-9d95-409e-b2de-32824a8ec2ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:34:06.162941 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a61ae99-9d95-409e-b2de-32824a8ec2ed None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:34:06.163231 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a61ae99-9d95-409e-b2de-32824a8ec2ed None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:34:06.163512 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a61ae99-9d95-409e-b2de-32824a8ec2ed None admin] PATH_INFO: `/v3/users/nova` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:34:06.185560 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a61ae99-9d95-409e-b2de-32824a8ec2ed None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:34:06.187075 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a61ae99-9d95-409e-b2de-32824a8ec2ed None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:34:06.209512 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application [None req-9a61ae99-9d95-409e-b2de-32824a8ec2ed None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 27 09:34:06.209512 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 09:34:06.209512 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 09:34:06.209512 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 09:34:06.209512 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 09:34:06.209512 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 09:34:06.209512 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 09:34:06.209512 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 09:34:06.209512 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 09:34:06.209512 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 09:34:06.209512 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 09:34:06.209512 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 09:34:06.209512 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 27 09:34:06.209512 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 27 09:34:06.209512 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 27 09:34:06.209512 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 27 09:34:06.210577 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 09:34:06.210577 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 09:34:06.210577 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 27 09:34:06.210577 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 27 09:34:06.210577 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 27 09:34:06.210577 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 27 09:34:06.210577 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 09:34:06.210577 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 09:34:06.210577 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 09:34:06.210577 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 09:34:06.210577 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 09:34:06.210577 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application with Lock( Oct 27 09:34:06.210577 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 09:34:06.210577 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._enter() Oct 27 09:34:06.210577 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 09:34:06.210577 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 09:34:06.210577 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 09:34:06.210577 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.creator() Oct 27 09:34:06.211519 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 09:34:06.211519 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application created_value = creator( Oct 27 09:34:06.211519 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 27 09:34:06.211519 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 27 09:34:06.211519 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 27 09:34:06.211519 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 27 09:34:06.211519 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 27 09:34:06.211519 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 27 09:34:06.211519 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 27 09:34:06.211519 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application Oct 27 09:34:06.211519 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 271/563] 10.222.0.65 () {56 vars in 1093 bytes} [Thu Oct 27 09:34:05 2022] GET /identity/v3/users/nova => generated 82 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 09:34:06.217069 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a61ae99-9d95-409e-b2de-32824a8ec2ed None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:34:06.242677 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0b51d8-2b5e-44f4-8523-838825ec24d7 None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:34:06.297944 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33221b5-0d1f-4c3c-aa5d-83d3a1d6826c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:34:06.299008 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33221b5-0d1f-4c3c-aa5d-83d3a1d6826c None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:34:06.299500 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33221b5-0d1f-4c3c-aa5d-83d3a1d6826c None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:34:06.299998 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33221b5-0d1f-4c3c-aa5d-83d3a1d6826c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:34:06.315522 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33221b5-0d1f-4c3c-aa5d-83d3a1d6826c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:34:06.317930 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33221b5-0d1f-4c3c-aa5d-83d3a1d6826c None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:34:06.344897 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application [None req-f33221b5-0d1f-4c3c-aa5d-83d3a1d6826c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 09:34:06.344897 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 09:34:06.344897 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 09:34:06.344897 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 09:34:06.344897 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 09:34:06.344897 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 09:34:06.344897 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 09:34:06.344897 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 09:34:06.344897 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 09:34:06.344897 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 09:34:06.344897 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 09:34:06.344897 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 09:34:06.344897 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 27 09:34:06.344897 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 27 09:34:06.344897 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 27 09:34:06.344897 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 27 09:34:06.345888 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 09:34:06.345888 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 09:34:06.345888 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 09:34:06.345888 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 09:34:06.345888 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 09:34:06.345888 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 09:34:06.345888 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 09:34:06.345888 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application with Lock( Oct 27 09:34:06.345888 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 09:34:06.345888 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._enter() Oct 27 09:34:06.345888 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 09:34:06.345888 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 09:34:06.345888 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 09:34:06.345888 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.creator() Oct 27 09:34:06.345888 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 09:34:06.345888 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application created_value = creator( Oct 27 09:34:06.345888 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 27 09:34:06.349517 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 27 09:34:06.349517 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 09:34:06.349517 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application Oct 27 09:34:06.349517 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 293/564] 10.222.0.65 () {56 vars in 1108 bytes} [Thu Oct 27 09:34:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 09:34:06.356098 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33221b5-0d1f-4c3c-aa5d-83d3a1d6826c None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:34:06.377230 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a61ae99-9d95-409e-b2de-32824a8ec2ed None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:34:06.426312 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f46976-e9e4-471a-a92f-f57f2f834c72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:34:06.426973 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f46976-e9e4-471a-a92f-f57f2f834c72 None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:34:06.427258 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f46976-e9e4-471a-a92f-f57f2f834c72 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:34:06.427551 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f46976-e9e4-471a-a92f-f57f2f834c72 None admin] PATH_INFO: `/v3/users` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:34:06.429367 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f46976-e9e4-471a-a92f-f57f2f834c72 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 09:34:06.429715 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f46976-e9e4-471a-a92f-f57f2f834c72 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:34:06.431232 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f46976-e9e4-471a-a92f-f57f2f834c72 None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:34:06.452531 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 272/565] 10.222.0.65 () {56 vars in 1133 bytes} [Thu Oct 27 09:34:06 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 09:34:06.459089 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f46976-e9e4-471a-a92f-f57f2f834c72 None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:34:06.468995 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:34:06.519292 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33221b5-0d1f-4c3c-aa5d-83d3a1d6826c None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:34:06.523260 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:34:06.595365 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a464e0-9e3c-428f-a8c5-789b3f644f9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:34:06.596054 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a464e0-9e3c-428f-a8c5-789b3f644f9c None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:34:06.596340 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a464e0-9e3c-428f-a8c5-789b3f644f9c None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:34:06.596612 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a464e0-9e3c-428f-a8c5-789b3f644f9c None admin] PATH_INFO: `/v3/domains` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:34:06.597262 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a464e0-9e3c-428f-a8c5-789b3f644f9c None admin] RBAC: Adding query filter params (name=Default) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 09:34:06.597562 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a464e0-9e3c-428f-a8c5-789b3f644f9c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:34:06.598966 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a464e0-9e3c-428f-a8c5-789b3f644f9c None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:34:06.611521 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f46976-e9e4-471a-a92f-f57f2f834c72 None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:34:06.628688 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 294/566] 10.222.0.65 () {56 vars in 1109 bytes} [Thu Oct 27 09:34:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 09:34:06.635820 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a464e0-9e3c-428f-a8c5-789b3f644f9c None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:34:06.685746 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a84358-6be6-41bb-a696-d4aca1708d99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:34:06.686365 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a84358-6be6-41bb-a696-d4aca1708d99 None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:34:06.686687 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a84358-6be6-41bb-a696-d4aca1708d99 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:34:06.687018 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a84358-6be6-41bb-a696-d4aca1708d99 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:34:06.812305 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a84358-6be6-41bb-a696-d4aca1708d99 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:34:06.813698 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a84358-6be6-41bb-a696-d4aca1708d99 None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:34:06.819651 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a464e0-9e3c-428f-a8c5-789b3f644f9c None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:34:06.866211 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4237e4c7-0491-4fb0-a7a6-599406d3d462 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:34:06.867404 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4237e4c7-0491-4fb0-a7a6-599406d3d462 None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:34:06.867690 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4237e4c7-0491-4fb0-a7a6-599406d3d462 None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:34:06.867965 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4237e4c7-0491-4fb0-a7a6-599406d3d462 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:34:06.871485 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:34:06.877889 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4237e4c7-0491-4fb0-a7a6-599406d3d462 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:34:06.879833 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4237e4c7-0491-4fb0-a7a6-599406d3d462 None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:34:06.893521 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application [None req-4237e4c7-0491-4fb0-a7a6-599406d3d462 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 27 09:34:06.893521 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 09:34:06.893521 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 09:34:06.893521 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 09:34:06.893521 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 09:34:06.893521 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 09:34:06.893521 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 09:34:06.893521 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 09:34:06.893521 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 09:34:06.893521 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 09:34:06.893521 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 09:34:06.893521 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 09:34:06.893521 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 27 09:34:06.893521 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 27 09:34:06.893521 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 27 09:34:06.900078 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 27 09:34:06.900078 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 09:34:06.900078 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 09:34:06.900078 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 09:34:06.900078 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 09:34:06.900078 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 09:34:06.900078 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 09:34:06.900078 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 09:34:06.900078 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application with Lock( Oct 27 09:34:06.900078 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 09:34:06.900078 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._enter() Oct 27 09:34:06.900078 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 09:34:06.900078 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 09:34:06.900078 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 09:34:06.900078 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.creator() Oct 27 09:34:06.900078 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 09:34:06.900078 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application created_value = creator( Oct 27 09:34:06.901607 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 27 09:34:06.901607 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 27 09:34:06.901607 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 27 09:34:06.901607 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 27 09:34:06.901607 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 27 09:34:06.901607 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 27 09:34:06.901607 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 27 09:34:06.901607 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application Oct 27 09:34:06.901607 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 295/567] 10.222.0.65 () {56 vars in 1111 bytes} [Thu Oct 27 09:34:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 27 09:34:06.901607 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4237e4c7-0491-4fb0-a7a6-599406d3d462 None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:34:06.938152 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:34:07.051545 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4237e4c7-0491-4fb0-a7a6-599406d3d462 None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:34:07.077454 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 273/568] 10.222.0.65 () {58 vars in 1282 bytes} [Thu Oct 27 09:34:06 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 619 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 27 09:34:07.084710 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a84358-6be6-41bb-a696-d4aca1708d99 None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:34:07.096385 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1319ce8-0432-4e57-9423-d0866f8e90f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:34:07.097004 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1319ce8-0432-4e57-9423-d0866f8e90f6 None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:34:07.097290 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1319ce8-0432-4e57-9423-d0866f8e90f6 None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:34:07.097566 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1319ce8-0432-4e57-9423-d0866f8e90f6 None admin] PATH_INFO: `/v3/projects` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:34:07.098260 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1319ce8-0432-4e57-9423-d0866f8e90f6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 09:34:07.098614 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1319ce8-0432-4e57-9423-d0866f8e90f6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:34:07.106579 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1319ce8-0432-4e57-9423-d0866f8e90f6 None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:34:07.116863 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 296/569] 10.222.0.65 () {56 vars in 1148 bytes} [Thu Oct 27 09:34:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 09:34:07.124109 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1319ce8-0432-4e57-9423-d0866f8e90f6 None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:34:07.250987 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:34:07.263621 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a84358-6be6-41bb-a696-d4aca1708d99 None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:34:07.313744 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a739db-9ff3-4be4-9679-bf3812094b3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:34:07.314390 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a739db-9ff3-4be4-9679-bf3812094b3c None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:34:07.314703 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a739db-9ff3-4be4-9679-bf3812094b3c None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:34:07.314981 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a739db-9ff3-4be4-9679-bf3812094b3c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:34:07.340165 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a739db-9ff3-4be4-9679-bf3812094b3c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:34:07.341558 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a739db-9ff3-4be4-9679-bf3812094b3c None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:34:07.355025 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:34:07.358685 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1319ce8-0432-4e57-9423-d0866f8e90f6 None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:34:07.375941 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application [None req-b8a739db-9ff3-4be4-9679-bf3812094b3c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 09:34:07.375941 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 09:34:07.375941 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 09:34:07.375941 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 09:34:07.375941 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 09:34:07.375941 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 09:34:07.375941 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 09:34:07.375941 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 09:34:07.375941 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 09:34:07.375941 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 09:34:07.375941 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 09:34:07.375941 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 09:34:07.375941 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 27 09:34:07.375941 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 27 09:34:07.375941 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 27 09:34:07.375941 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 27 09:34:07.377010 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 09:34:07.377010 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 09:34:07.377010 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 09:34:07.377010 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 09:34:07.377010 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 09:34:07.377010 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 09:34:07.377010 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 09:34:07.377010 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application with Lock( Oct 27 09:34:07.377010 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 09:34:07.377010 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._enter() Oct 27 09:34:07.377010 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 09:34:07.377010 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 09:34:07.377010 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 09:34:07.377010 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.creator() Oct 27 09:34:07.377010 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 09:34:07.377010 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application created_value = creator( Oct 27 09:34:07.377010 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 27 09:34:07.378332 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 27 09:34:07.378332 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 09:34:07.378332 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application Oct 27 09:34:07.387027 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 274/570] 10.222.0.65 () {56 vars in 1108 bytes} [Thu Oct 27 09:34:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 303 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 09:34:07.393240 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a739db-9ff3-4be4-9679-bf3812094b3c None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:34:07.399355 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b979b91-1632-4d44-bc98-c4f230b4823a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:34:07.400154 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b979b91-1632-4d44-bc98-c4f230b4823a None admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:34:07.400602 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b979b91-1632-4d44-bc98-c4f230b4823a None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:34:07.401652 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b979b91-1632-4d44-bc98-c4f230b4823a None admin] PATH_INFO: `/v3/projects/dc2e3a7a1bcc480891c0b433291c00b1/users/c18a92a796934277ad64a51ef3f7bb23/roles/8d728ccbaa534a949df6711b47151356` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:34:07.418348 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b979b91-1632-4d44-bc98-c4f230b4823a None admin] RBAC: Authorizing `identity:create_grant(project_id=dc2e3a7a1bcc480891c0b433291c00b1, user_id=c18a92a796934277ad64a51ef3f7bb23, role_id=8d728ccbaa534a949df6711b47151356)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:34:07.420011 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b979b91-1632-4d44-bc98-c4f230b4823a None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:34:07.492714 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 297/571] 10.222.0.65 () {58 vars in 1439 bytes} [Thu Oct 27 09:34:07 2022] PUT /identity/v3/projects/dc2e3a7a1bcc480891c0b433291c00b1/users/c18a92a796934277ad64a51ef3f7bb23/roles/8d728ccbaa534a949df6711b47151356 => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 09:34:07.567385 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a739db-9ff3-4be4-9679-bf3812094b3c None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:34:07.567845 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cccf9d-80ea-4080-a01a-db1c30949975 None None] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:34:07.568233 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cccf9d-80ea-4080-a01a-db1c30949975 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:34:07.568610 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cccf9d-80ea-4080-a01a-db1c30949975 None None] PATH_INFO: `/` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:34:07.574153 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 298/572] 10.222.0.65 () {54 vars in 927 bytes} [Thu Oct 27 09:34:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 09:34:07.576912 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9991116f-2f56-4001-acb7-660b39816418 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:34:07.577306 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9991116f-2f56-4001-acb7-660b39816418 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:34:07.578058 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9991116f-2f56-4001-acb7-660b39816418 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:34:07.612034 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3fb8b2-c7d1-47f1-a87e-40b5bf31cdc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:34:07.612575 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3fb8b2-c7d1-47f1-a87e-40b5bf31cdc8 None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:34:07.612848 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3fb8b2-c7d1-47f1-a87e-40b5bf31cdc8 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:34:07.613386 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3fb8b2-c7d1-47f1-a87e-40b5bf31cdc8 None admin] PATH_INFO: `/v3/domains` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:34:07.614036 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3fb8b2-c7d1-47f1-a87e-40b5bf31cdc8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 09:34:07.614340 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3fb8b2-c7d1-47f1-a87e-40b5bf31cdc8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:34:07.614583 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-9991116f-2f56-4001-acb7-660b39816418 None None] MFA Rules not processed for user `b5065084bf664b99bdeac46067cb0f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:34:07.615754 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3fb8b2-c7d1-47f1-a87e-40b5bf31cdc8 None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:34:07.616150 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-9991116f-2f56-4001-acb7-660b39816418 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:34:07.643336 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 275/573] 10.222.0.65 () {56 vars in 1109 bytes} [Thu Oct 27 09:34:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 09:34:07.645605 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3fb8b2-c7d1-47f1-a87e-40b5bf31cdc8 None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:34:07.733885 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:34:07.742652 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 299/574] 10.222.0.65 () {58 vars in 1024 bytes} [Thu Oct 27 09:34:07 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 27 09:34:07.786558 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3fb8b2-c7d1-47f1-a87e-40b5bf31cdc8 None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:34:07.826376 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abd23e8-8522-49b1-8370-08eab7f9a863 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:34:07.827078 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abd23e8-8522-49b1-8370-08eab7f9a863 None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:34:07.827378 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abd23e8-8522-49b1-8370-08eab7f9a863 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:34:07.827695 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abd23e8-8522-49b1-8370-08eab7f9a863 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:34:07.835159 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abd23e8-8522-49b1-8370-08eab7f9a863 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:34:07.836691 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abd23e8-8522-49b1-8370-08eab7f9a863 None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:34:07.852455 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application [None req-9abd23e8-8522-49b1-8370-08eab7f9a863 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 27 09:34:07.852455 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 09:34:07.852455 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 09:34:07.852455 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 09:34:07.852455 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 09:34:07.852455 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 09:34:07.852455 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 09:34:07.852455 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 09:34:07.852455 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 09:34:07.852455 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 09:34:07.852455 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 09:34:07.852455 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 09:34:07.852455 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 27 09:34:07.852455 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 27 09:34:07.852455 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 27 09:34:07.855140 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 27 09:34:07.855140 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 09:34:07.855140 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 09:34:07.855140 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 09:34:07.855140 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 09:34:07.855140 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 09:34:07.855140 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 09:34:07.855140 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 09:34:07.855140 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application with Lock( Oct 27 09:34:07.855140 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 09:34:07.855140 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._enter() Oct 27 09:34:07.855140 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 09:34:07.855140 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 09:34:07.855140 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 09:34:07.855140 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.creator() Oct 27 09:34:07.855140 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 09:34:07.855140 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application created_value = creator( Oct 27 09:34:07.856029 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 27 09:34:07.856029 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 27 09:34:07.856029 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 27 09:34:07.856029 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 27 09:34:07.856029 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 27 09:34:07.856029 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 27 09:34:07.856029 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 27 09:34:07.856029 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application Oct 27 09:34:07.856029 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 276/575] 10.222.0.65 () {56 vars in 1111 bytes} [Thu Oct 27 09:34:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 09:34:07.865029 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9991116f-2f56-4001-acb7-660b39816418 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:34:07.895815 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b3316c-363f-44f2-a3bd-fd3d8d8c3364 None None] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:34:07.896124 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b3316c-363f-44f2-a3bd-fd3d8d8c3364 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:34:07.896368 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b3316c-363f-44f2-a3bd-fd3d8d8c3364 None None] PATH_INFO: `/` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:34:07.897918 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 277/576] 10.222.0.65 () {54 vars in 927 bytes} [Thu Oct 27 09:34:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 27 09:34:07.907424 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b56fa5-7c31-4209-ab13-b6f9c52d906d None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:34:07.907791 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b56fa5-7c31-4209-ab13-b6f9c52d906d None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:34:07.908072 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b56fa5-7c31-4209-ab13-b6f9c52d906d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:34:07.933964 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-56b56fa5-7c31-4209-ab13-b6f9c52d906d None None] MFA Rules not processed for user `b5065084bf664b99bdeac46067cb0f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:34:07.935205 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-56b56fa5-7c31-4209-ab13-b6f9c52d906d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:34:07.954967 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:34:08.043360 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9991116f-2f56-4001-acb7-660b39816418 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:34:08.048271 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 278/577] 10.222.0.65 () {58 vars in 1024 bytes} [Thu Oct 27 09:34:07 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 27 09:34:08.094541 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813d50dd-b9c9-4cf5-9934-e52d43e41c4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:34:08.095156 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813d50dd-b9c9-4cf5-9934-e52d43e41c4b None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:34:08.095431 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813d50dd-b9c9-4cf5-9934-e52d43e41c4b None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:34:08.095702 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813d50dd-b9c9-4cf5-9934-e52d43e41c4b None admin] PATH_INFO: `/v3/projects` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:34:08.096438 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813d50dd-b9c9-4cf5-9934-e52d43e41c4b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 09:34:08.096742 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813d50dd-b9c9-4cf5-9934-e52d43e41c4b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:34:08.098207 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813d50dd-b9c9-4cf5-9934-e52d43e41c4b None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:34:08.118389 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 300/578] 10.222.0.65 () {56 vars in 1148 bytes} [Thu Oct 27 09:34:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 09:34:08.125271 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b56fa5-7c31-4209-ab13-b6f9c52d906d None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:34:08.130226 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813d50dd-b9c9-4cf5-9934-e52d43e41c4b None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:34:08.229671 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:34:08.298480 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b56fa5-7c31-4209-ab13-b6f9c52d906d None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:34:08.300564 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:34:08.321126 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813d50dd-b9c9-4cf5-9934-e52d43e41c4b None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:34:08.336023 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f58c671-ad30-4cac-a541-3fe2aefe7a5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:34:08.336935 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f58c671-ad30-4cac-a541-3fe2aefe7a5c None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:34:08.337363 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f58c671-ad30-4cac-a541-3fe2aefe7a5c None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:34:08.337825 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f58c671-ad30-4cac-a541-3fe2aefe7a5c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:34:08.339259 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f58c671-ad30-4cac-a541-3fe2aefe7a5c None admin] RBAC: Adding query filter params (role.id=6ad17b9f9dea4b66ab2da3677d7e715d, scope.project.id=dc2e3a7a1bcc480891c0b433291c00b1, user.id=fd0d23ef039d4f1591a589d302ef165f) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 09:34:08.339709 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f58c671-ad30-4cac-a541-3fe2aefe7a5c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:34:08.342233 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f58c671-ad30-4cac-a541-3fe2aefe7a5c None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:34:08.349241 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 279/579] 10.222.0.65 () {56 vars in 1374 bytes} [Thu Oct 27 09:34:08 2022] GET /identity/v3/role_assignments?user.id=fd0d23ef039d4f1591a589d302ef165f&scope.project.id=dc2e3a7a1bcc480891c0b433291c00b1&role.id=6ad17b9f9dea4b66ab2da3677d7e715d => generated 608 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 09:34:08.358418 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f58c671-ad30-4cac-a541-3fe2aefe7a5c None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:34:08.428903 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef2af52-a12c-4cb6-8914-db135981e016 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:34:08.429585 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef2af52-a12c-4cb6-8914-db135981e016 None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:34:08.429829 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef2af52-a12c-4cb6-8914-db135981e016 None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:34:08.430102 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef2af52-a12c-4cb6-8914-db135981e016 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:34:08.430735 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef2af52-a12c-4cb6-8914-db135981e016 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:34:08.432228 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef2af52-a12c-4cb6-8914-db135981e016 None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:34:08.450069 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application [None req-0ef2af52-a12c-4cb6-8914-db135981e016 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 27 09:34:08.450069 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 09:34:08.450069 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 27 09:34:08.450069 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 27 09:34:08.450069 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 27 09:34:08.450069 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 27 09:34:08.450069 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 27 09:34:08.450069 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 27 09:34:08.450069 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 27 09:34:08.450069 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application Oct 27 09:34:08.450069 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 27 09:34:08.450069 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application Oct 27 09:34:08.450069 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 09:34:08.450069 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 09:34:08.450069 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 09:34:08.450069 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 09:34:08.450069 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 09:34:08.451181 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 09:34:08.451181 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 09:34:08.451181 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 09:34:08.451181 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 09:34:08.451181 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 09:34:08.451181 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 09:34:08.451181 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 27 09:34:08.451181 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 27 09:34:08.451181 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 27 09:34:08.451181 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 27 09:34:08.451181 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 09:34:08.451181 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 09:34:08.451181 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 09:34:08.451181 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 09:34:08.451181 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 09:34:08.451181 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 09:34:08.452219 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 09:34:08.452219 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application with Lock( Oct 27 09:34:08.452219 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 09:34:08.452219 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._enter() Oct 27 09:34:08.452219 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 09:34:08.452219 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 09:34:08.452219 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 09:34:08.452219 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.creator() Oct 27 09:34:08.452219 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 09:34:08.452219 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application created_value = creator( Oct 27 09:34:08.452219 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 27 09:34:08.452219 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 27 09:34:08.452219 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 27 09:34:08.452219 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application Oct 27 09:34:08.452219 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 301/580] 10.222.0.65 () {56 vars in 1129 bytes} [Thu Oct 27 09:34:08 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 322 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 27 09:34:08.458183 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef2af52-a12c-4cb6-8914-db135981e016 None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:34:08.537280 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f58c671-ad30-4cac-a541-3fe2aefe7a5c None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:34:08.561262 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:34:08.595310 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1faef8-e4d1-4e2f-b251-6471b4804005 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:34:08.596162 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1faef8-e4d1-4e2f-b251-6471b4804005 None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:34:08.596327 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1faef8-e4d1-4e2f-b251-6471b4804005 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:34:08.596493 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1faef8-e4d1-4e2f-b251-6471b4804005 None admin] PATH_INFO: `/v3/services/network` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:34:08.597089 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1faef8-e4d1-4e2f-b251-6471b4804005 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:34:08.598470 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1faef8-e4d1-4e2f-b251-6471b4804005 None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:34:08.610208 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application [None req-8b1faef8-e4d1-4e2f-b251-6471b4804005 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Oct 27 09:34:08.610208 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 09:34:08.610208 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 27 09:34:08.610208 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 27 09:34:08.610208 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 27 09:34:08.610208 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 27 09:34:08.610208 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 27 09:34:08.610208 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 27 09:34:08.610208 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 27 09:34:08.610208 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application Oct 27 09:34:08.610208 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 27 09:34:08.610208 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application Oct 27 09:34:08.610208 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 09:34:08.610208 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 09:34:08.610208 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 09:34:08.610208 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 09:34:08.610208 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 09:34:08.611410 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 09:34:08.611410 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 09:34:08.611410 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 09:34:08.611410 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 09:34:08.611410 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 09:34:08.611410 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 09:34:08.611410 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 27 09:34:08.611410 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 27 09:34:08.611410 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 27 09:34:08.611410 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 27 09:34:08.611410 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 09:34:08.611410 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 09:34:08.611410 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 09:34:08.611410 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 09:34:08.611410 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 09:34:08.611410 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 09:34:08.612299 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 09:34:08.612299 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application with Lock( Oct 27 09:34:08.612299 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 09:34:08.612299 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._enter() Oct 27 09:34:08.612299 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 09:34:08.612299 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 09:34:08.612299 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 09:34:08.612299 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.creator() Oct 27 09:34:08.612299 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 09:34:08.612299 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application created_value = creator( Oct 27 09:34:08.612299 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 27 09:34:08.612299 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 27 09:34:08.612299 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 27 09:34:08.612299 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application Oct 27 09:34:08.612299 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 280/581] 10.222.0.65 () {56 vars in 1111 bytes} [Thu Oct 27 09:34:08 2022] GET /identity/v3/services/network => generated 88 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 27 09:34:08.617523 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1faef8-e4d1-4e2f-b251-6471b4804005 None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:34:08.641920 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef2af52-a12c-4cb6-8914-db135981e016 None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:34:08.685110 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d8b3e3-3c10-4eb8-a8bf-151524c1765c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:34:08.686023 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d8b3e3-3c10-4eb8-a8bf-151524c1765c None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:34:08.686472 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d8b3e3-3c10-4eb8-a8bf-151524c1765c None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:34:08.687037 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d8b3e3-3c10-4eb8-a8bf-151524c1765c None admin] PATH_INFO: `/v3/services` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:34:08.687835 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d8b3e3-3c10-4eb8-a8bf-151524c1765c None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 09:34:08.688352 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d8b3e3-3c10-4eb8-a8bf-151524c1765c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:34:08.689955 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d8b3e3-3c10-4eb8-a8bf-151524c1765c None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:34:08.696133 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 302/582] 10.222.0.65 () {56 vars in 1124 bytes} [Thu Oct 27 09:34:08 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 09:34:08.701983 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d8b3e3-3c10-4eb8-a8bf-151524c1765c None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:34:08.732680 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:34:08.745609 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1faef8-e4d1-4e2f-b251-6471b4804005 None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:34:08.792823 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790fed95-b303-4c88-9050-18f1f0c4ddcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:34:08.793822 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790fed95-b303-4c88-9050-18f1f0c4ddcc None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:34:08.794300 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790fed95-b303-4c88-9050-18f1f0c4ddcc None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:34:08.794813 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790fed95-b303-4c88-9050-18f1f0c4ddcc None admin] PATH_INFO: `/v3/services` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:34:08.795676 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790fed95-b303-4c88-9050-18f1f0c4ddcc None admin] RBAC: Adding query filter params (name=network) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 09:34:08.796236 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790fed95-b303-4c88-9050-18f1f0c4ddcc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:34:08.797797 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790fed95-b303-4c88-9050-18f1f0c4ddcc None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:34:08.815656 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 281/583] 10.222.0.65 () {56 vars in 1112 bytes} [Thu Oct 27 09:34:08 2022] GET /identity/v3/services?name=network => generated 124 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 09:34:08.816556 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d8b3e3-3c10-4eb8-a8bf-151524c1765c None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:34:08.820910 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790fed95-b303-4c88-9050-18f1f0c4ddcc None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:34:08.857847 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c64b061-b3b1-4235-b0ef-fa0869b5a1cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:34:08.858477 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c64b061-b3b1-4235-b0ef-fa0869b5a1cc None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:34:08.858791 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c64b061-b3b1-4235-b0ef-fa0869b5a1cc None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:34:08.859067 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c64b061-b3b1-4235-b0ef-fa0869b5a1cc None admin] PATH_INFO: `/v3/services` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:34:08.859708 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c64b061-b3b1-4235-b0ef-fa0869b5a1cc None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 09:34:08.860015 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c64b061-b3b1-4235-b0ef-fa0869b5a1cc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:34:08.861407 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c64b061-b3b1-4235-b0ef-fa0869b5a1cc None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:34:08.868498 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 303/584] 10.222.0.65 () {56 vars in 1124 bytes} [Thu Oct 27 09:34:08 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 09:34:08.877914 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c64b061-b3b1-4235-b0ef-fa0869b5a1cc None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:34:08.896529 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:34:09.021095 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790fed95-b303-4c88-9050-18f1f0c4ddcc None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:34:09.044714 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:34:09.061078 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c64b061-b3b1-4235-b0ef-fa0869b5a1cc None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:34:09.068910 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c330070-44c4-4ec9-8ff8-aad0c9dcdf0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:34:09.069726 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c330070-44c4-4ec9-8ff8-aad0c9dcdf0c None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:34:09.070213 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c330070-44c4-4ec9-8ff8-aad0c9dcdf0c None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:34:09.070704 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c330070-44c4-4ec9-8ff8-aad0c9dcdf0c None admin] PATH_INFO: `/v3/services` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:34:09.071486 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c330070-44c4-4ec9-8ff8-aad0c9dcdf0c None admin] RBAC: Adding query filter params (type=network) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 09:34:09.071928 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c330070-44c4-4ec9-8ff8-aad0c9dcdf0c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:34:09.073870 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c330070-44c4-4ec9-8ff8-aad0c9dcdf0c None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:34:09.080693 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 282/585] 10.222.0.65 () {56 vars in 1112 bytes} [Thu Oct 27 09:34:08 2022] GET /identity/v3/services?type=network => generated 350 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 09:34:09.082210 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb328141-c1bd-49ad-a37d-0774c5a62d72 None None] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:34:09.082693 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb328141-c1bd-49ad-a37d-0774c5a62d72 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:34:09.083186 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb328141-c1bd-49ad-a37d-0774c5a62d72 None None] PATH_INFO: `/` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:34:09.084821 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 283/586] 10.222.0.65 () {54 vars in 927 bytes} [Thu Oct 27 09:34:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 09:34:09.086397 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb328141-c1bd-49ad-a37d-0774c5a62d72 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:34:09.103229 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83ef956-02cf-4dd0-bd80-40e5e3e8a603 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:34:09.104823 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83ef956-02cf-4dd0-bd80-40e5e3e8a603 None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:34:09.105110 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83ef956-02cf-4dd0-bd80-40e5e3e8a603 None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:34:09.105387 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83ef956-02cf-4dd0-bd80-40e5e3e8a603 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:34:09.106622 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83ef956-02cf-4dd0-bd80-40e5e3e8a603 None admin] RBAC: Adding query filter params (interface=public, service_id=84c637649dce4d838321346ce807c96e, region_id=RegionOne) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 09:34:09.106941 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83ef956-02cf-4dd0-bd80-40e5e3e8a603 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:34:09.108606 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83ef956-02cf-4dd0-bd80-40e5e3e8a603 None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:34:09.124251 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 304/587] 10.222.0.65 () {56 vars in 1251 bytes} [Thu Oct 27 09:34:08 2022] GET /identity/v3/endpoints?service_id=84c637649dce4d838321346ce807c96e&interface=public®ion_id=RegionOne => generated 194 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 09:34:09.124251 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b534380-402d-4f28-bd2a-731a8e46cb16 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:34:09.124251 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b534380-402d-4f28-bd2a-731a8e46cb16 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:34:09.124251 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b534380-402d-4f28-bd2a-731a8e46cb16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:34:09.145018 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-4b534380-402d-4f28-bd2a-731a8e46cb16 None None] MFA Rules not processed for user `b5065084bf664b99bdeac46067cb0f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:34:09.146227 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-4b534380-402d-4f28-bd2a-731a8e46cb16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:34:09.218583 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb328141-c1bd-49ad-a37d-0774c5a62d72 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:34:09.221924 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:34:09.247235 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 305/588] 10.222.0.65 () {58 vars in 1024 bytes} [Thu Oct 27 09:34:09 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 27 09:34:09.248182 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b534380-402d-4f28-bd2a-731a8e46cb16 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:34:09.271072 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a635bd-7484-4333-a0ae-8dd22c819e36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:34:09.272511 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a635bd-7484-4333-a0ae-8dd22c819e36 None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:34:09.273874 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a635bd-7484-4333-a0ae-8dd22c819e36 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:34:09.275931 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a635bd-7484-4333-a0ae-8dd22c819e36 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:34:09.278291 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a635bd-7484-4333-a0ae-8dd22c819e36 None admin] RBAC: Adding query filter params (interface=public, service_id=130dd3ea44504662b44922f4957c27dc, region_id=RegionOne) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 09:34:09.279916 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a635bd-7484-4333-a0ae-8dd22c819e36 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:34:09.281731 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a635bd-7484-4333-a0ae-8dd22c819e36 None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:34:09.301014 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 284/589] 10.222.0.65 () {56 vars in 1251 bytes} [Thu Oct 27 09:34:09 2022] GET /identity/v3/endpoints?service_id=130dd3ea44504662b44922f4957c27dc&interface=public®ion_id=RegionOne => generated 194 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 09:34:09.307352 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a635bd-7484-4333-a0ae-8dd22c819e36 None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:34:09.391788 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:34:09.415238 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b534380-402d-4f28-bd2a-731a8e46cb16 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:34:09.457371 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53cfefb-fce0-45ae-9997-03408839529b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:34:09.458915 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53cfefb-fce0-45ae-9997-03408839529b None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:34:09.459397 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53cfefb-fce0-45ae-9997-03408839529b None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:34:09.460156 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53cfefb-fce0-45ae-9997-03408839529b None admin] PATH_INFO: `/v3/services` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:34:09.460964 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53cfefb-fce0-45ae-9997-03408839529b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:34:09.462550 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53cfefb-fce0-45ae-9997-03408839529b None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:34:09.469540 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 306/590] 10.222.0.65 () {56 vars in 1087 bytes} [Thu Oct 27 09:34:09 2022] GET /identity/v3/services => generated 772 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 09:34:09.543598 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a635bd-7484-4333-a0ae-8dd22c819e36 None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:34:09.585149 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53cfefb-fce0-45ae-9997-03408839529b None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:34:09.601943 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd086fa-99e8-453b-aba6-f4f4f32ae79f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:34:09.603019 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd086fa-99e8-453b-aba6-f4f4f32ae79f None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:34:09.604123 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd086fa-99e8-453b-aba6-f4f4f32ae79f None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:34:09.604957 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd086fa-99e8-453b-aba6-f4f4f32ae79f None admin] PATH_INFO: `/v3/services` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:34:09.607628 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd086fa-99e8-453b-aba6-f4f4f32ae79f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:34:09.609343 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd086fa-99e8-453b-aba6-f4f4f32ae79f None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:34:09.623295 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 285/591] 10.222.0.65 () {56 vars in 1087 bytes} [Thu Oct 27 09:34:09 2022] GET /identity/v3/services => generated 772 bytes in 317 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 09:34:09.767325 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53cfefb-fce0-45ae-9997-03408839529b None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:34:09.812762 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bf55b7-7df2-4511-affc-66e9ac1a3650 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:34:09.813339 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bf55b7-7df2-4511-affc-66e9ac1a3650 None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:34:09.813620 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bf55b7-7df2-4511-affc-66e9ac1a3650 None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:34:09.813896 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bf55b7-7df2-4511-affc-66e9ac1a3650 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:34:09.827526 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22bf55b7-7df2-4511-affc-66e9ac1a3650 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 09:34:09.832542 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application [None req-22bf55b7-7df2-4511-affc-66e9ac1a3650 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 27 09:34:09.832542 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 09:34:09.832542 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 09:34:09.832542 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 09:34:09.832542 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 09:34:09.832542 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 09:34:09.832542 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 09:34:09.832542 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 09:34:09.832542 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 09:34:09.832542 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 09:34:09.832542 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 09:34:09.832542 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 09:34:09.832542 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 27 09:34:09.832542 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 27 09:34:09.832542 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 27 09:34:09.832542 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 27 09:34:09.833482 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 27 09:34:09.833482 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 27 09:34:09.833482 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 27 09:34:09.833482 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 27 09:34:09.833482 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 09:34:09.833482 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 09:34:09.833482 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 09:34:09.833482 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 09:34:09.833482 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 09:34:09.833482 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 09:34:09.833482 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 09:34:09.833482 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application with Lock( Oct 27 09:34:09.833482 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 09:34:09.833482 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._enter() Oct 27 09:34:09.833482 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 09:34:09.833482 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 09:34:09.834303 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 09:34:09.834303 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.creator() Oct 27 09:34:09.834303 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 09:34:09.834303 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application created_value = creator( Oct 27 09:34:09.834303 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 27 09:34:09.834303 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 27 09:34:09.834303 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 27 09:34:09.834303 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 27 09:34:09.834303 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 27 09:34:09.834303 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 27 09:34:09.834303 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 27 09:34:09.834303 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application Oct 27 09:34:09.834303 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 307/592] 10.222.0.65 () {56 vars in 1096 bytes} [Thu Oct 27 09:34:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 09:34:09.841036 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd086fa-99e8-453b-aba6-f4f4f32ae79f None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:34:09.879441 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:34:09.959200 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd086fa-99e8-453b-aba6-f4f4f32ae79f None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:34:09.997316 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8684906-ccd3-491c-a606-6dde7b7fd905 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:34:09.997933 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8684906-ccd3-491c-a606-6dde7b7fd905 None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:34:09.998215 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8684906-ccd3-491c-a606-6dde7b7fd905 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:34:09.998490 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8684906-ccd3-491c-a606-6dde7b7fd905 None admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:34:09.999196 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8684906-ccd3-491c-a606-6dde7b7fd905 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 09:34:09.999593 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8684906-ccd3-491c-a606-6dde7b7fd905 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:34:10.001043 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8684906-ccd3-491c-a606-6dde7b7fd905 None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:34:10.011677 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 286/593] 10.222.0.65 () {56 vars in 1099 bytes} [Thu Oct 27 09:34:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 09:34:10.017450 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bf55b7-7df2-4511-affc-66e9ac1a3650 None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:34:10.022099 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:34:10.167944 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bf55b7-7df2-4511-affc-66e9ac1a3650 None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:34:10.200997 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd86a31-fb1b-43de-a935-dd6917235dd9 None None] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:34:10.201383 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd86a31-fb1b-43de-a935-dd6917235dd9 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:34:10.201745 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd86a31-fb1b-43de-a935-dd6917235dd9 None None] PATH_INFO: `/` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:34:10.204256 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 287/594] 10.222.0.65 () {54 vars in 927 bytes} [Thu Oct 27 09:34:10 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 09:34:10.209841 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7effe5bc-2948-405a-b037-8714e93dc873 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:34:10.210137 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7effe5bc-2948-405a-b037-8714e93dc873 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:34:10.210420 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7effe5bc-2948-405a-b037-8714e93dc873 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:34:10.236065 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9c280a-ab14-4157-9fd0-6046dc66d83d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:34:10.237106 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9c280a-ab14-4157-9fd0-6046dc66d83d None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:34:10.237593 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9c280a-ab14-4157-9fd0-6046dc66d83d None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:34:10.238342 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9c280a-ab14-4157-9fd0-6046dc66d83d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:34:10.249978 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-7effe5bc-2948-405a-b037-8714e93dc873 None None] MFA Rules not processed for user `b5065084bf664b99bdeac46067cb0f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:34:10.251590 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-7effe5bc-2948-405a-b037-8714e93dc873 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:34:10.264099 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9c280a-ab14-4157-9fd0-6046dc66d83d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:34:10.265924 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9c280a-ab14-4157-9fd0-6046dc66d83d None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:34:10.290886 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application [None req-cb9c280a-ab14-4157-9fd0-6046dc66d83d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 09:34:10.290886 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 09:34:10.290886 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 09:34:10.290886 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 09:34:10.290886 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 09:34:10.290886 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 09:34:10.290886 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 09:34:10.290886 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 09:34:10.290886 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 09:34:10.290886 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 09:34:10.290886 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 09:34:10.290886 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 09:34:10.290886 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 27 09:34:10.290886 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 27 09:34:10.290886 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 27 09:34:10.290886 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 27 09:34:10.292401 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 09:34:10.292401 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 09:34:10.292401 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 09:34:10.292401 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 09:34:10.292401 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 09:34:10.292401 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 09:34:10.292401 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 09:34:10.292401 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application with Lock( Oct 27 09:34:10.292401 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 09:34:10.292401 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._enter() Oct 27 09:34:10.292401 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 09:34:10.292401 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 09:34:10.292401 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 09:34:10.292401 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.creator() Oct 27 09:34:10.292401 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 09:34:10.292401 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application created_value = creator( Oct 27 09:34:10.292401 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 27 09:34:10.293269 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 27 09:34:10.293269 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 09:34:10.293269 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application Oct 27 09:34:10.293269 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 308/595] 10.222.0.65 () {56 vars in 1108 bytes} [Thu Oct 27 09:34:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 09:34:10.301890 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9c280a-ab14-4157-9fd0-6046dc66d83d None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:34:10.376265 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 288/596] 10.222.0.65 () {58 vars in 1024 bytes} [Thu Oct 27 09:34:10 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 27 09:34:10.393627 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:34:10.455930 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9c280a-ab14-4157-9fd0-6046dc66d83d None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:34:10.492535 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11696c1-df26-4484-b85d-48c8b70055af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:34:10.493191 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11696c1-df26-4484-b85d-48c8b70055af None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:34:10.493434 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11696c1-df26-4484-b85d-48c8b70055af None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:34:10.493678 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11696c1-df26-4484-b85d-48c8b70055af None admin] PATH_INFO: `/v3/domains` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:34:10.494389 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11696c1-df26-4484-b85d-48c8b70055af None admin] RBAC: Adding query filter params (name=Default) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 09:34:10.494734 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11696c1-df26-4484-b85d-48c8b70055af None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:34:10.496189 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11696c1-df26-4484-b85d-48c8b70055af None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:34:10.509458 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 309/597] 10.222.0.65 () {56 vars in 1109 bytes} [Thu Oct 27 09:34:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 09:34:10.515559 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7effe5bc-2948-405a-b037-8714e93dc873 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:34:10.543644 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:34:10.644858 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7effe5bc-2948-405a-b037-8714e93dc873 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:34:10.694945 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ac6f56-a87c-438e-bbdb-40736fd0a416 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:34:10.695631 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ac6f56-a87c-438e-bbdb-40736fd0a416 None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:34:10.695964 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ac6f56-a87c-438e-bbdb-40736fd0a416 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:34:10.696246 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ac6f56-a87c-438e-bbdb-40736fd0a416 None admin] PATH_INFO: `/v3/users/swift` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:34:10.702719 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11696c1-df26-4484-b85d-48c8b70055af None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:34:10.714095 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ac6f56-a87c-438e-bbdb-40736fd0a416 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:34:10.715528 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ac6f56-a87c-438e-bbdb-40736fd0a416 None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:34:10.729929 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application [None req-b9ac6f56-a87c-438e-bbdb-40736fd0a416 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 27 09:34:10.729929 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 09:34:10.729929 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 09:34:10.729929 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 09:34:10.729929 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 09:34:10.729929 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 09:34:10.729929 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 09:34:10.729929 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 09:34:10.729929 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 09:34:10.729929 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 09:34:10.729929 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 09:34:10.729929 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 09:34:10.729929 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 27 09:34:10.729929 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 27 09:34:10.729929 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 27 09:34:10.729929 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 27 09:34:10.730946 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 09:34:10.730946 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 09:34:10.730946 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 27 09:34:10.730946 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 27 09:34:10.730946 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 27 09:34:10.730946 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 27 09:34:10.730946 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 09:34:10.730946 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 09:34:10.730946 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 09:34:10.730946 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 09:34:10.730946 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 09:34:10.730946 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application with Lock( Oct 27 09:34:10.730946 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 09:34:10.730946 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._enter() Oct 27 09:34:10.730946 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 09:34:10.730946 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 09:34:10.730946 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 09:34:10.730946 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.creator() Oct 27 09:34:10.731870 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 09:34:10.731870 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application created_value = creator( Oct 27 09:34:10.731870 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 27 09:34:10.731870 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 27 09:34:10.731870 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 27 09:34:10.731870 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 27 09:34:10.731870 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 27 09:34:10.731870 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 27 09:34:10.731870 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 27 09:34:10.731870 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application Oct 27 09:34:10.731870 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 289/598] 10.222.0.65 () {56 vars in 1096 bytes} [Thu Oct 27 09:34:10 2022] GET /identity/v3/users/swift => generated 83 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 09:34:10.739042 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ac6f56-a87c-438e-bbdb-40736fd0a416 None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:34:10.817707 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11696c1-df26-4484-b85d-48c8b70055af None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:34:10.835643 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:34:10.855462 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7129bf7a-dfec-403b-a560-e0845f6aa242 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:34:10.864599 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7129bf7a-dfec-403b-a560-e0845f6aa242 None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:34:10.864599 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7129bf7a-dfec-403b-a560-e0845f6aa242 None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:34:10.864599 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7129bf7a-dfec-403b-a560-e0845f6aa242 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:34:10.869637 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7129bf7a-dfec-403b-a560-e0845f6aa242 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 09:34:10.874886 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application [None req-7129bf7a-dfec-403b-a560-e0845f6aa242 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 27 09:34:10.874886 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 09:34:10.874886 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 09:34:10.874886 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 09:34:10.874886 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 09:34:10.874886 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 09:34:10.874886 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 09:34:10.874886 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 09:34:10.874886 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 09:34:10.874886 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 09:34:10.874886 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 09:34:10.874886 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 09:34:10.874886 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 27 09:34:10.874886 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 27 09:34:10.874886 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 27 09:34:10.874886 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 27 09:34:10.875903 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 27 09:34:10.875903 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 27 09:34:10.875903 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 27 09:34:10.875903 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 27 09:34:10.875903 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 09:34:10.875903 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 09:34:10.875903 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 09:34:10.875903 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 09:34:10.875903 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 09:34:10.875903 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 09:34:10.875903 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 09:34:10.875903 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application with Lock( Oct 27 09:34:10.875903 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 09:34:10.875903 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._enter() Oct 27 09:34:10.875903 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 09:34:10.875903 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 09:34:10.876720 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 09:34:10.876720 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.creator() Oct 27 09:34:10.876720 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 09:34:10.876720 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application created_value = creator( Oct 27 09:34:10.876720 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 27 09:34:10.876720 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 27 09:34:10.876720 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 27 09:34:10.876720 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 27 09:34:10.876720 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 27 09:34:10.876720 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 27 09:34:10.876720 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 27 09:34:10.876720 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application Oct 27 09:34:10.876720 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 310/599] 10.222.0.65 () {56 vars in 1102 bytes} [Thu Oct 27 09:34:10 2022] GET /identity/v3/roles/service => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 27 09:34:10.883701 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7129bf7a-dfec-403b-a560-e0845f6aa242 None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:34:10.902988 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:34:10.911874 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ac6f56-a87c-438e-bbdb-40736fd0a416 None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:34:10.954560 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21563a7b-709b-46f4-81f2-cdf47de3da20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:34:10.955189 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21563a7b-709b-46f4-81f2-cdf47de3da20 None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:34:10.955616 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21563a7b-709b-46f4-81f2-cdf47de3da20 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:34:10.955906 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21563a7b-709b-46f4-81f2-cdf47de3da20 None admin] PATH_INFO: `/v3/users` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:34:10.956649 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21563a7b-709b-46f4-81f2-cdf47de3da20 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 09:34:10.956957 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21563a7b-709b-46f4-81f2-cdf47de3da20 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:34:10.958418 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21563a7b-709b-46f4-81f2-cdf47de3da20 None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:34:10.995798 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 290/600] 10.222.0.65 () {56 vars in 1135 bytes} [Thu Oct 27 09:34:10 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 09:34:10.999480 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21563a7b-709b-46f4-81f2-cdf47de3da20 None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:34:11.076620 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7129bf7a-dfec-403b-a560-e0845f6aa242 None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:34:11.116989 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46922178-288b-4fa9-b73e-f72870180109 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:34:11.118639 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46922178-288b-4fa9-b73e-f72870180109 None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:34:11.119230 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46922178-288b-4fa9-b73e-f72870180109 None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:34:11.119768 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46922178-288b-4fa9-b73e-f72870180109 None admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:34:11.120655 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46922178-288b-4fa9-b73e-f72870180109 None admin] RBAC: Adding query filter params (name=service) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 09:34:11.121332 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46922178-288b-4fa9-b73e-f72870180109 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:34:11.123376 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46922178-288b-4fa9-b73e-f72870180109 None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:34:11.137137 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 311/601] 10.222.0.65 () {56 vars in 1103 bytes} [Thu Oct 27 09:34:10 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 09:34:11.138761 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b137370-ec84-4db3-877a-af69350232da None None] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:34:11.139217 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b137370-ec84-4db3-877a-af69350232da None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:34:11.139655 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b137370-ec84-4db3-877a-af69350232da None None] PATH_INFO: `/` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:34:11.145460 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 312/602] 10.222.0.65 () {54 vars in 927 bytes} [Thu Oct 27 09:34:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 09:34:11.145460 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b137370-ec84-4db3-877a-af69350232da None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:34:11.148271 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21563a7b-709b-46f4-81f2-cdf47de3da20 None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:34:11.187515 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0372e4e-4adf-47af-bb78-1ff7238bce3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:34:11.188163 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0372e4e-4adf-47af-bb78-1ff7238bce3a None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:34:11.188447 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0372e4e-4adf-47af-bb78-1ff7238bce3a None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:34:11.188781 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0372e4e-4adf-47af-bb78-1ff7238bce3a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:34:11.198384 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:34:11.211318 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:34:11.282386 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b137370-ec84-4db3-877a-af69350232da None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:34:11.295434 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0372e4e-4adf-47af-bb78-1ff7238bce3a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:34:11.298007 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0372e4e-4adf-47af-bb78-1ff7238bce3a None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:34:11.335781 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feec90d3-34ef-42b9-86ab-a254a2c62188 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:34:11.336772 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feec90d3-34ef-42b9-86ab-a254a2c62188 None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:34:11.337516 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feec90d3-34ef-42b9-86ab-a254a2c62188 None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:34:11.338162 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feec90d3-34ef-42b9-86ab-a254a2c62188 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:34:11.353955 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feec90d3-34ef-42b9-86ab-a254a2c62188 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:34:11.355987 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feec90d3-34ef-42b9-86ab-a254a2c62188 None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:34:11.374943 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application [None req-feec90d3-34ef-42b9-86ab-a254a2c62188 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 09:34:11.374943 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 09:34:11.374943 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 09:34:11.374943 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 09:34:11.374943 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 09:34:11.374943 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 09:34:11.374943 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 09:34:11.374943 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 09:34:11.374943 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 09:34:11.374943 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 09:34:11.374943 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 09:34:11.374943 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 09:34:11.374943 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 27 09:34:11.374943 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 27 09:34:11.374943 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 27 09:34:11.374943 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 27 09:34:11.375942 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 09:34:11.375942 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 09:34:11.375942 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 09:34:11.375942 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 09:34:11.375942 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 09:34:11.375942 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 09:34:11.375942 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 09:34:11.375942 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application with Lock( Oct 27 09:34:11.375942 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 09:34:11.375942 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._enter() Oct 27 09:34:11.375942 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 09:34:11.375942 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 09:34:11.375942 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 09:34:11.375942 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.creator() Oct 27 09:34:11.375942 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 09:34:11.375942 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application created_value = creator( Oct 27 09:34:11.375942 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 27 09:34:11.376806 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 27 09:34:11.376806 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 09:34:11.376806 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application Oct 27 09:34:11.380930 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 313/603] 10.222.0.65 () {56 vars in 1108 bytes} [Thu Oct 27 09:34:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 09:34:11.382282 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9295d3d0-2952-47a4-b170-bfe34e040e88 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:34:11.382595 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9295d3d0-2952-47a4-b170-bfe34e040e88 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:34:11.382877 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9295d3d0-2952-47a4-b170-bfe34e040e88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:34:11.403743 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-9295d3d0-2952-47a4-b170-bfe34e040e88 None None] MFA Rules not processed for user `b5065084bf664b99bdeac46067cb0f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:34:11.405136 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-9295d3d0-2952-47a4-b170-bfe34e040e88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:34:11.430346 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 291/604] 10.222.0.65 () {58 vars in 1282 bytes} [Thu Oct 27 09:34:10 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 431 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 27 09:34:11.432108 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0372e4e-4adf-47af-bb78-1ff7238bce3a None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:34:11.494662 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 314/605] 10.222.0.65 () {58 vars in 1024 bytes} [Thu Oct 27 09:34:11 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 27 09:34:11.494662 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9295d3d0-2952-47a4-b170-bfe34e040e88 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:34:11.496146 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:34:11.530975 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:34:11.599349 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0372e4e-4adf-47af-bb78-1ff7238bce3a None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:34:11.653520 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9295d3d0-2952-47a4-b170-bfe34e040e88 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:34:11.689249 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738580f2-827c-4345-abad-097cdec61edc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:34:11.689866 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738580f2-827c-4345-abad-097cdec61edc None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:34:11.690147 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738580f2-827c-4345-abad-097cdec61edc None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:34:11.690420 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738580f2-827c-4345-abad-097cdec61edc None admin] PATH_INFO: `/v3/domains` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:34:11.691100 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738580f2-827c-4345-abad-097cdec61edc None admin] RBAC: Adding query filter params (name=Default) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 09:34:11.691403 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738580f2-827c-4345-abad-097cdec61edc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:34:11.691648 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92db9b4-281c-4fff-9d54-7fc19e6a0403 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:34:11.692279 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92db9b4-281c-4fff-9d54-7fc19e6a0403 None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:34:11.692555 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92db9b4-281c-4fff-9d54-7fc19e6a0403 None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:34:11.692762 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738580f2-827c-4345-abad-097cdec61edc None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:34:11.692861 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92db9b4-281c-4fff-9d54-7fc19e6a0403 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:34:11.712788 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92db9b4-281c-4fff-9d54-7fc19e6a0403 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:34:11.714207 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 292/606] 10.222.0.65 () {56 vars in 1109 bytes} [Thu Oct 27 09:34:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 09:34:11.714772 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92db9b4-281c-4fff-9d54-7fc19e6a0403 None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:34:11.721993 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738580f2-827c-4345-abad-097cdec61edc None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:34:11.738109 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application [None req-e92db9b4-281c-4fff-9d54-7fc19e6a0403 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 09:34:11.738109 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 09:34:11.738109 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 09:34:11.738109 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 09:34:11.738109 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 09:34:11.738109 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 09:34:11.738109 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 09:34:11.738109 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 09:34:11.738109 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 09:34:11.738109 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 09:34:11.738109 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 09:34:11.738109 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 09:34:11.738109 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 27 09:34:11.738109 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 27 09:34:11.738109 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 27 09:34:11.738109 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 27 09:34:11.739151 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 09:34:11.739151 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 09:34:11.739151 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 09:34:11.739151 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 09:34:11.739151 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 09:34:11.739151 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 09:34:11.739151 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 09:34:11.739151 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application with Lock( Oct 27 09:34:11.739151 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 09:34:11.739151 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._enter() Oct 27 09:34:11.739151 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 09:34:11.739151 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 09:34:11.739151 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 09:34:11.739151 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.creator() Oct 27 09:34:11.739151 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 09:34:11.739151 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application created_value = creator( Oct 27 09:34:11.739151 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 27 09:34:11.740019 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 27 09:34:11.740019 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 09:34:11.740019 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application Oct 27 09:34:11.741940 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 315/607] 10.222.0.65 () {56 vars in 1108 bytes} [Thu Oct 27 09:34:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 09:34:11.747682 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92db9b4-281c-4fff-9d54-7fc19e6a0403 None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:34:11.871934 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:34:11.877803 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738580f2-827c-4345-abad-097cdec61edc None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:34:11.880335 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:34:11.912162 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92db9b4-281c-4fff-9d54-7fc19e6a0403 None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:34:11.922788 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83772a6a-c092-414a-acf0-972eb17d82e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:34:11.924033 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83772a6a-c092-414a-acf0-972eb17d82e0 None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:34:11.924415 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83772a6a-c092-414a-acf0-972eb17d82e0 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:34:11.925200 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83772a6a-c092-414a-acf0-972eb17d82e0 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:34:11.935905 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83772a6a-c092-414a-acf0-972eb17d82e0 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:34:11.938302 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83772a6a-c092-414a-acf0-972eb17d82e0 None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:34:11.954395 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c419d53-9549-455a-a7b0-459ea5bb9118 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:34:11.955026 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c419d53-9549-455a-a7b0-459ea5bb9118 None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:34:11.955248 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application [None req-83772a6a-c092-414a-acf0-972eb17d82e0 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 27 09:34:11.955248 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 09:34:11.955248 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 09:34:11.955248 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 09:34:11.955248 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 09:34:11.955248 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 09:34:11.955248 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 09:34:11.955248 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 09:34:11.955248 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 09:34:11.955248 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 09:34:11.955248 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 09:34:11.955248 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 09:34:11.955248 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 27 09:34:11.955248 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 27 09:34:11.955248 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 27 09:34:11.955248 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 27 09:34:11.956195 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 09:34:11.956195 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 09:34:11.956195 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 27 09:34:11.956195 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 27 09:34:11.956195 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 27 09:34:11.956195 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 27 09:34:11.956195 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 09:34:11.956195 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 09:34:11.956195 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 09:34:11.956195 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 09:34:11.956195 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 09:34:11.956195 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application with Lock( Oct 27 09:34:11.956195 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 09:34:11.956195 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._enter() Oct 27 09:34:11.956195 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 09:34:11.956195 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 09:34:11.956195 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 09:34:11.956195 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.creator() Oct 27 09:34:11.957185 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 09:34:11.957185 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application created_value = creator( Oct 27 09:34:11.957185 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 27 09:34:11.957185 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 27 09:34:11.957185 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 27 09:34:11.957185 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 27 09:34:11.957185 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 27 09:34:11.957185 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 27 09:34:11.957185 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 27 09:34:11.957185 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application Oct 27 09:34:11.957718 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c419d53-9549-455a-a7b0-459ea5bb9118 None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:34:11.957718 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c419d53-9549-455a-a7b0-459ea5bb9118 None admin] PATH_INFO: `/v3/domains` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:34:11.957718 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c419d53-9549-455a-a7b0-459ea5bb9118 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 09:34:11.957718 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c419d53-9549-455a-a7b0-459ea5bb9118 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:34:11.957997 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 293/608] 10.222.0.65 () {56 vars in 1117 bytes} [Thu Oct 27 09:34:11 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 27 09:34:11.957997 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83772a6a-c092-414a-acf0-972eb17d82e0 None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:34:11.958116 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c419d53-9549-455a-a7b0-459ea5bb9118 None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:34:11.974080 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 316/609] 10.222.0.65 () {56 vars in 1109 bytes} [Thu Oct 27 09:34:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 09:34:11.975113 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c419d53-9549-455a-a7b0-459ea5bb9118 None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:34:12.100760 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83772a6a-c092-414a-acf0-972eb17d82e0 None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:34:12.115654 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c419d53-9549-455a-a7b0-459ea5bb9118 None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:34:12.151630 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720fa5df-2906-4106-8ba8-fd2d38619ba7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:34:12.152269 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720fa5df-2906-4106-8ba8-fd2d38619ba7 None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:34:12.152553 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720fa5df-2906-4106-8ba8-fd2d38619ba7 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:34:12.153082 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720fa5df-2906-4106-8ba8-fd2d38619ba7 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:34:12.154094 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720fa5df-2906-4106-8ba8-fd2d38619ba7 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:34:12.156047 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720fa5df-2906-4106-8ba8-fd2d38619ba7 None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:34:12.157211 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:34:12.163887 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d955932f-48f0-4d8d-818f-c2f62e33c11c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:34:12.164585 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d955932f-48f0-4d8d-818f-c2f62e33c11c None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:34:12.164934 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d955932f-48f0-4d8d-818f-c2f62e33c11c None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:34:12.165269 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d955932f-48f0-4d8d-818f-c2f62e33c11c None admin] PATH_INFO: `/v3/users` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:34:12.166148 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d955932f-48f0-4d8d-818f-c2f62e33c11c None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 09:34:12.176627 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d955932f-48f0-4d8d-818f-c2f62e33c11c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:34:12.176627 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d955932f-48f0-4d8d-818f-c2f62e33c11c None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:34:12.176816 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application [None req-720fa5df-2906-4106-8ba8-fd2d38619ba7 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 27 09:34:12.176816 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 09:34:12.176816 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 27 09:34:12.176816 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 27 09:34:12.176816 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 27 09:34:12.176816 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 27 09:34:12.176816 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 27 09:34:12.176816 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 27 09:34:12.176816 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 27 09:34:12.176816 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application Oct 27 09:34:12.176816 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 27 09:34:12.176816 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application Oct 27 09:34:12.176816 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 09:34:12.176816 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 09:34:12.176816 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 09:34:12.176816 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 09:34:12.177674 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 09:34:12.177674 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 09:34:12.177674 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 09:34:12.177674 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 09:34:12.177674 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 09:34:12.177674 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 09:34:12.177674 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 09:34:12.177674 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 27 09:34:12.177674 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 27 09:34:12.177674 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 27 09:34:12.177674 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 27 09:34:12.177674 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 09:34:12.177674 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 09:34:12.177674 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 09:34:12.177674 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 09:34:12.177674 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 09:34:12.177674 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 09:34:12.178551 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 09:34:12.178551 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application with Lock( Oct 27 09:34:12.178551 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 09:34:12.178551 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._enter() Oct 27 09:34:12.178551 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 09:34:12.178551 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 09:34:12.178551 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 09:34:12.178551 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.creator() Oct 27 09:34:12.178551 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 09:34:12.178551 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application created_value = creator( Oct 27 09:34:12.178551 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 27 09:34:12.178551 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 27 09:34:12.178551 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 27 09:34:12.178551 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application Oct 27 09:34:12.178551 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 294/610] 10.222.0.65 () {56 vars in 1132 bytes} [Thu Oct 27 09:34:11 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 09:34:12.179336 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720fa5df-2906-4106-8ba8-fd2d38619ba7 None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:34:12.195035 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 317/611] 10.222.0.65 () {56 vars in 1149 bytes} [Thu Oct 27 09:34:11 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 09:34:12.196384 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d955932f-48f0-4d8d-818f-c2f62e33c11c None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:34:12.221317 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:34:12.318453 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720fa5df-2906-4106-8ba8-fd2d38619ba7 None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:34:12.328819 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d955932f-48f0-4d8d-818f-c2f62e33c11c None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:34:12.363497 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3e3dd8-e569-4968-9e3f-5e11d2c1d86b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:34:12.364185 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3e3dd8-e569-4968-9e3f-5e11d2c1d86b None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:34:12.364467 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3e3dd8-e569-4968-9e3f-5e11d2c1d86b None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:34:12.364742 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3e3dd8-e569-4968-9e3f-5e11d2c1d86b None admin] PATH_INFO: `/v3/projects/service` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:34:12.372917 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3e3dd8-e569-4968-9e3f-5e11d2c1d86b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:34:12.373344 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d9ca76-1ae1-4d8a-a099-6fdf6f097e7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:34:12.374082 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d9ca76-1ae1-4d8a-a099-6fdf6f097e7d None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:34:12.374411 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3e3dd8-e569-4968-9e3f-5e11d2c1d86b None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:34:12.374633 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d9ca76-1ae1-4d8a-a099-6fdf6f097e7d None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:34:12.375079 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d9ca76-1ae1-4d8a-a099-6fdf6f097e7d None admin] PATH_INFO: `/v3/services` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:34:12.375922 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d9ca76-1ae1-4d8a-a099-6fdf6f097e7d None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 09:34:12.376624 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d9ca76-1ae1-4d8a-a099-6fdf6f097e7d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:34:12.378727 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d9ca76-1ae1-4d8a-a099-6fdf6f097e7d None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:34:12.390062 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 318/612] 10.222.0.65 () {56 vars in 1126 bytes} [Thu Oct 27 09:34:12 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 09:34:12.390062 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d9ca76-1ae1-4d8a-a099-6fdf6f097e7d None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:34:12.390314 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application [None req-bb3e3dd8-e569-4968-9e3f-5e11d2c1d86b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 27 09:34:12.390314 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 09:34:12.390314 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 09:34:12.390314 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 09:34:12.390314 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 09:34:12.390314 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 09:34:12.390314 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 09:34:12.390314 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 09:34:12.390314 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 09:34:12.390314 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 09:34:12.390314 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 09:34:12.390314 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 09:34:12.390314 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 27 09:34:12.390314 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 27 09:34:12.390314 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 27 09:34:12.391181 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 27 09:34:12.391181 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 09:34:12.391181 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 09:34:12.391181 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 09:34:12.391181 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 09:34:12.391181 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 09:34:12.391181 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 09:34:12.391181 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 09:34:12.391181 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application with Lock( Oct 27 09:34:12.391181 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 09:34:12.391181 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._enter() Oct 27 09:34:12.391181 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 09:34:12.391181 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 09:34:12.391181 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 09:34:12.391181 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.creator() Oct 27 09:34:12.391181 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 09:34:12.391181 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application created_value = creator( Oct 27 09:34:12.392042 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 27 09:34:12.392042 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 27 09:34:12.392042 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 27 09:34:12.392042 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 27 09:34:12.392042 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 27 09:34:12.392042 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 27 09:34:12.392042 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 27 09:34:12.392042 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application Oct 27 09:34:12.393903 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 295/613] 10.222.0.65 () {56 vars in 1111 bytes} [Thu Oct 27 09:34:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 09:34:12.395146 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c52fa5-6f48-4f52-8fa5-c288951fb3f8 None None] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:34:12.395436 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c52fa5-6f48-4f52-8fa5-c288951fb3f8 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:34:12.395715 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c52fa5-6f48-4f52-8fa5-c288951fb3f8 None None] PATH_INFO: `/` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:34:12.397018 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 296/614] 10.222.0.65 () {54 vars in 927 bytes} [Thu Oct 27 09:34:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 09:34:12.397715 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c52fa5-6f48-4f52-8fa5-c288951fb3f8 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:34:12.472762 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:34:12.513604 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:34:12.527226 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d9ca76-1ae1-4d8a-a099-6fdf6f097e7d None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:34:12.530703 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c52fa5-6f48-4f52-8fa5-c288951fb3f8 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:34:12.562610 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d785933d-b7ca-409f-81d0-143689cdbc65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:34:12.563219 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d785933d-b7ca-409f-81d0-143689cdbc65 None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:34:12.563500 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d785933d-b7ca-409f-81d0-143689cdbc65 None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:34:12.563775 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d785933d-b7ca-409f-81d0-143689cdbc65 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:34:12.566042 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e8bec9-bb4d-46bb-94dc-df40a2e8d73f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:34:12.566691 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e8bec9-bb4d-46bb-94dc-df40a2e8d73f None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:34:12.566974 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e8bec9-bb4d-46bb-94dc-df40a2e8d73f None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:34:12.567259 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e8bec9-bb4d-46bb-94dc-df40a2e8d73f None admin] PATH_INFO: `/v3/services` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:34:12.567890 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e8bec9-bb4d-46bb-94dc-df40a2e8d73f None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 09:34:12.568199 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e8bec9-bb4d-46bb-94dc-df40a2e8d73f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:34:12.569566 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e8bec9-bb4d-46bb-94dc-df40a2e8d73f None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:34:12.575207 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 297/615] 10.222.0.65 () {56 vars in 1126 bytes} [Thu Oct 27 09:34:12 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 09:34:12.575994 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e8bec9-bb4d-46bb-94dc-df40a2e8d73f None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:34:12.648483 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d785933d-b7ca-409f-81d0-143689cdbc65 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:34:12.649969 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d785933d-b7ca-409f-81d0-143689cdbc65 None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:34:12.706026 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e8bec9-bb4d-46bb-94dc-df40a2e8d73f None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:34:12.718923 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:34:12.748733 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6982cf-fe1c-444b-9858-f94252f323d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:34:12.749264 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6982cf-fe1c-444b-9858-f94252f323d0 None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:34:12.750255 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6982cf-fe1c-444b-9858-f94252f323d0 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:34:12.750474 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6982cf-fe1c-444b-9858-f94252f323d0 None admin] PATH_INFO: `/v3/projects` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:34:12.751220 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6982cf-fe1c-444b-9858-f94252f323d0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 09:34:12.751525 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6982cf-fe1c-444b-9858-f94252f323d0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:34:12.752999 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6982cf-fe1c-444b-9858-f94252f323d0 None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:34:12.768292 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 298/616] 10.222.0.65 () {56 vars in 1148 bytes} [Thu Oct 27 09:34:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 09:34:12.769791 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a595a26a-5d85-4afe-bd85-e1daaef4074a None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:34:12.770269 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a595a26a-5d85-4afe-bd85-e1daaef4074a None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:34:12.770576 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a595a26a-5d85-4afe-bd85-e1daaef4074a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:34:12.778099 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 319/617] 10.222.0.65 () {58 vars in 1282 bytes} [Thu Oct 27 09:34:12 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 27 09:34:12.779673 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da6a6dc-1594-438f-9efd-c5665f604ce4 None None] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:34:12.780251 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da6a6dc-1594-438f-9efd-c5665f604ce4 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:34:12.780533 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da6a6dc-1594-438f-9efd-c5665f604ce4 None None] PATH_INFO: `/` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:34:12.781802 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 320/618] 10.222.0.65 () {54 vars in 927 bytes} [Thu Oct 27 09:34:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 09:34:12.782618 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da6a6dc-1594-438f-9efd-c5665f604ce4 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:34:12.791803 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-a595a26a-5d85-4afe-bd85-e1daaef4074a None None] MFA Rules not processed for user `b5065084bf664b99bdeac46067cb0f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:34:12.793519 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-a595a26a-5d85-4afe-bd85-e1daaef4074a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:34:12.797808 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:34:12.874695 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 299/619] 10.222.0.65 () {58 vars in 1024 bytes} [Thu Oct 27 09:34:12 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 27 09:34:12.876090 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a595a26a-5d85-4afe-bd85-e1daaef4074a None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:34:12.906458 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da6a6dc-1594-438f-9efd-c5665f604ce4 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:34:12.948236 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54164173-8a76-49a6-8d0b-2b147a371880 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:34:12.948903 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54164173-8a76-49a6-8d0b-2b147a371880 None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:34:12.949189 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54164173-8a76-49a6-8d0b-2b147a371880 None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:34:12.949540 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54164173-8a76-49a6-8d0b-2b147a371880 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:34:12.950317 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54164173-8a76-49a6-8d0b-2b147a371880 None admin] RBAC: Adding query filter params (role.id=6ad17b9f9dea4b66ab2da3677d7e715d, scope.project.id=dc2e3a7a1bcc480891c0b433291c00b1, user.id=01e32fc35c8b467e9604b325cf1527aa) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 09:34:12.950676 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54164173-8a76-49a6-8d0b-2b147a371880 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:34:12.952127 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54164173-8a76-49a6-8d0b-2b147a371880 None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:34:12.959036 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 321/620] 10.222.0.65 () {56 vars in 1374 bytes} [Thu Oct 27 09:34:12 2022] GET /identity/v3/role_assignments?user.id=01e32fc35c8b467e9604b325cf1527aa&scope.project.id=dc2e3a7a1bcc480891c0b433291c00b1&role.id=6ad17b9f9dea4b66ab2da3677d7e715d => generated 608 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 09:34:12.960371 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1ffb96-28d4-43bd-9aaa-8dcfe1ead5f9 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:34:12.960755 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1ffb96-28d4-43bd-9aaa-8dcfe1ead5f9 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:34:12.961035 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1ffb96-28d4-43bd-9aaa-8dcfe1ead5f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:34:12.982401 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-7b1ffb96-28d4-43bd-9aaa-8dcfe1ead5f9 None None] MFA Rules not processed for user `b5065084bf664b99bdeac46067cb0f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:34:12.983675 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-7b1ffb96-28d4-43bd-9aaa-8dcfe1ead5f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:34:13.000037 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:34:13.044127 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a595a26a-5d85-4afe-bd85-e1daaef4074a None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:34:13.062678 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 322/621] 10.222.0.65 () {58 vars in 1024 bytes} [Thu Oct 27 09:34:12 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 27 09:34:13.089491 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381c017e-698d-453c-834e-2e4be3de91fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:34:13.090397 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381c017e-698d-453c-834e-2e4be3de91fa None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:34:13.090926 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381c017e-698d-453c-834e-2e4be3de91fa None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:34:13.091367 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381c017e-698d-453c-834e-2e4be3de91fa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:34:13.101899 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:34:13.105764 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381c017e-698d-453c-834e-2e4be3de91fa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:34:13.107580 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381c017e-698d-453c-834e-2e4be3de91fa None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:34:13.126153 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application [None req-381c017e-698d-453c-834e-2e4be3de91fa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 09:34:13.126153 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 09:34:13.126153 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 09:34:13.126153 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 09:34:13.126153 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 09:34:13.126153 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 09:34:13.126153 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 09:34:13.126153 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 09:34:13.126153 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 09:34:13.126153 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 09:34:13.126153 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 09:34:13.126153 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 09:34:13.126153 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 27 09:34:13.126153 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 27 09:34:13.126153 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 27 09:34:13.126153 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 27 09:34:13.127546 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 09:34:13.127546 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 09:34:13.127546 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 09:34:13.127546 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 09:34:13.127546 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 09:34:13.127546 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 09:34:13.127546 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 09:34:13.127546 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application with Lock( Oct 27 09:34:13.127546 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 09:34:13.127546 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._enter() Oct 27 09:34:13.127546 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 09:34:13.127546 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 09:34:13.127546 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 09:34:13.127546 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.creator() Oct 27 09:34:13.127546 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 09:34:13.127546 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application created_value = creator( Oct 27 09:34:13.127546 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 27 09:34:13.128603 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 27 09:34:13.128603 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 09:34:13.128603 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application Oct 27 09:34:13.135211 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 300/622] 10.222.0.65 () {56 vars in 1108 bytes} [Thu Oct 27 09:34:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 09:34:13.137598 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1ffb96-28d4-43bd-9aaa-8dcfe1ead5f9 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:34:13.278086 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1ffb96-28d4-43bd-9aaa-8dcfe1ead5f9 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:34:13.315671 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba41c0e8-5f3c-416c-8e34-a0631c06ea90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:34:13.318560 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba41c0e8-5f3c-416c-8e34-a0631c06ea90 None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:34:13.318560 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba41c0e8-5f3c-416c-8e34-a0631c06ea90 None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:34:13.318560 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba41c0e8-5f3c-416c-8e34-a0631c06ea90 None admin] PATH_INFO: `/v3/domains` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:34:13.318560 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba41c0e8-5f3c-416c-8e34-a0631c06ea90 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 09:34:13.318560 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba41c0e8-5f3c-416c-8e34-a0631c06ea90 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:34:13.319202 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba41c0e8-5f3c-416c-8e34-a0631c06ea90 None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:34:13.332043 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 323/623] 10.222.0.65 () {56 vars in 1109 bytes} [Thu Oct 27 09:34:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 09:34:13.335657 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381c017e-698d-453c-834e-2e4be3de91fa None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:34:13.338895 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba41c0e8-5f3c-416c-8e34-a0631c06ea90 None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:34:13.350488 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:34:13.508572 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381c017e-698d-453c-834e-2e4be3de91fa None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:34:13.561610 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba41c0e8-5f3c-416c-8e34-a0631c06ea90 None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:34:13.593342 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76dd45da-fd19-4f25-87eb-f80ba086037e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:34:13.593992 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dd45da-fd19-4f25-87eb-f80ba086037e None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:34:13.594277 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dd45da-fd19-4f25-87eb-f80ba086037e None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:34:13.594593 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dd45da-fd19-4f25-87eb-f80ba086037e None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:34:13.595263 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76dd45da-fd19-4f25-87eb-f80ba086037e None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:34:13.596781 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76dd45da-fd19-4f25-87eb-f80ba086037e None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:34:13.607280 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application [None req-76dd45da-fd19-4f25-87eb-f80ba086037e None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 27 09:34:13.607280 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 09:34:13.607280 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 27 09:34:13.607280 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 27 09:34:13.607280 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 27 09:34:13.607280 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 27 09:34:13.607280 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 27 09:34:13.607280 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 27 09:34:13.607280 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 27 09:34:13.607280 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application Oct 27 09:34:13.607280 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 27 09:34:13.607280 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application Oct 27 09:34:13.607280 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 09:34:13.607280 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 09:34:13.607280 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 09:34:13.607280 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 09:34:13.607280 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 09:34:13.608305 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 09:34:13.608305 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 09:34:13.608305 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 09:34:13.608305 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 09:34:13.608305 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 09:34:13.608305 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 09:34:13.608305 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 27 09:34:13.608305 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 27 09:34:13.608305 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 27 09:34:13.608305 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 27 09:34:13.608305 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 09:34:13.608305 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 09:34:13.608305 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 09:34:13.608305 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 09:34:13.608305 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 09:34:13.608305 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 09:34:13.609140 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 09:34:13.609140 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application with Lock( Oct 27 09:34:13.609140 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 09:34:13.609140 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._enter() Oct 27 09:34:13.609140 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 09:34:13.609140 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 09:34:13.609140 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 09:34:13.609140 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.creator() Oct 27 09:34:13.609140 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 09:34:13.609140 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application created_value = creator( Oct 27 09:34:13.609140 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 27 09:34:13.609140 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 27 09:34:13.609140 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 27 09:34:13.609140 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application Oct 27 09:34:13.609140 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 301/624] 10.222.0.65 () {56 vars in 1129 bytes} [Thu Oct 27 09:34:13 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 09:34:13.609896 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76dd45da-fd19-4f25-87eb-f80ba086037e None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:34:13.621129 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74e0e9b-0df7-437a-8fff-4c754f49fc07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:34:13.622108 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74e0e9b-0df7-437a-8fff-4c754f49fc07 None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:34:13.622614 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74e0e9b-0df7-437a-8fff-4c754f49fc07 None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:34:13.623106 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74e0e9b-0df7-437a-8fff-4c754f49fc07 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:34:13.631355 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74e0e9b-0df7-437a-8fff-4c754f49fc07 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:34:13.633405 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74e0e9b-0df7-437a-8fff-4c754f49fc07 None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:34:13.647970 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application [None req-e74e0e9b-0df7-437a-8fff-4c754f49fc07 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 27 09:34:13.647970 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 09:34:13.647970 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 09:34:13.647970 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 09:34:13.647970 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 09:34:13.647970 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 09:34:13.647970 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 09:34:13.647970 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 09:34:13.647970 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 09:34:13.647970 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 09:34:13.647970 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 09:34:13.647970 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 09:34:13.647970 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 27 09:34:13.647970 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 27 09:34:13.647970 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 27 09:34:13.648890 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 27 09:34:13.648890 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 09:34:13.648890 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 09:34:13.648890 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 09:34:13.648890 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 09:34:13.648890 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 09:34:13.648890 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 09:34:13.648890 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 09:34:13.648890 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application with Lock( Oct 27 09:34:13.648890 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 09:34:13.648890 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._enter() Oct 27 09:34:13.648890 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 09:34:13.648890 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 09:34:13.648890 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 09:34:13.648890 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.creator() Oct 27 09:34:13.648890 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 09:34:13.648890 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application created_value = creator( Oct 27 09:34:13.649763 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 27 09:34:13.649763 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 27 09:34:13.649763 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 27 09:34:13.649763 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 27 09:34:13.649763 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 27 09:34:13.649763 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 27 09:34:13.649763 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 27 09:34:13.649763 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application Oct 27 09:34:13.652438 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 324/625] 10.222.0.65 () {56 vars in 1111 bytes} [Thu Oct 27 09:34:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 314 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 09:34:13.653513 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74e0e9b-0df7-437a-8fff-4c754f49fc07 None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:34:13.676230 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:34:13.726277 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:34:13.726903 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76dd45da-fd19-4f25-87eb-f80ba086037e None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:34:13.765803 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a071ece6-f101-4ab2-9b2e-776627e95b20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:34:13.766292 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74e0e9b-0df7-437a-8fff-4c754f49fc07 None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:34:13.766470 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a071ece6-f101-4ab2-9b2e-776627e95b20 None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:34:13.766774 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a071ece6-f101-4ab2-9b2e-776627e95b20 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:34:13.767056 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a071ece6-f101-4ab2-9b2e-776627e95b20 None admin] PATH_INFO: `/v3/services/network` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:34:13.767642 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a071ece6-f101-4ab2-9b2e-776627e95b20 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:34:13.769583 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a071ece6-f101-4ab2-9b2e-776627e95b20 None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:34:13.780277 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application [None req-a071ece6-f101-4ab2-9b2e-776627e95b20 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Oct 27 09:34:13.780277 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 09:34:13.780277 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 27 09:34:13.780277 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 27 09:34:13.780277 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 27 09:34:13.780277 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 27 09:34:13.780277 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 27 09:34:13.780277 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 27 09:34:13.780277 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 27 09:34:13.780277 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application Oct 27 09:34:13.780277 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 27 09:34:13.780277 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application Oct 27 09:34:13.780277 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 09:34:13.780277 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 09:34:13.780277 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 09:34:13.780277 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 09:34:13.780277 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 09:34:13.781311 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 09:34:13.781311 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 09:34:13.781311 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 09:34:13.781311 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 09:34:13.781311 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 09:34:13.781311 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 09:34:13.781311 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 27 09:34:13.781311 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 27 09:34:13.781311 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 27 09:34:13.781311 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 27 09:34:13.781311 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 09:34:13.781311 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 09:34:13.781311 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 09:34:13.781311 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 09:34:13.781311 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 09:34:13.781311 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 09:34:13.782132 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 09:34:13.782132 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application with Lock( Oct 27 09:34:13.782132 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 09:34:13.782132 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._enter() Oct 27 09:34:13.782132 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 09:34:13.782132 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 09:34:13.782132 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 09:34:13.782132 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.creator() Oct 27 09:34:13.782132 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 09:34:13.782132 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application created_value = creator( Oct 27 09:34:13.782132 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 27 09:34:13.782132 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 27 09:34:13.782132 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 27 09:34:13.782132 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application Oct 27 09:34:13.786372 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 302/626] 10.222.0.65 () {56 vars in 1111 bytes} [Thu Oct 27 09:34:13 2022] GET /identity/v3/services/network => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 09:34:13.787341 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a071ece6-f101-4ab2-9b2e-776627e95b20 None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:34:13.809537 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85e1d7a-0f22-4dc4-afec-a718e111f087 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:34:13.810593 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85e1d7a-0f22-4dc4-afec-a718e111f087 None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:34:13.811094 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85e1d7a-0f22-4dc4-afec-a718e111f087 None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:34:13.811577 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85e1d7a-0f22-4dc4-afec-a718e111f087 None admin] PATH_INFO: `/v3/services` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:34:13.812445 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85e1d7a-0f22-4dc4-afec-a718e111f087 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 09:34:13.812989 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85e1d7a-0f22-4dc4-afec-a718e111f087 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:34:13.814632 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85e1d7a-0f22-4dc4-afec-a718e111f087 None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:34:13.824957 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 325/627] 10.222.0.65 () {56 vars in 1124 bytes} [Thu Oct 27 09:34:13 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 09:34:13.826250 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85e1d7a-0f22-4dc4-afec-a718e111f087 None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:34:13.901801 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a071ece6-f101-4ab2-9b2e-776627e95b20 None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:34:13.924111 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:34:13.940312 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d93a0bd-0046-4068-b138-a88a48be909f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:34:13.940928 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d93a0bd-0046-4068-b138-a88a48be909f None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:34:13.941213 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d93a0bd-0046-4068-b138-a88a48be909f None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:34:13.941490 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d93a0bd-0046-4068-b138-a88a48be909f None admin] PATH_INFO: `/v3/projects` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:34:13.942194 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d93a0bd-0046-4068-b138-a88a48be909f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 09:34:13.942586 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d93a0bd-0046-4068-b138-a88a48be909f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:34:13.943533 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85e1d7a-0f22-4dc4-afec-a718e111f087 None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:34:13.944173 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d93a0bd-0046-4068-b138-a88a48be909f None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:34:13.958431 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 303/628] 10.222.0.65 () {56 vars in 1148 bytes} [Thu Oct 27 09:34:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 09:34:13.959452 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d93a0bd-0046-4068-b138-a88a48be909f None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:34:13.979072 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:34:13.982619 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc1962e-f581-4db0-85b5-8a2e37155d8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:34:13.983229 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc1962e-f581-4db0-85b5-8a2e37155d8f None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:34:13.983615 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc1962e-f581-4db0-85b5-8a2e37155d8f None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:34:13.983893 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc1962e-f581-4db0-85b5-8a2e37155d8f None admin] PATH_INFO: `/v3/services` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:34:13.984520 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc1962e-f581-4db0-85b5-8a2e37155d8f None admin] RBAC: Adding query filter params (name=network) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 09:34:13.984819 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc1962e-f581-4db0-85b5-8a2e37155d8f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:34:13.986278 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc1962e-f581-4db0-85b5-8a2e37155d8f None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:34:13.991935 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 326/629] 10.222.0.65 () {56 vars in 1112 bytes} [Thu Oct 27 09:34:13 2022] GET /identity/v3/services?name=network => generated 124 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 09:34:13.992759 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc1962e-f581-4db0-85b5-8a2e37155d8f None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:34:14.080518 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d93a0bd-0046-4068-b138-a88a48be909f None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:34:14.121962 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2124125-a6b8-43d8-b1a7-d7b4f9242cc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:34:14.122665 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2124125-a6b8-43d8-b1a7-d7b4f9242cc8 None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:34:14.122944 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2124125-a6b8-43d8-b1a7-d7b4f9242cc8 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:34:14.123211 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2124125-a6b8-43d8-b1a7-d7b4f9242cc8 None admin] PATH_INFO: `/v3/services` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:34:14.123886 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2124125-a6b8-43d8-b1a7-d7b4f9242cc8 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 09:34:14.124184 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2124125-a6b8-43d8-b1a7-d7b4f9242cc8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:34:14.125600 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2124125-a6b8-43d8-b1a7-d7b4f9242cc8 None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:34:14.135955 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 304/630] 10.222.0.65 () {56 vars in 1124 bytes} [Thu Oct 27 09:34:13 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 09:34:14.136980 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2124125-a6b8-43d8-b1a7-d7b4f9242cc8 None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:34:14.158496 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc1962e-f581-4db0-85b5-8a2e37155d8f None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:34:14.201169 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:34:14.205124 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbe16ff-f461-4795-b043-2e08bdc8e8af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:34:14.205866 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbe16ff-f461-4795-b043-2e08bdc8e8af None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:34:14.206397 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbe16ff-f461-4795-b043-2e08bdc8e8af None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:34:14.206760 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbe16ff-f461-4795-b043-2e08bdc8e8af None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:34:14.207825 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbe16ff-f461-4795-b043-2e08bdc8e8af None admin] RBAC: Adding query filter params (role.id=8d728ccbaa534a949df6711b47151356, scope.project.id=dc2e3a7a1bcc480891c0b433291c00b1, user.id=c18a92a796934277ad64a51ef3f7bb23) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 09:34:14.211984 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbe16ff-f461-4795-b043-2e08bdc8e8af None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:34:14.211984 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbe16ff-f461-4795-b043-2e08bdc8e8af None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:34:14.219442 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 327/631] 10.222.0.65 () {56 vars in 1374 bytes} [Thu Oct 27 09:34:13 2022] GET /identity/v3/role_assignments?user.id=c18a92a796934277ad64a51ef3f7bb23&scope.project.id=dc2e3a7a1bcc480891c0b433291c00b1&role.id=8d728ccbaa534a949df6711b47151356 => generated 608 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 09:34:14.220445 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbe16ff-f461-4795-b043-2e08bdc8e8af None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:34:14.285664 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2124125-a6b8-43d8-b1a7-d7b4f9242cc8 None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:34:14.352756 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d9102d-d04c-4db4-8859-4575aef0bab5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:34:14.354130 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d9102d-d04c-4db4-8859-4575aef0bab5 None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:34:14.354471 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d9102d-d04c-4db4-8859-4575aef0bab5 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:34:14.354772 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d9102d-d04c-4db4-8859-4575aef0bab5 None admin] PATH_INFO: `/v3/services` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:34:14.355424 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d9102d-d04c-4db4-8859-4575aef0bab5 None admin] RBAC: Adding query filter params (type=network) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 09:34:14.355726 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d9102d-d04c-4db4-8859-4575aef0bab5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:34:14.357127 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d9102d-d04c-4db4-8859-4575aef0bab5 None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:34:14.385272 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 305/632] 10.222.0.65 () {56 vars in 1112 bytes} [Thu Oct 27 09:34:14 2022] GET /identity/v3/services?type=network => generated 350 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 09:34:14.392252 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d9102d-d04c-4db4-8859-4575aef0bab5 None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:34:14.394052 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:34:14.457144 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbe16ff-f461-4795-b043-2e08bdc8e8af None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:34:14.501200 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836ac2f6-6181-4b26-b88b-ebaac0f9b071 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:34:14.501811 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836ac2f6-6181-4b26-b88b-ebaac0f9b071 None admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:34:14.502085 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836ac2f6-6181-4b26-b88b-ebaac0f9b071 None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:34:14.502354 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836ac2f6-6181-4b26-b88b-ebaac0f9b071 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:34:14.503146 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836ac2f6-6181-4b26-b88b-ebaac0f9b071 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:34:14.504638 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836ac2f6-6181-4b26-b88b-ebaac0f9b071 None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:34:14.531407 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d9102d-d04c-4db4-8859-4575aef0bab5 None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:34:14.543298 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:34:14.575688 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03573da-5686-4f8a-84af-e186e7f7e897 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:34:14.576310 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03573da-5686-4f8a-84af-e186e7f7e897 None admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:34:14.576593 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03573da-5686-4f8a-84af-e186e7f7e897 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:34:14.576914 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03573da-5686-4f8a-84af-e186e7f7e897 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:34:14.577640 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03573da-5686-4f8a-84af-e186e7f7e897 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:34:14.579090 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03573da-5686-4f8a-84af-e186e7f7e897 None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:34:14.705751 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 328/633] 10.222.0.65 () {60 vars in 1144 bytes} [Thu Oct 27 09:34:14 2022] POST /identity/v3/endpoints => generated 346 bytes in 481 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 09:34:14.706292 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 306/634] 10.222.0.65 () {60 vars in 1144 bytes} [Thu Oct 27 09:34:14 2022] POST /identity/v3/endpoints => generated 337 bytes in 314 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 09:34:15.009593 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4e6069-1acd-4dda-a362-f378a7108452 None None] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:34:15.009826 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4e6069-1acd-4dda-a362-f378a7108452 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:34:15.010076 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4e6069-1acd-4dda-a362-f378a7108452 None None] PATH_INFO: `/` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:34:15.011930 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 329/635] 10.222.0.65 () {54 vars in 927 bytes} [Thu Oct 27 09:34:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 09:34:15.017853 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca4bd2c-88bd-4d75-a8bd-640549cc7a83 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:34:15.018354 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca4bd2c-88bd-4d75-a8bd-640549cc7a83 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:34:15.018430 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca4bd2c-88bd-4d75-a8bd-640549cc7a83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:34:15.039231 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-fca4bd2c-88bd-4d75-a8bd-640549cc7a83 None None] MFA Rules not processed for user `b5065084bf664b99bdeac46067cb0f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:34:15.040375 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-fca4bd2c-88bd-4d75-a8bd-640549cc7a83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:34:15.127896 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 307/636] 10.222.0.65 () {58 vars in 1024 bytes} [Thu Oct 27 09:34:15 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 27 09:34:15.413809 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4e6069-1acd-4dda-a362-f378a7108452 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:34:15.528906 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4e6069-1acd-4dda-a362-f378a7108452 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:34:15.551293 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:34:15.565423 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec990ef-185f-4f86-9126-4c088a846047 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:34:15.566310 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec990ef-185f-4f86-9126-4c088a846047 None admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:34:15.566798 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec990ef-185f-4f86-9126-4c088a846047 None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:34:15.567272 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec990ef-185f-4f86-9126-4c088a846047 None admin] PATH_INFO: `/v3/services` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:34:15.568113 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec990ef-185f-4f86-9126-4c088a846047 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:34:15.569676 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec990ef-185f-4f86-9126-4c088a846047 None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:34:15.624881 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da833ed-f26c-490e-a530-a5b0c30a16aa None None] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:34:15.625249 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da833ed-f26c-490e-a530-a5b0c30a16aa None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:34:15.625600 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da833ed-f26c-490e-a530-a5b0c30a16aa None None] PATH_INFO: `/` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:34:15.627206 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 308/637] 10.222.0.65 () {54 vars in 927 bytes} [Thu Oct 27 09:34:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 09:34:15.632028 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d538578c-b89c-4920-968e-f194d50641d5 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:34:15.632316 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d538578c-b89c-4920-968e-f194d50641d5 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:34:15.632595 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d538578c-b89c-4920-968e-f194d50641d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:34:15.648678 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 330/638] 10.222.0.65 () {60 vars in 1141 bytes} [Thu Oct 27 09:34:15 2022] POST /identity/v3/services => generated 269 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 09:34:15.655924 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-d538578c-b89c-4920-968e-f194d50641d5 None None] MFA Rules not processed for user `b5065084bf664b99bdeac46067cb0f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:34:15.657277 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-d538578c-b89c-4920-968e-f194d50641d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:34:15.758862 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 309/639] 10.222.0.65 () {58 vars in 1024 bytes} [Thu Oct 27 09:34:15 2022] POST /identity/v3/auth/tokens => generated 1271 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 27 09:34:16.028342 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec990ef-185f-4f86-9126-4c088a846047 None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:34:16.139126 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec990ef-185f-4f86-9126-4c088a846047 None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:34:16.175643 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d96f49-304b-4400-abe3-03cbdf396e44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:34:16.176278 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d96f49-304b-4400-abe3-03cbdf396e44 None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:34:16.176560 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d96f49-304b-4400-abe3-03cbdf396e44 None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:34:16.176835 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d96f49-304b-4400-abe3-03cbdf396e44 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:34:16.177422 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d96f49-304b-4400-abe3-03cbdf396e44 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:34:16.178817 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d96f49-304b-4400-abe3-03cbdf396e44 None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:34:16.188878 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application [None req-62d96f49-304b-4400-abe3-03cbdf396e44 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 27 09:34:16.188878 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 09:34:16.188878 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 27 09:34:16.188878 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 27 09:34:16.188878 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 27 09:34:16.188878 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 27 09:34:16.188878 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 27 09:34:16.188878 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 27 09:34:16.188878 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 27 09:34:16.188878 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application Oct 27 09:34:16.188878 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 27 09:34:16.188878 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application Oct 27 09:34:16.188878 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 09:34:16.188878 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 09:34:16.188878 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 09:34:16.188878 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 09:34:16.188878 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 09:34:16.189916 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 09:34:16.189916 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 09:34:16.189916 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 09:34:16.189916 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 09:34:16.189916 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 09:34:16.189916 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 09:34:16.189916 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 27 09:34:16.189916 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 27 09:34:16.189916 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 27 09:34:16.189916 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 27 09:34:16.189916 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 09:34:16.189916 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 09:34:16.189916 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 09:34:16.189916 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 09:34:16.189916 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 09:34:16.189916 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 09:34:16.190787 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 09:34:16.190787 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application with Lock( Oct 27 09:34:16.190787 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 09:34:16.190787 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._enter() Oct 27 09:34:16.190787 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 09:34:16.190787 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 09:34:16.190787 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 09:34:16.190787 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.creator() Oct 27 09:34:16.190787 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 09:34:16.190787 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application created_value = creator( Oct 27 09:34:16.190787 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 27 09:34:16.190787 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 27 09:34:16.190787 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 27 09:34:16.190787 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application Oct 27 09:34:16.190787 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 331/640] 10.222.0.65 () {56 vars in 1126 bytes} [Thu Oct 27 09:34:16 2022] GET /identity/v3/services/object-store => generated 93 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 09:34:16.196207 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d538578c-b89c-4920-968e-f194d50641d5 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:34:16.215877 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:34:16.303100 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d538578c-b89c-4920-968e-f194d50641d5 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:34:16.340522 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17538de-0803-48ab-8875-307bf4769cf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:34:16.341138 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17538de-0803-48ab-8875-307bf4769cf1 None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:34:16.341419 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17538de-0803-48ab-8875-307bf4769cf1 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:34:16.341698 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17538de-0803-48ab-8875-307bf4769cf1 None admin] PATH_INFO: `/v3/services` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:34:16.342339 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17538de-0803-48ab-8875-307bf4769cf1 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 09:34:16.342685 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17538de-0803-48ab-8875-307bf4769cf1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:34:16.344156 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17538de-0803-48ab-8875-307bf4769cf1 None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:34:16.349406 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 310/641] 10.222.0.65 () {56 vars in 1122 bytes} [Thu Oct 27 09:34:16 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 09:34:16.355783 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d96f49-304b-4400-abe3-03cbdf396e44 None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:34:16.404324 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:34:16.469317 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d96f49-304b-4400-abe3-03cbdf396e44 None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:34:16.506321 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8769dc-ae99-405b-b50d-358c8514ce44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:34:16.506967 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8769dc-ae99-405b-b50d-358c8514ce44 None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:34:16.507251 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8769dc-ae99-405b-b50d-358c8514ce44 None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:34:16.507527 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8769dc-ae99-405b-b50d-358c8514ce44 None admin] PATH_INFO: `/v3/services` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:34:16.508161 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8769dc-ae99-405b-b50d-358c8514ce44 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 09:34:16.508463 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8769dc-ae99-405b-b50d-358c8514ce44 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:34:16.510231 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8769dc-ae99-405b-b50d-358c8514ce44 None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:34:16.515307 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 332/642] 10.222.0.65 () {56 vars in 1122 bytes} [Thu Oct 27 09:34:16 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 09:34:16.687022 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e548f1-9b5e-4d17-b8c0-bb9deef6d1a1 None None] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:34:16.687436 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e548f1-9b5e-4d17-b8c0-bb9deef6d1a1 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:34:16.687619 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e548f1-9b5e-4d17-b8c0-bb9deef6d1a1 None None] PATH_INFO: `/` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:34:16.689178 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 311/643] 10.222.0.65 () {54 vars in 927 bytes} [Thu Oct 27 09:34:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 09:34:16.694614 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4415f6-8708-4b07-b0c0-1b5cd0f7b7b6 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:34:16.694902 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4415f6-8708-4b07-b0c0-1b5cd0f7b7b6 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:34:16.695173 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4415f6-8708-4b07-b0c0-1b5cd0f7b7b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:34:16.714897 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-fe4415f6-8708-4b07-b0c0-1b5cd0f7b7b6 None None] MFA Rules not processed for user `b5065084bf664b99bdeac46067cb0f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:34:16.716429 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-fe4415f6-8708-4b07-b0c0-1b5cd0f7b7b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:34:16.798949 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 333/644] 10.222.0.65 () {58 vars in 1024 bytes} [Thu Oct 27 09:34:16 2022] POST /identity/v3/auth/tokens => generated 1271 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 27 09:34:17.069581 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e548f1-9b5e-4d17-b8c0-bb9deef6d1a1 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:34:17.154015 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:34:17.175188 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e548f1-9b5e-4d17-b8c0-bb9deef6d1a1 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:34:17.213073 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6680a442-e64b-4c8e-a6be-09be5944e2d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:34:17.213829 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6680a442-e64b-4c8e-a6be-09be5944e2d6 None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:34:17.214073 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6680a442-e64b-4c8e-a6be-09be5944e2d6 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:34:17.214264 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6680a442-e64b-4c8e-a6be-09be5944e2d6 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:34:17.226954 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6680a442-e64b-4c8e-a6be-09be5944e2d6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 09:34:17.232718 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application [None req-6680a442-e64b-4c8e-a6be-09be5944e2d6 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 27 09:34:17.232718 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 09:34:17.232718 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 09:34:17.232718 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 09:34:17.232718 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 09:34:17.232718 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 09:34:17.232718 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 09:34:17.232718 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 09:34:17.232718 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 09:34:17.232718 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 09:34:17.232718 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 09:34:17.232718 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 09:34:17.232718 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 27 09:34:17.232718 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 27 09:34:17.232718 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 27 09:34:17.232718 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 27 09:34:17.233702 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 27 09:34:17.233702 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 27 09:34:17.233702 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 27 09:34:17.233702 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 27 09:34:17.233702 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 09:34:17.233702 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 09:34:17.233702 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 09:34:17.233702 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 09:34:17.233702 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 09:34:17.233702 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 09:34:17.233702 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 09:34:17.233702 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application with Lock( Oct 27 09:34:17.233702 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 09:34:17.233702 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._enter() Oct 27 09:34:17.233702 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 09:34:17.233702 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 09:34:17.234589 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 09:34:17.234589 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.creator() Oct 27 09:34:17.234589 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 09:34:17.234589 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application created_value = creator( Oct 27 09:34:17.234589 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 27 09:34:17.234589 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 27 09:34:17.234589 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 27 09:34:17.234589 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 27 09:34:17.234589 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 27 09:34:17.234589 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 27 09:34:17.234589 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 27 09:34:17.234589 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application Oct 27 09:34:17.234589 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 312/645] 10.222.0.65 () {56 vars in 1120 bytes} [Thu Oct 27 09:34:17 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 09:34:17.240277 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4415f6-8708-4b07-b0c0-1b5cd0f7b7b6 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:34:17.276753 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:34:17.345171 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f182ab09-67d1-43b4-9d66-4ecaee30be88 None None] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:34:17.345477 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f182ab09-67d1-43b4-9d66-4ecaee30be88 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:34:17.345637 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f182ab09-67d1-43b4-9d66-4ecaee30be88 None None] PATH_INFO: `/` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:34:17.347295 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 313/646] 10.222.0.65 () {54 vars in 927 bytes} [Thu Oct 27 09:34:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 09:34:17.347495 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4415f6-8708-4b07-b0c0-1b5cd0f7b7b6 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:34:17.352486 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca21fe2-7836-4d15-bad2-c0315eb4b211 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:34:17.352759 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca21fe2-7836-4d15-bad2-c0315eb4b211 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:34:17.353136 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca21fe2-7836-4d15-bad2-c0315eb4b211 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:34:17.382609 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-2ca21fe2-7836-4d15-bad2-c0315eb4b211 None None] MFA Rules not processed for user `b5065084bf664b99bdeac46067cb0f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:34:17.384943 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-2ca21fe2-7836-4d15-bad2-c0315eb4b211 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:34:17.390396 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacd6b47-451d-4603-ad74-23b668715221 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:34:17.391123 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacd6b47-451d-4603-ad74-23b668715221 None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:34:17.391515 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacd6b47-451d-4603-ad74-23b668715221 None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:34:17.391848 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacd6b47-451d-4603-ad74-23b668715221 None admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:34:17.392583 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bacd6b47-451d-4603-ad74-23b668715221 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 09:34:17.392950 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bacd6b47-451d-4603-ad74-23b668715221 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:34:17.396023 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bacd6b47-451d-4603-ad74-23b668715221 None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:34:17.406017 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 334/647] 10.222.0.65 () {56 vars in 1115 bytes} [Thu Oct 27 09:34:17 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 09:34:17.411157 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacd6b47-451d-4603-ad74-23b668715221 None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:34:17.474761 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 314/648] 10.222.0.65 () {58 vars in 1024 bytes} [Thu Oct 27 09:34:17 2022] POST /identity/v3/auth/tokens => generated 1271 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 27 09:34:17.517329 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:34:17.523215 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacd6b47-451d-4603-ad74-23b668715221 None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:34:17.560047 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cc3ba5-c802-427d-86c7-ae1ef0561a35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:34:17.560680 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cc3ba5-c802-427d-86c7-ae1ef0561a35 None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:34:17.560962 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cc3ba5-c802-427d-86c7-ae1ef0561a35 None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:34:17.561237 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cc3ba5-c802-427d-86c7-ae1ef0561a35 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:34:17.573829 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0cc3ba5-c802-427d-86c7-ae1ef0561a35 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:34:17.575326 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0cc3ba5-c802-427d-86c7-ae1ef0561a35 None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:34:17.591145 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application [None req-f0cc3ba5-c802-427d-86c7-ae1ef0561a35 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 09:34:17.591145 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 09:34:17.591145 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 09:34:17.591145 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 09:34:17.591145 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 09:34:17.591145 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 09:34:17.591145 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 09:34:17.591145 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 09:34:17.591145 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 09:34:17.591145 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 09:34:17.591145 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 09:34:17.591145 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 09:34:17.591145 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 27 09:34:17.591145 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 27 09:34:17.591145 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 27 09:34:17.591145 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 27 09:34:17.595408 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 09:34:17.595408 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 09:34:17.595408 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 09:34:17.595408 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 09:34:17.595408 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 09:34:17.595408 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 09:34:17.595408 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 09:34:17.595408 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application with Lock( Oct 27 09:34:17.595408 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 09:34:17.595408 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._enter() Oct 27 09:34:17.595408 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 09:34:17.595408 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 09:34:17.595408 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 09:34:17.595408 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.creator() Oct 27 09:34:17.595408 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 09:34:17.595408 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application created_value = creator( Oct 27 09:34:17.595408 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 27 09:34:17.596277 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 27 09:34:17.596277 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 09:34:17.596277 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application Oct 27 09:34:17.596277 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 335/649] 10.222.0.65 () {56 vars in 1108 bytes} [Thu Oct 27 09:34:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 27 09:34:17.600246 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca21fe2-7836-4d15-bad2-c0315eb4b211 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:34:17.680087 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:34:17.712989 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca21fe2-7836-4d15-bad2-c0315eb4b211 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:34:17.753412 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ac2e0b-8a55-4f2d-894f-3617c8c8a104 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:34:17.754022 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ac2e0b-8a55-4f2d-894f-3617c8c8a104 None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:34:17.754302 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ac2e0b-8a55-4f2d-894f-3617c8c8a104 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:34:17.754604 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ac2e0b-8a55-4f2d-894f-3617c8c8a104 None admin] PATH_INFO: `/v3/domains` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:34:17.755261 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ac2e0b-8a55-4f2d-894f-3617c8c8a104 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 09:34:17.755567 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ac2e0b-8a55-4f2d-894f-3617c8c8a104 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:34:17.756937 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ac2e0b-8a55-4f2d-894f-3617c8c8a104 None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:34:17.770072 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 315/650] 10.222.0.65 () {56 vars in 1109 bytes} [Thu Oct 27 09:34:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 09:34:17.777677 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cc3ba5-c802-427d-86c7-ae1ef0561a35 None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:34:17.785548 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ac2e0b-8a55-4f2d-894f-3617c8c8a104 None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:34:17.910468 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cc3ba5-c802-427d-86c7-ae1ef0561a35 None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:34:17.933691 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ac2e0b-8a55-4f2d-894f-3617c8c8a104 None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:34:17.955193 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd5f115-01ba-4cda-941e-ec51edc5e10f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:34:17.955899 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd5f115-01ba-4cda-941e-ec51edc5e10f None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:34:17.956272 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd5f115-01ba-4cda-941e-ec51edc5e10f None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:34:17.956652 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd5f115-01ba-4cda-941e-ec51edc5e10f None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:34:17.965567 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd5f115-01ba-4cda-941e-ec51edc5e10f None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:34:17.967294 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd5f115-01ba-4cda-941e-ec51edc5e10f None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:34:17.979461 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:34:17.983171 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application [None req-8bd5f115-01ba-4cda-941e-ec51edc5e10f None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 27 09:34:17.983171 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 09:34:17.983171 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 09:34:17.983171 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 09:34:17.983171 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 09:34:17.983171 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 09:34:17.983171 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 09:34:17.983171 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 09:34:17.983171 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 09:34:17.983171 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 09:34:17.983171 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 09:34:17.983171 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 09:34:17.983171 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 27 09:34:17.983171 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 27 09:34:17.983171 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 27 09:34:17.983171 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 27 09:34:17.990619 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 09:34:17.990619 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 09:34:17.990619 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 27 09:34:17.990619 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 27 09:34:17.990619 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 27 09:34:17.990619 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 27 09:34:17.990619 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 09:34:17.990619 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 09:34:17.990619 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 09:34:17.990619 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 09:34:17.990619 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 09:34:17.990619 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application with Lock( Oct 27 09:34:17.990619 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 09:34:17.990619 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._enter() Oct 27 09:34:17.990619 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 09:34:17.990619 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 09:34:17.990619 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 09:34:17.990619 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.creator() Oct 27 09:34:17.991529 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 09:34:17.991529 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application created_value = creator( Oct 27 09:34:17.991529 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 27 09:34:17.991529 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 27 09:34:17.991529 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 27 09:34:17.991529 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 27 09:34:17.991529 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 27 09:34:17.991529 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 27 09:34:17.991529 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 27 09:34:17.991529 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application Oct 27 09:34:17.991529 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 336/651] 10.222.0.65 () {56 vars in 1117 bytes} [Thu Oct 27 09:34:17 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 09:34:17.991529 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd5f115-01ba-4cda-941e-ec51edc5e10f None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:34:17.994560 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ebf076-3bd3-4bed-b4d5-80aaf9cb3bf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:34:17.995226 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ebf076-3bd3-4bed-b4d5-80aaf9cb3bf7 None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:34:17.995510 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ebf076-3bd3-4bed-b4d5-80aaf9cb3bf7 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:34:17.995786 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ebf076-3bd3-4bed-b4d5-80aaf9cb3bf7 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:34:17.996425 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ebf076-3bd3-4bed-b4d5-80aaf9cb3bf7 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:34:17.998290 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ebf076-3bd3-4bed-b4d5-80aaf9cb3bf7 None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:34:18.006353 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:34:18.008898 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application [None req-23ebf076-3bd3-4bed-b4d5-80aaf9cb3bf7 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 27 09:34:18.008898 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 09:34:18.008898 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 27 09:34:18.008898 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 27 09:34:18.008898 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 27 09:34:18.008898 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 27 09:34:18.008898 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 27 09:34:18.008898 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 27 09:34:18.008898 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 27 09:34:18.008898 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application Oct 27 09:34:18.008898 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 27 09:34:18.008898 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application Oct 27 09:34:18.008898 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 09:34:18.008898 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 09:34:18.008898 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 09:34:18.008898 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 09:34:18.008898 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 09:34:18.010058 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 09:34:18.010058 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 09:34:18.010058 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 09:34:18.010058 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 09:34:18.010058 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 09:34:18.010058 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 09:34:18.010058 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 27 09:34:18.010058 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 27 09:34:18.010058 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 27 09:34:18.010058 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 27 09:34:18.010058 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 09:34:18.010058 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 09:34:18.010058 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 09:34:18.010058 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 09:34:18.010058 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 09:34:18.010058 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 09:34:18.011086 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 09:34:18.011086 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application with Lock( Oct 27 09:34:18.011086 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 09:34:18.011086 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._enter() Oct 27 09:34:18.011086 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 09:34:18.011086 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 09:34:18.011086 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 09:34:18.011086 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.creator() Oct 27 09:34:18.011086 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 09:34:18.011086 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application created_value = creator( Oct 27 09:34:18.011086 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 27 09:34:18.011086 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 27 09:34:18.011086 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 27 09:34:18.011086 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application Oct 27 09:34:18.013824 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 316/652] 10.222.0.65 () {56 vars in 1114 bytes} [Thu Oct 27 09:34:17 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 09:34:18.019320 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ebf076-3bd3-4bed-b4d5-80aaf9cb3bf7 None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:34:18.108433 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd5f115-01ba-4cda-941e-ec51edc5e10f None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:34:18.126256 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ebf076-3bd3-4bed-b4d5-80aaf9cb3bf7 None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:34:18.142702 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1364ef52-d03d-47ed-8603-e1d80ba01911 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:34:18.143301 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1364ef52-d03d-47ed-8603-e1d80ba01911 None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:34:18.143580 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1364ef52-d03d-47ed-8603-e1d80ba01911 None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:34:18.143846 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1364ef52-d03d-47ed-8603-e1d80ba01911 None admin] PATH_INFO: `/v3/users` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:34:18.144561 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1364ef52-d03d-47ed-8603-e1d80ba01911 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 09:34:18.144863 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1364ef52-d03d-47ed-8603-e1d80ba01911 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:34:18.146278 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1364ef52-d03d-47ed-8603-e1d80ba01911 None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:34:18.161754 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a20a94-c63c-4cbf-a66d-ab773b83d107 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:34:18.162364 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a20a94-c63c-4cbf-a66d-ab773b83d107 None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:34:18.162682 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a20a94-c63c-4cbf-a66d-ab773b83d107 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:34:18.162955 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a20a94-c63c-4cbf-a66d-ab773b83d107 None admin] PATH_INFO: `/v3/services` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:34:18.163610 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a20a94-c63c-4cbf-a66d-ab773b83d107 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 09:34:18.163915 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a20a94-c63c-4cbf-a66d-ab773b83d107 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:34:18.170259 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 337/653] 10.222.0.65 () {56 vars in 1149 bytes} [Thu Oct 27 09:34:17 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 09:34:18.170436 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a20a94-c63c-4cbf-a66d-ab773b83d107 None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:34:18.170662 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea28c0a-577f-4bcb-be63-607609bcf2d3 None None] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:34:18.170662 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea28c0a-577f-4bcb-be63-607609bcf2d3 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:34:18.170662 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea28c0a-577f-4bcb-be63-607609bcf2d3 None None] PATH_INFO: `/` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:34:18.170662 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 338/654] 10.222.0.65 () {54 vars in 927 bytes} [Thu Oct 27 09:34:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 09:34:18.171099 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea28c0a-577f-4bcb-be63-607609bcf2d3 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:34:18.181523 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 317/655] 10.222.0.65 () {56 vars in 1114 bytes} [Thu Oct 27 09:34:18 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 09:34:18.181523 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0f5f43-ee01-4f8d-bc7e-8bc473f7e602 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:34:18.181523 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0f5f43-ee01-4f8d-bc7e-8bc473f7e602 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:34:18.181523 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0f5f43-ee01-4f8d-bc7e-8bc473f7e602 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:34:18.197310 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-fa0f5f43-ee01-4f8d-bc7e-8bc473f7e602 None None] MFA Rules not processed for user `b5065084bf664b99bdeac46067cb0f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:34:18.198501 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-fa0f5f43-ee01-4f8d-bc7e-8bc473f7e602 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:34:18.246848 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:34:18.258202 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:34:18.286557 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 318/656] 10.222.0.65 () {58 vars in 1024 bytes} [Thu Oct 27 09:34:18 2022] POST /identity/v3/auth/tokens => generated 1271 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 27 09:34:18.286557 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0f5f43-ee01-4f8d-bc7e-8bc473f7e602 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:34:18.286807 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea28c0a-577f-4bcb-be63-607609bcf2d3 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:34:18.323985 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8248a3ef-721e-41e7-9d32-b08687a87d1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:34:18.324619 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8248a3ef-721e-41e7-9d32-b08687a87d1c None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:34:18.324898 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8248a3ef-721e-41e7-9d32-b08687a87d1c None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:34:18.325167 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8248a3ef-721e-41e7-9d32-b08687a87d1c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:34:18.336449 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8248a3ef-721e-41e7-9d32-b08687a87d1c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:34:18.337995 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8248a3ef-721e-41e7-9d32-b08687a87d1c None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:34:18.353328 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application [None req-8248a3ef-721e-41e7-9d32-b08687a87d1c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 09:34:18.353328 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 09:34:18.353328 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 09:34:18.353328 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 09:34:18.353328 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 09:34:18.353328 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 09:34:18.353328 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 09:34:18.353328 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 09:34:18.353328 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 09:34:18.353328 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 09:34:18.353328 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 09:34:18.353328 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 09:34:18.353328 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 27 09:34:18.353328 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 27 09:34:18.353328 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 27 09:34:18.353328 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 27 09:34:18.354377 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 09:34:18.354377 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 09:34:18.354377 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 09:34:18.354377 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 09:34:18.354377 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 09:34:18.354377 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 09:34:18.354377 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 09:34:18.354377 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application with Lock( Oct 27 09:34:18.354377 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 09:34:18.354377 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._enter() Oct 27 09:34:18.354377 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 09:34:18.354377 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 09:34:18.354377 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 09:34:18.354377 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.creator() Oct 27 09:34:18.354377 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 09:34:18.354377 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application created_value = creator( Oct 27 09:34:18.354377 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 27 09:34:18.355663 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 27 09:34:18.355663 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 09:34:18.355663 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application Oct 27 09:34:18.355663 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 339/657] 10.222.0.65 () {56 vars in 1108 bytes} [Thu Oct 27 09:34:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 27 09:34:18.360131 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8248a3ef-721e-41e7-9d32-b08687a87d1c None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:34:18.414110 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0f5f43-ee01-4f8d-bc7e-8bc473f7e602 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:34:18.453340 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414e28c4-47d2-494e-830f-31b9f2e00053 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:34:18.454352 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414e28c4-47d2-494e-830f-31b9f2e00053 None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:34:18.454852 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414e28c4-47d2-494e-830f-31b9f2e00053 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:34:18.455276 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414e28c4-47d2-494e-830f-31b9f2e00053 None admin] PATH_INFO: `/v3/services` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:34:18.456124 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414e28c4-47d2-494e-830f-31b9f2e00053 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 09:34:18.456585 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414e28c4-47d2-494e-830f-31b9f2e00053 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:34:18.458123 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414e28c4-47d2-494e-830f-31b9f2e00053 None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:34:18.464559 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 319/658] 10.222.0.65 () {56 vars in 1114 bytes} [Thu Oct 27 09:34:18 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 09:34:18.482553 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8248a3ef-721e-41e7-9d32-b08687a87d1c None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:34:18.503902 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:34:18.524063 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa8268c-89c1-4e7d-a7df-aaa4e01c0d47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:34:18.526694 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa8268c-89c1-4e7d-a7df-aaa4e01c0d47 None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:34:18.526694 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa8268c-89c1-4e7d-a7df-aaa4e01c0d47 None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:34:18.526694 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa8268c-89c1-4e7d-a7df-aaa4e01c0d47 None admin] PATH_INFO: `/v3/domains` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:34:18.526958 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa8268c-89c1-4e7d-a7df-aaa4e01c0d47 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 09:34:18.527193 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa8268c-89c1-4e7d-a7df-aaa4e01c0d47 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:34:18.528757 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa8268c-89c1-4e7d-a7df-aaa4e01c0d47 None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:34:18.543574 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 340/659] 10.222.0.65 () {56 vars in 1109 bytes} [Thu Oct 27 09:34:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 09:34:18.549054 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414e28c4-47d2-494e-830f-31b9f2e00053 None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:34:18.592870 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa8268c-89c1-4e7d-a7df-aaa4e01c0d47 None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:34:18.617037 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:34:18.674144 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414e28c4-47d2-494e-830f-31b9f2e00053 None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:34:18.714404 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa8268c-89c1-4e7d-a7df-aaa4e01c0d47 None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:34:18.728946 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d23221-741c-4995-a6b7-f22fcb72052a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:34:18.729944 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d23221-741c-4995-a6b7-f22fcb72052a None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:34:18.730468 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d23221-741c-4995-a6b7-f22fcb72052a None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:34:18.731450 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d23221-741c-4995-a6b7-f22fcb72052a None admin] PATH_INFO: `/v3/projects/service` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:34:18.742099 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d23221-741c-4995-a6b7-f22fcb72052a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:34:18.744599 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d23221-741c-4995-a6b7-f22fcb72052a None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:34:18.761003 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application [None req-17d23221-741c-4995-a6b7-f22fcb72052a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 27 09:34:18.761003 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 09:34:18.761003 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 09:34:18.761003 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 09:34:18.761003 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 09:34:18.761003 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 09:34:18.761003 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 09:34:18.761003 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 09:34:18.761003 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 09:34:18.761003 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 09:34:18.761003 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 09:34:18.761003 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 09:34:18.761003 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 27 09:34:18.761003 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 27 09:34:18.761003 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 27 09:34:18.761959 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 27 09:34:18.761959 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 09:34:18.761959 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 09:34:18.761959 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 09:34:18.761959 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 09:34:18.761959 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 09:34:18.761959 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 09:34:18.761959 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 09:34:18.761959 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application with Lock( Oct 27 09:34:18.761959 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 09:34:18.761959 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._enter() Oct 27 09:34:18.761959 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 09:34:18.761959 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 09:34:18.761959 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 09:34:18.761959 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.creator() Oct 27 09:34:18.761959 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 09:34:18.761959 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application created_value = creator( Oct 27 09:34:18.762886 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 27 09:34:18.762886 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 27 09:34:18.762886 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 27 09:34:18.762886 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 27 09:34:18.762886 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 27 09:34:18.762886 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 27 09:34:18.762886 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 27 09:34:18.762886 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application Oct 27 09:34:18.765008 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 320/660] 10.222.0.65 () {56 vars in 1111 bytes} [Thu Oct 27 09:34:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 09:34:18.775373 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d23221-741c-4995-a6b7-f22fcb72052a None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:34:18.775650 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c4f4e3-aaf3-43dc-9f30-f7011d1d1a1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:34:18.775650 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c4f4e3-aaf3-43dc-9f30-f7011d1d1a1b None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:34:18.775650 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c4f4e3-aaf3-43dc-9f30-f7011d1d1a1b None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:34:18.775650 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c4f4e3-aaf3-43dc-9f30-f7011d1d1a1b None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:34:18.776236 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c4f4e3-aaf3-43dc-9f30-f7011d1d1a1b None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:34:18.776675 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c4f4e3-aaf3-43dc-9f30-f7011d1d1a1b None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:34:18.790475 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application [None req-97c4f4e3-aaf3-43dc-9f30-f7011d1d1a1b None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 27 09:34:18.790475 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 09:34:18.790475 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 27 09:34:18.790475 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 27 09:34:18.790475 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 27 09:34:18.790475 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 27 09:34:18.790475 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 27 09:34:18.790475 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 27 09:34:18.790475 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 27 09:34:18.790475 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application Oct 27 09:34:18.790475 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 27 09:34:18.790475 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application Oct 27 09:34:18.790475 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 09:34:18.790475 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 09:34:18.790475 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 09:34:18.790475 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 09:34:18.791860 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 09:34:18.791860 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 09:34:18.791860 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 09:34:18.791860 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 09:34:18.791860 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 09:34:18.791860 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 09:34:18.791860 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 09:34:18.791860 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 27 09:34:18.791860 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 27 09:34:18.791860 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 27 09:34:18.791860 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 27 09:34:18.791860 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 09:34:18.791860 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 09:34:18.791860 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 09:34:18.791860 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 09:34:18.791860 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 09:34:18.791860 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 09:34:18.792983 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 09:34:18.792983 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application with Lock( Oct 27 09:34:18.792983 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 09:34:18.792983 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._enter() Oct 27 09:34:18.792983 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 09:34:18.792983 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 09:34:18.792983 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 09:34:18.792983 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.creator() Oct 27 09:34:18.792983 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 09:34:18.792983 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application created_value = creator( Oct 27 09:34:18.792983 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 27 09:34:18.792983 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 27 09:34:18.792983 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 27 09:34:18.792983 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application Oct 27 09:34:18.796321 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 341/661] 10.222.0.65 () {56 vars in 1132 bytes} [Thu Oct 27 09:34:18 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 27 09:34:18.802097 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c4f4e3-aaf3-43dc-9f30-f7011d1d1a1b None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:34:18.867556 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:34:18.888921 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d23221-741c-4995-a6b7-f22fcb72052a None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:34:18.903025 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:34:18.921614 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c4f4e3-aaf3-43dc-9f30-f7011d1d1a1b None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:34:18.925789 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ff3ae8-2a36-4718-8227-5633645cbf15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:34:18.926400 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ff3ae8-2a36-4718-8227-5633645cbf15 None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:34:18.926756 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ff3ae8-2a36-4718-8227-5633645cbf15 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:34:18.927029 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ff3ae8-2a36-4718-8227-5633645cbf15 None admin] PATH_INFO: `/v3/projects` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:34:18.927722 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ff3ae8-2a36-4718-8227-5633645cbf15 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 09:34:18.928027 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ff3ae8-2a36-4718-8227-5633645cbf15 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:34:18.929461 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ff3ae8-2a36-4718-8227-5633645cbf15 None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:34:18.944125 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 321/662] 10.222.0.65 () {56 vars in 1148 bytes} [Thu Oct 27 09:34:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 09:34:18.945711 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58734d7b-79bf-4513-82c8-f590f375af0d None None] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:34:18.946202 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58734d7b-79bf-4513-82c8-f590f375af0d None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:34:18.947119 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58734d7b-79bf-4513-82c8-f590f375af0d None None] PATH_INFO: `/` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:34:18.952675 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 322/663] 10.222.0.65 () {54 vars in 927 bytes} [Thu Oct 27 09:34:18 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 09:34:18.952675 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58734d7b-79bf-4513-82c8-f590f375af0d None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:34:18.958710 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa47b2a-e34b-45f3-92dd-471952b741fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:34:18.959317 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa47b2a-e34b-45f3-92dd-471952b741fd None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:34:18.959596 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa47b2a-e34b-45f3-92dd-471952b741fd None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:34:18.959863 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa47b2a-e34b-45f3-92dd-471952b741fd None admin] PATH_INFO: `/v3/services` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:34:18.960485 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa47b2a-e34b-45f3-92dd-471952b741fd None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 09:34:18.960790 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa47b2a-e34b-45f3-92dd-471952b741fd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:34:18.962751 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa47b2a-e34b-45f3-92dd-471952b741fd None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:34:18.972288 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 342/664] 10.222.0.65 () {56 vars in 1126 bytes} [Thu Oct 27 09:34:18 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 09:34:18.972288 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ec37a4-ab94-46de-808c-72e7f4de3943 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:34:18.972288 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ec37a4-ab94-46de-808c-72e7f4de3943 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:34:18.972288 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ec37a4-ab94-46de-808c-72e7f4de3943 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:34:18.990933 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-b9ec37a4-ab94-46de-808c-72e7f4de3943 None None] MFA Rules not processed for user `b5065084bf664b99bdeac46067cb0f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:34:18.993254 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-b9ec37a4-ab94-46de-808c-72e7f4de3943 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:34:19.066176 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58734d7b-79bf-4513-82c8-f590f375af0d None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:34:19.067163 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 343/665] 10.222.0.65 () {58 vars in 1024 bytes} [Thu Oct 27 09:34:18 2022] POST /identity/v3/auth/tokens => generated 1271 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 27 09:34:19.071544 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ec37a4-ab94-46de-808c-72e7f4de3943 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:34:19.105175 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7188c24e-fa0d-414e-a638-6913ba330903 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:34:19.105974 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7188c24e-fa0d-414e-a638-6913ba330903 None admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:34:19.106205 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7188c24e-fa0d-414e-a638-6913ba330903 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:34:19.106480 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7188c24e-fa0d-414e-a638-6913ba330903 None admin] PATH_INFO: `/v3/projects/dc2e3a7a1bcc480891c0b433291c00b1/users/c18a92a796934277ad64a51ef3f7bb23/roles/ed04e37a302d4d4c9d940d9dc8d11599` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:34:19.108855 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7188c24e-fa0d-414e-a638-6913ba330903 None admin] RBAC: Authorizing `identity:create_grant(project_id=dc2e3a7a1bcc480891c0b433291c00b1, user_id=c18a92a796934277ad64a51ef3f7bb23, role_id=ed04e37a302d4d4c9d940d9dc8d11599)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:34:19.110458 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7188c24e-fa0d-414e-a638-6913ba330903 None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:34:19.127834 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:34:19.184501 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ec37a4-ab94-46de-808c-72e7f4de3943 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:34:19.211445 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 323/666] 10.222.0.65 () {58 vars in 1439 bytes} [Thu Oct 27 09:34:18 2022] PUT /identity/v3/projects/dc2e3a7a1bcc480891c0b433291c00b1/users/c18a92a796934277ad64a51ef3f7bb23/roles/ed04e37a302d4d4c9d940d9dc8d11599 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 09:34:19.232366 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560df902-2daf-4aeb-aca8-aa2dbe9fc7ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:34:19.233002 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560df902-2daf-4aeb-aca8-aa2dbe9fc7ff None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:34:19.233376 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560df902-2daf-4aeb-aca8-aa2dbe9fc7ff None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:34:19.233713 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560df902-2daf-4aeb-aca8-aa2dbe9fc7ff None admin] PATH_INFO: `/v3/services` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:34:19.234478 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560df902-2daf-4aeb-aca8-aa2dbe9fc7ff None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 09:34:19.234819 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560df902-2daf-4aeb-aca8-aa2dbe9fc7ff None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:34:19.236360 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560df902-2daf-4aeb-aca8-aa2dbe9fc7ff None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:34:19.243331 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 344/667] 10.222.0.65 () {56 vars in 1126 bytes} [Thu Oct 27 09:34:19 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 09:34:19.249289 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7188c24e-fa0d-414e-a638-6913ba330903 None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:34:19.285409 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:34:19.367968 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560df902-2daf-4aeb-aca8-aa2dbe9fc7ff None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:34:19.378084 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7188c24e-fa0d-414e-a638-6913ba330903 None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:34:19.421010 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5707d9-c1a0-4920-be0e-efb0ca4794f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:34:19.422019 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5707d9-c1a0-4920-be0e-efb0ca4794f3 None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:34:19.422380 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5707d9-c1a0-4920-be0e-efb0ca4794f3 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:34:19.422748 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5707d9-c1a0-4920-be0e-efb0ca4794f3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:34:19.423553 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5707d9-c1a0-4920-be0e-efb0ca4794f3 None admin] RBAC: Adding query filter params (interface=public, service_id=21aad5826ab7429b950b23ca95ded08b, region_id=RegionOne) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 09:34:19.423936 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5707d9-c1a0-4920-be0e-efb0ca4794f3 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:34:19.426273 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5707d9-c1a0-4920-be0e-efb0ca4794f3 None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:34:19.431703 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 324/668] 10.222.0.65 () {56 vars in 1251 bytes} [Thu Oct 27 09:34:19 2022] GET /identity/v3/endpoints?service_id=21aad5826ab7429b950b23ca95ded08b&interface=public®ion_id=RegionOne => generated 194 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 09:34:19.437251 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5707d9-c1a0-4920-be0e-efb0ca4794f3 None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:34:19.510694 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:34:19.515107 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560df902-2daf-4aeb-aca8-aa2dbe9fc7ff None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:34:19.558206 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceeaca25-018a-45c4-8e39-3980c10b668e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:34:19.559134 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceeaca25-018a-45c4-8e39-3980c10b668e None admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:34:19.559413 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceeaca25-018a-45c4-8e39-3980c10b668e None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:34:19.559966 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceeaca25-018a-45c4-8e39-3980c10b668e None admin] PATH_INFO: `/v3/services` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:34:19.561146 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:34:19.561974 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceeaca25-018a-45c4-8e39-3980c10b668e None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:34:19.563852 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceeaca25-018a-45c4-8e39-3980c10b668e None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:34:19.567122 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5707d9-c1a0-4920-be0e-efb0ca4794f3 None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:34:19.604930 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acc02bd-a922-4389-b381-fadba1576b9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:34:19.605544 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acc02bd-a922-4389-b381-fadba1576b9c None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:34:19.605825 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acc02bd-a922-4389-b381-fadba1576b9c None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:34:19.606102 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acc02bd-a922-4389-b381-fadba1576b9c None admin] PATH_INFO: `/v3/services` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:34:19.606737 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4acc02bd-a922-4389-b381-fadba1576b9c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:34:19.608241 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4acc02bd-a922-4389-b381-fadba1576b9c None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:34:19.614236 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 325/669] 10.222.0.65 () {56 vars in 1087 bytes} [Thu Oct 27 09:34:19 2022] GET /identity/v3/services => generated 1029 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 09:34:19.660695 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 345/670] 10.222.0.65 () {60 vars in 1141 bytes} [Thu Oct 27 09:34:19 2022] POST /identity/v3/services => generated 241 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 09:34:20.718608 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecdb6d5-f0a7-4dfd-af4c-231ac7eca7a4 None None] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:34:20.719134 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecdb6d5-f0a7-4dfd-af4c-231ac7eca7a4 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:34:20.719134 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecdb6d5-f0a7-4dfd-af4c-231ac7eca7a4 None None] PATH_INFO: `/` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:34:20.720710 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 326/671] 10.222.0.65 () {54 vars in 927 bytes} [Thu Oct 27 09:34:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 09:34:20.726043 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633e9ead-9e59-420f-bc11-f3e8c333b6fa None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:34:20.726436 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633e9ead-9e59-420f-bc11-f3e8c333b6fa None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:34:20.726646 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633e9ead-9e59-420f-bc11-f3e8c333b6fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:34:20.745885 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-633e9ead-9e59-420f-bc11-f3e8c333b6fa None None] MFA Rules not processed for user `b5065084bf664b99bdeac46067cb0f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:34:20.747102 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-633e9ead-9e59-420f-bc11-f3e8c333b6fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:34:20.826545 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 346/672] 10.222.0.65 () {58 vars in 1024 bytes} [Thu Oct 27 09:34:20 2022] POST /identity/v3/auth/tokens => generated 1373 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 27 09:34:21.104519 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecdb6d5-f0a7-4dfd-af4c-231ac7eca7a4 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:34:21.216032 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecdb6d5-f0a7-4dfd-af4c-231ac7eca7a4 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:34:21.255353 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe452d5-044a-44ca-bfe4-4f234496e3d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:34:21.256327 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe452d5-044a-44ca-bfe4-4f234496e3d9 None admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:34:21.256812 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe452d5-044a-44ca-bfe4-4f234496e3d9 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:34:21.257315 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe452d5-044a-44ca-bfe4-4f234496e3d9 None admin] PATH_INFO: `/v3/services` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:34:21.258211 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe452d5-044a-44ca-bfe4-4f234496e3d9 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:34:21.260284 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe452d5-044a-44ca-bfe4-4f234496e3d9 None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:34:21.352320 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 327/673] 10.222.0.65 () {60 vars in 1141 bytes} [Thu Oct 27 09:34:21 2022] POST /identity/v3/services => generated 251 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 09:34:21.468651 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa141b0b-c189-4e69-adc4-e02650b3dc9b None None] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:34:21.469036 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa141b0b-c189-4e69-adc4-e02650b3dc9b None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:34:21.469216 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa141b0b-c189-4e69-adc4-e02650b3dc9b None None] PATH_INFO: `/` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:34:21.470909 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 347/674] 10.222.0.65 () {54 vars in 927 bytes} [Thu Oct 27 09:34:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 09:34:21.476683 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004794d7-bc2a-4539-815d-d9e5f8fc2eca None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:34:21.476983 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004794d7-bc2a-4539-815d-d9e5f8fc2eca None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:34:21.477247 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004794d7-bc2a-4539-815d-d9e5f8fc2eca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:34:21.497751 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-004794d7-bc2a-4539-815d-d9e5f8fc2eca None None] MFA Rules not processed for user `b5065084bf664b99bdeac46067cb0f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:34:21.499008 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-004794d7-bc2a-4539-815d-d9e5f8fc2eca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:34:21.517216 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:34:21.584228 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 328/675] 10.222.0.65 () {58 vars in 1024 bytes} [Thu Oct 27 09:34:21 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 27 09:34:21.864702 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ff885a-ab72-4a35-8e76-49d3b7078968 None None] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:34:21.865255 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ff885a-ab72-4a35-8e76-49d3b7078968 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:34:21.865255 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ff885a-ab72-4a35-8e76-49d3b7078968 None None] PATH_INFO: `/` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:34:21.866849 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 348/676] 10.222.0.65 () {54 vars in 927 bytes} [Thu Oct 27 09:34:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 09:34:21.873642 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7318d2-3f2d-479a-baa4-1407d6543dc7 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:34:21.874162 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ff885a-ab72-4a35-8e76-49d3b7078968 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:34:21.874246 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7318d2-3f2d-479a-baa4-1407d6543dc7 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:34:21.874246 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7318d2-3f2d-479a-baa4-1407d6543dc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:34:21.899245 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-4e7318d2-3f2d-479a-baa4-1407d6543dc7 None None] MFA Rules not processed for user `b5065084bf664b99bdeac46067cb0f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:34:21.901131 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-4e7318d2-3f2d-479a-baa4-1407d6543dc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:34:21.975155 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:34:21.991752 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ff885a-ab72-4a35-8e76-49d3b7078968 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:34:21.992899 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 329/677] 10.222.0.65 () {58 vars in 1024 bytes} [Thu Oct 27 09:34:21 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 27 09:34:22.029434 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc184f8-8b96-45ad-85dd-78bca79459e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:34:22.030423 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc184f8-8b96-45ad-85dd-78bca79459e3 None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:34:22.031074 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc184f8-8b96-45ad-85dd-78bca79459e3 None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:34:22.031567 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc184f8-8b96-45ad-85dd-78bca79459e3 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:34:22.037943 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871ca126-616c-4bd8-9fbc-fc6f44342483 None None] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:34:22.038474 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871ca126-616c-4bd8-9fbc-fc6f44342483 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:34:22.039111 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871ca126-616c-4bd8-9fbc-fc6f44342483 None None] PATH_INFO: `/` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:34:22.041811 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 330/678] 10.222.0.65 () {54 vars in 927 bytes} [Thu Oct 27 09:34:22 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 27 09:34:22.047654 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db14c59-5ccf-4e16-8c5f-7bb5abf4ef98 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:34:22.053164 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db14c59-5ccf-4e16-8c5f-7bb5abf4ef98 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:34:22.053164 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db14c59-5ccf-4e16-8c5f-7bb5abf4ef98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:34:22.053332 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc184f8-8b96-45ad-85dd-78bca79459e3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 09:34:22.055288 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application [None req-dcc184f8-8b96-45ad-85dd-78bca79459e3 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 27 09:34:22.055288 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 09:34:22.055288 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 09:34:22.055288 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 09:34:22.055288 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 09:34:22.055288 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 09:34:22.055288 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 09:34:22.055288 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 09:34:22.055288 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 09:34:22.055288 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 09:34:22.055288 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 09:34:22.055288 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 09:34:22.055288 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 27 09:34:22.055288 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 27 09:34:22.055288 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 27 09:34:22.055288 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 27 09:34:22.056274 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 27 09:34:22.056274 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 27 09:34:22.056274 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 27 09:34:22.056274 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 27 09:34:22.056274 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 09:34:22.056274 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 09:34:22.056274 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 09:34:22.056274 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 09:34:22.056274 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 09:34:22.056274 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 09:34:22.056274 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 09:34:22.056274 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application with Lock( Oct 27 09:34:22.056274 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 09:34:22.056274 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._enter() Oct 27 09:34:22.056274 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 09:34:22.056274 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 09:34:22.057233 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 09:34:22.057233 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.creator() Oct 27 09:34:22.057233 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 09:34:22.057233 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application created_value = creator( Oct 27 09:34:22.057233 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 27 09:34:22.057233 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 27 09:34:22.057233 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 27 09:34:22.057233 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 27 09:34:22.057233 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 27 09:34:22.057233 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 27 09:34:22.057233 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 27 09:34:22.057233 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application Oct 27 09:34:22.057233 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 349/679] 10.222.0.65 () {56 vars in 1120 bytes} [Thu Oct 27 09:34:21 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 27 09:34:22.062979 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc184f8-8b96-45ad-85dd-78bca79459e3 None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:34:22.073706 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-0db14c59-5ccf-4e16-8c5f-7bb5abf4ef98 None None] MFA Rules not processed for user `b5065084bf664b99bdeac46067cb0f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:34:22.075815 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-0db14c59-5ccf-4e16-8c5f-7bb5abf4ef98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:34:22.170679 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 331/680] 10.222.0.65 () {58 vars in 1024 bytes} [Thu Oct 27 09:34:22 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 27 09:34:22.188181 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc184f8-8b96-45ad-85dd-78bca79459e3 None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:34:22.224778 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03bbba5-86f0-445b-abea-405f4bef8623 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:34:22.227075 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03bbba5-86f0-445b-abea-405f4bef8623 None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:34:22.228300 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03bbba5-86f0-445b-abea-405f4bef8623 None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:34:22.228788 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03bbba5-86f0-445b-abea-405f4bef8623 None admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:34:22.229638 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03bbba5-86f0-445b-abea-405f4bef8623 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 09:34:22.230137 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03bbba5-86f0-445b-abea-405f4bef8623 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:34:22.231798 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03bbba5-86f0-445b-abea-405f4bef8623 None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:34:22.241174 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 350/681] 10.222.0.65 () {56 vars in 1115 bytes} [Thu Oct 27 09:34:22 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 09:34:22.247485 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db14c59-5ccf-4e16-8c5f-7bb5abf4ef98 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:34:22.256089 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:34:22.265515 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03bbba5-86f0-445b-abea-405f4bef8623 None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:34:22.279514 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:34:22.371005 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db14c59-5ccf-4e16-8c5f-7bb5abf4ef98 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:34:22.384999 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03bbba5-86f0-445b-abea-405f4bef8623 None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:34:22.409684 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6343372-09a1-48ea-acd8-5c80a5329ab7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:34:22.410679 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6343372-09a1-48ea-acd8-5c80a5329ab7 None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:34:22.411104 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6343372-09a1-48ea-acd8-5c80a5329ab7 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:34:22.411559 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6343372-09a1-48ea-acd8-5c80a5329ab7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:34:22.421457 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d666e283-0776-4519-91c7-be62ebcdede0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:34:22.422099 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d666e283-0776-4519-91c7-be62ebcdede0 None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:34:22.422456 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d666e283-0776-4519-91c7-be62ebcdede0 None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:34:22.422834 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d666e283-0776-4519-91c7-be62ebcdede0 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:34:22.423529 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d666e283-0776-4519-91c7-be62ebcdede0 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:34:22.424092 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6343372-09a1-48ea-acd8-5c80a5329ab7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:34:22.425039 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d666e283-0776-4519-91c7-be62ebcdede0 None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:34:22.425895 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6343372-09a1-48ea-acd8-5c80a5329ab7 None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:34:22.434491 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application [None req-d666e283-0776-4519-91c7-be62ebcdede0 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 27 09:34:22.434491 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 09:34:22.434491 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 27 09:34:22.434491 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 27 09:34:22.434491 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 27 09:34:22.434491 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 27 09:34:22.434491 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 27 09:34:22.434491 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 27 09:34:22.434491 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 27 09:34:22.434491 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application Oct 27 09:34:22.434491 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 27 09:34:22.434491 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application Oct 27 09:34:22.434491 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 09:34:22.434491 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 09:34:22.434491 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 09:34:22.434491 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 09:34:22.435482 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 09:34:22.435482 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 09:34:22.435482 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 09:34:22.435482 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 09:34:22.435482 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 09:34:22.435482 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 09:34:22.435482 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 09:34:22.435482 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 27 09:34:22.435482 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 27 09:34:22.435482 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 27 09:34:22.435482 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 27 09:34:22.435482 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 09:34:22.435482 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 09:34:22.435482 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 09:34:22.435482 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 09:34:22.435482 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 09:34:22.435482 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 09:34:22.441397 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 09:34:22.441397 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application with Lock( Oct 27 09:34:22.441397 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 09:34:22.441397 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._enter() Oct 27 09:34:22.441397 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 09:34:22.441397 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 09:34:22.441397 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 09:34:22.441397 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.creator() Oct 27 09:34:22.441397 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 09:34:22.441397 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application created_value = creator( Oct 27 09:34:22.441397 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 27 09:34:22.441397 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 27 09:34:22.441397 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 27 09:34:22.441397 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application Oct 27 09:34:22.441397 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 351/682] 10.222.0.65 () {56 vars in 1132 bytes} [Thu Oct 27 09:34:22 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 27 09:34:22.442182 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d666e283-0776-4519-91c7-be62ebcdede0 None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:34:22.450830 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application [None req-e6343372-09a1-48ea-acd8-5c80a5329ab7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 09:34:22.450830 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 09:34:22.450830 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 09:34:22.450830 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 09:34:22.450830 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 09:34:22.450830 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 09:34:22.450830 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 09:34:22.450830 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 09:34:22.450830 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 09:34:22.450830 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 09:34:22.450830 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 09:34:22.450830 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 09:34:22.450830 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 27 09:34:22.450830 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 27 09:34:22.450830 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 27 09:34:22.450830 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 27 09:34:22.451771 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 09:34:22.451771 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 09:34:22.451771 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 09:34:22.451771 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 09:34:22.451771 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 09:34:22.451771 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 09:34:22.451771 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 09:34:22.451771 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application with Lock( Oct 27 09:34:22.451771 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 09:34:22.451771 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._enter() Oct 27 09:34:22.451771 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 09:34:22.451771 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 09:34:22.451771 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 09:34:22.451771 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.creator() Oct 27 09:34:22.451771 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 09:34:22.451771 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application created_value = creator( Oct 27 09:34:22.451771 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 27 09:34:22.452629 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 27 09:34:22.452629 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 09:34:22.452629 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application Oct 27 09:34:22.459646 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 332/683] 10.222.0.65 () {56 vars in 1108 bytes} [Thu Oct 27 09:34:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 09:34:22.461429 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6343372-09a1-48ea-acd8-5c80a5329ab7 None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:34:22.525811 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:34:22.528226 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:34:22.556976 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d666e283-0776-4519-91c7-be62ebcdede0 None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:34:22.573749 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6343372-09a1-48ea-acd8-5c80a5329ab7 None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:34:22.593515 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6faf657-3482-4176-a085-2794398fe9e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:34:22.594165 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6faf657-3482-4176-a085-2794398fe9e5 None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:34:22.594443 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6faf657-3482-4176-a085-2794398fe9e5 None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:34:22.594753 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6faf657-3482-4176-a085-2794398fe9e5 None admin] PATH_INFO: `/v3/services` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:34:22.595387 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6faf657-3482-4176-a085-2794398fe9e5 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 09:34:22.595692 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6faf657-3482-4176-a085-2794398fe9e5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:34:22.597063 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6faf657-3482-4176-a085-2794398fe9e5 None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:34:22.606737 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 352/684] 10.222.0.65 () {56 vars in 1126 bytes} [Thu Oct 27 09:34:22 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 09:34:22.606737 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6faf657-3482-4176-a085-2794398fe9e5 None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:34:22.617182 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb67529-97c5-428d-ab83-b253b8bb259c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:34:22.617793 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb67529-97c5-428d-ab83-b253b8bb259c None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:34:22.618105 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb67529-97c5-428d-ab83-b253b8bb259c None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:34:22.618376 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb67529-97c5-428d-ab83-b253b8bb259c None admin] PATH_INFO: `/v3/domains` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:34:22.619357 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb67529-97c5-428d-ab83-b253b8bb259c None admin] RBAC: Adding query filter params (name=Default) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 09:34:22.619557 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb67529-97c5-428d-ab83-b253b8bb259c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:34:22.620916 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb67529-97c5-428d-ab83-b253b8bb259c None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:34:22.634001 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 333/685] 10.222.0.65 () {56 vars in 1109 bytes} [Thu Oct 27 09:34:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 09:34:22.635043 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb67529-97c5-428d-ab83-b253b8bb259c None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:34:22.716439 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6faf657-3482-4176-a085-2794398fe9e5 None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:34:22.741141 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb67529-97c5-428d-ab83-b253b8bb259c None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:34:22.759739 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:34:22.761473 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0a9b16-170a-481b-a5d7-833cc95a64b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:34:22.762107 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0a9b16-170a-481b-a5d7-833cc95a64b2 None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:34:22.762384 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0a9b16-170a-481b-a5d7-833cc95a64b2 None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:34:22.762683 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0a9b16-170a-481b-a5d7-833cc95a64b2 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:34:22.763706 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0a9b16-170a-481b-a5d7-833cc95a64b2 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:34:22.765368 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0a9b16-170a-481b-a5d7-833cc95a64b2 None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:34:22.769379 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:34:22.777271 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d40e0df-9e51-4e5e-96a4-7155d6adacfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:34:22.777560 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application [None req-6c0a9b16-170a-481b-a5d7-833cc95a64b2 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 27 09:34:22.777560 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 09:34:22.777560 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 27 09:34:22.777560 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 27 09:34:22.777560 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 27 09:34:22.777560 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 27 09:34:22.777560 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 27 09:34:22.777560 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 27 09:34:22.777560 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 27 09:34:22.777560 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application Oct 27 09:34:22.777560 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 27 09:34:22.777560 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application Oct 27 09:34:22.777560 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 09:34:22.777560 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 09:34:22.777560 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 09:34:22.777560 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 09:34:22.777560 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 09:34:22.778823 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 09:34:22.778823 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 09:34:22.778823 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 09:34:22.778823 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 09:34:22.778823 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 09:34:22.778823 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 09:34:22.778823 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 27 09:34:22.778823 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 27 09:34:22.778823 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 27 09:34:22.778823 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 27 09:34:22.778823 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 09:34:22.778823 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 09:34:22.778823 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 09:34:22.778823 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 09:34:22.778823 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 09:34:22.778823 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 09:34:22.779782 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 09:34:22.779782 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application with Lock( Oct 27 09:34:22.779782 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 09:34:22.779782 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._enter() Oct 27 09:34:22.779782 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 09:34:22.779782 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 09:34:22.779782 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 09:34:22.779782 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.creator() Oct 27 09:34:22.779782 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 09:34:22.779782 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application created_value = creator( Oct 27 09:34:22.779782 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 27 09:34:22.779782 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 27 09:34:22.779782 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 27 09:34:22.779782 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application Oct 27 09:34:22.780536 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d40e0df-9e51-4e5e-96a4-7155d6adacfc None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:34:22.780536 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d40e0df-9e51-4e5e-96a4-7155d6adacfc None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:34:22.780536 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d40e0df-9e51-4e5e-96a4-7155d6adacfc None admin] PATH_INFO: `/v3/services` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:34:22.780724 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 353/686] 10.222.0.65 () {56 vars in 1126 bytes} [Thu Oct 27 09:34:22 2022] GET /identity/v3/services/object-store => generated 93 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 09:34:22.780724 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0a9b16-170a-481b-a5d7-833cc95a64b2 None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:34:22.784041 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d40e0df-9e51-4e5e-96a4-7155d6adacfc None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 09:34:22.785113 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d40e0df-9e51-4e5e-96a4-7155d6adacfc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:34:22.785745 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d40e0df-9e51-4e5e-96a4-7155d6adacfc None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:34:22.797913 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 334/687] 10.222.0.65 () {56 vars in 1126 bytes} [Thu Oct 27 09:34:22 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 09:34:22.797913 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d40e0df-9e51-4e5e-96a4-7155d6adacfc None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:34:22.905506 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0a9b16-170a-481b-a5d7-833cc95a64b2 None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:34:22.918247 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d40e0df-9e51-4e5e-96a4-7155d6adacfc None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:34:22.942424 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035de547-d7a3-4a54-b0f0-3a757ef7427e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:34:22.943076 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035de547-d7a3-4a54-b0f0-3a757ef7427e None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:34:22.943356 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035de547-d7a3-4a54-b0f0-3a757ef7427e None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:34:22.943627 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035de547-d7a3-4a54-b0f0-3a757ef7427e None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:34:22.952750 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035de547-d7a3-4a54-b0f0-3a757ef7427e None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:34:22.954887 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035de547-d7a3-4a54-b0f0-3a757ef7427e None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:34:22.957176 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a58e63d-06cf-4785-97d1-3e93530dbc4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:34:22.957793 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a58e63d-06cf-4785-97d1-3e93530dbc4b None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:34:22.958074 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a58e63d-06cf-4785-97d1-3e93530dbc4b None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:34:22.958352 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a58e63d-06cf-4785-97d1-3e93530dbc4b None admin] PATH_INFO: `/v3/services` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:34:22.959017 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a58e63d-06cf-4785-97d1-3e93530dbc4b None admin] RBAC: Adding query filter params (name=object-store) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 09:34:22.959318 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a58e63d-06cf-4785-97d1-3e93530dbc4b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:34:22.960710 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a58e63d-06cf-4785-97d1-3e93530dbc4b None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:34:22.965910 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 335/688] 10.222.0.65 () {56 vars in 1122 bytes} [Thu Oct 27 09:34:22 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 09:34:22.966757 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a58e63d-06cf-4785-97d1-3e93530dbc4b None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:34:22.969764 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application [None req-035de547-d7a3-4a54-b0f0-3a757ef7427e None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 27 09:34:22.969764 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 09:34:22.969764 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 09:34:22.969764 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 09:34:22.969764 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 09:34:22.969764 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 09:34:22.969764 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 09:34:22.969764 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 09:34:22.969764 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 09:34:22.969764 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 09:34:22.969764 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 09:34:22.969764 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 09:34:22.969764 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 27 09:34:22.969764 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 27 09:34:22.969764 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 27 09:34:22.969764 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 27 09:34:22.971045 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 09:34:22.971045 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 09:34:22.971045 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 27 09:34:22.971045 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 27 09:34:22.971045 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 27 09:34:22.971045 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 27 09:34:22.971045 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 09:34:22.971045 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 09:34:22.971045 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 09:34:22.971045 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 09:34:22.971045 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 09:34:22.971045 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application with Lock( Oct 27 09:34:22.971045 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 09:34:22.971045 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._enter() Oct 27 09:34:22.971045 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 09:34:22.971045 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 09:34:22.971045 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 09:34:22.971045 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.creator() Oct 27 09:34:22.972296 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 09:34:22.972296 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application created_value = creator( Oct 27 09:34:22.972296 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 27 09:34:22.972296 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 27 09:34:22.972296 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 27 09:34:22.972296 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 27 09:34:22.972296 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 27 09:34:22.972296 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 27 09:34:22.972296 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 27 09:34:22.972296 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application Oct 27 09:34:22.972296 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 354/689] 10.222.0.65 () {56 vars in 1117 bytes} [Thu Oct 27 09:34:22 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 09:34:22.972296 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035de547-d7a3-4a54-b0f0-3a757ef7427e None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:34:23.027232 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:34:23.035234 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:34:23.084188 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035de547-d7a3-4a54-b0f0-3a757ef7427e None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:34:23.084751 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a58e63d-06cf-4785-97d1-3e93530dbc4b None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:34:23.122112 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14c94aa-4824-4b0d-bce6-da345ebfe8a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:34:23.122749 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14c94aa-4824-4b0d-bce6-da345ebfe8a8 None admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:34:23.123033 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14c94aa-4824-4b0d-bce6-da345ebfe8a8 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:34:23.123308 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14c94aa-4824-4b0d-bce6-da345ebfe8a8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:34:23.123967 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14c94aa-4824-4b0d-bce6-da345ebfe8a8 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:34:23.125457 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14c94aa-4824-4b0d-bce6-da345ebfe8a8 None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:34:23.126511 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7a2678-ab9b-49a9-b67e-259917add7fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:34:23.127146 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7a2678-ab9b-49a9-b67e-259917add7fd None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:34:23.127426 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7a2678-ab9b-49a9-b67e-259917add7fd None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:34:23.127699 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7a2678-ab9b-49a9-b67e-259917add7fd None admin] PATH_INFO: `/v3/services` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:34:23.128322 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7a2678-ab9b-49a9-b67e-259917add7fd None admin] RBAC: Adding query filter params (type=object-store) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 09:34:23.128629 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7a2678-ab9b-49a9-b67e-259917add7fd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:34:23.130005 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7a2678-ab9b-49a9-b67e-259917add7fd None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:34:23.140881 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 355/690] 10.222.0.65 () {56 vars in 1122 bytes} [Thu Oct 27 09:34:22 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 09:34:23.140881 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7a2678-ab9b-49a9-b67e-259917add7fd None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:34:23.214560 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 336/691] 10.222.0.65 () {60 vars in 1144 bytes} [Thu Oct 27 09:34:22 2022] POST /identity/v3/endpoints => generated 347 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 09:34:23.214560 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14c94aa-4824-4b0d-bce6-da345ebfe8a8 None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:34:23.262574 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7a2678-ab9b-49a9-b67e-259917add7fd None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:34:23.295380 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:34:23.314444 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7d1c39-4655-47cc-8082-a4640802f4cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:34:23.315468 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7d1c39-4655-47cc-8082-a4640802f4cb None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:34:23.315891 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7d1c39-4655-47cc-8082-a4640802f4cb None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:34:23.316331 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7d1c39-4655-47cc-8082-a4640802f4cb None admin] PATH_INFO: `/v3/users` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:34:23.317349 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7d1c39-4655-47cc-8082-a4640802f4cb None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 09:34:23.317801 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7d1c39-4655-47cc-8082-a4640802f4cb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:34:23.319515 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7d1c39-4655-47cc-8082-a4640802f4cb None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:34:23.340596 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 356/692] 10.222.0.65 () {56 vars in 1149 bytes} [Thu Oct 27 09:34:23 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 09:34:23.347532 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7d1c39-4655-47cc-8082-a4640802f4cb None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:34:23.355223 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14c94aa-4824-4b0d-bce6-da345ebfe8a8 None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:34:23.357299 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:34:23.397923 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ddd5b9-4359-4fbd-bbfc-e35314ddb93e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:34:23.398760 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ddd5b9-4359-4fbd-bbfc-e35314ddb93e None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:34:23.399143 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ddd5b9-4359-4fbd-bbfc-e35314ddb93e None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:34:23.400093 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ddd5b9-4359-4fbd-bbfc-e35314ddb93e None admin] PATH_INFO: `/v3/endpoints` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:34:23.400855 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ddd5b9-4359-4fbd-bbfc-e35314ddb93e None admin] RBAC: Adding query filter params (interface=public, service_id=895719fe19664df48f4bdc52cf441355, region_id=RegionOne) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 09:34:23.401221 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ddd5b9-4359-4fbd-bbfc-e35314ddb93e None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:34:23.402893 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ddd5b9-4359-4fbd-bbfc-e35314ddb93e None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:34:23.409270 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 337/693] 10.222.0.65 () {56 vars in 1251 bytes} [Thu Oct 27 09:34:23 2022] GET /identity/v3/endpoints?service_id=895719fe19664df48f4bdc52cf441355&interface=public®ion_id=RegionOne => generated 194 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 09:34:23.419438 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ddd5b9-4359-4fbd-bbfc-e35314ddb93e None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:34:23.482369 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7d1c39-4655-47cc-8082-a4640802f4cb None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:34:23.533170 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae70794f-1bb3-4a0b-9f61-f578fadaa29f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:34:23.533817 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae70794f-1bb3-4a0b-9f61-f578fadaa29f None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:34:23.534170 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae70794f-1bb3-4a0b-9f61-f578fadaa29f None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:34:23.534543 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae70794f-1bb3-4a0b-9f61-f578fadaa29f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:34:23.549980 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ddd5b9-4359-4fbd-bbfc-e35314ddb93e None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:34:23.590082 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddfb973-e790-4c58-a829-edf1661e85a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:34:23.590859 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddfb973-e790-4c58-a829-edf1661e85a6 None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:34:23.591203 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddfb973-e790-4c58-a829-edf1661e85a6 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:34:23.591544 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddfb973-e790-4c58-a829-edf1661e85a6 None admin] PATH_INFO: `/v3/services` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:34:23.592222 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ddfb973-e790-4c58-a829-edf1661e85a6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:34:23.593654 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ddfb973-e790-4c58-a829-edf1661e85a6 None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:34:23.606083 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:34:23.608786 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 338/694] 10.222.0.65 () {56 vars in 1087 bytes} [Thu Oct 27 09:34:23 2022] GET /identity/v3/services => generated 1497 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 09:34:23.633408 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae70794f-1bb3-4a0b-9f61-f578fadaa29f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:34:23.635667 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae70794f-1bb3-4a0b-9f61-f578fadaa29f None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:34:23.664753 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37ec3a6-5059-4f50-9ec4-f95b3b6b9706 None None] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:34:23.665628 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37ec3a6-5059-4f50-9ec4-f95b3b6b9706 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:34:23.665954 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37ec3a6-5059-4f50-9ec4-f95b3b6b9706 None None] PATH_INFO: `/` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:34:23.667740 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 339/695] 10.222.0.65 () {54 vars in 927 bytes} [Thu Oct 27 09:34:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 27 09:34:23.673465 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57e4a28-31df-4757-9797-dd5493d12790 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:34:23.673772 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57e4a28-31df-4757-9797-dd5493d12790 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:34:23.674021 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57e4a28-31df-4757-9797-dd5493d12790 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:34:23.693962 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-c57e4a28-31df-4757-9797-dd5493d12790 None None] MFA Rules not processed for user `b5065084bf664b99bdeac46067cb0f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:34:23.695245 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-c57e4a28-31df-4757-9797-dd5493d12790 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:34:23.728888 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:34:23.762348 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 357/696] 10.222.0.65 () {58 vars in 1282 bytes} [Thu Oct 27 09:34:23 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 27 09:34:23.763422 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae70794f-1bb3-4a0b-9f61-f578fadaa29f None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:34:23.779786 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 340/697] 10.222.0.65 () {58 vars in 1024 bytes} [Thu Oct 27 09:34:23 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 27 09:34:23.860506 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:34:23.884280 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae70794f-1bb3-4a0b-9f61-f578fadaa29f None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:34:23.920671 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93dca73-4935-4bc6-8560-efdcf72f2172 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:34:23.921291 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93dca73-4935-4bc6-8560-efdcf72f2172 None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:34:23.921574 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93dca73-4935-4bc6-8560-efdcf72f2172 None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:34:23.921854 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93dca73-4935-4bc6-8560-efdcf72f2172 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:34:23.933457 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93dca73-4935-4bc6-8560-efdcf72f2172 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:34:23.934938 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93dca73-4935-4bc6-8560-efdcf72f2172 None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:34:23.949987 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application [None req-a93dca73-4935-4bc6-8560-efdcf72f2172 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 09:34:23.949987 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 09:34:23.949987 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 09:34:23.949987 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 09:34:23.949987 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 09:34:23.949987 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 09:34:23.949987 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 09:34:23.949987 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 09:34:23.949987 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 09:34:23.949987 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 09:34:23.949987 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 09:34:23.949987 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 09:34:23.949987 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 27 09:34:23.949987 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 27 09:34:23.949987 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 27 09:34:23.949987 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 27 09:34:23.951007 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 09:34:23.951007 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 09:34:23.951007 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 09:34:23.951007 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 09:34:23.951007 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 09:34:23.951007 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 09:34:23.951007 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 09:34:23.951007 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application with Lock( Oct 27 09:34:23.951007 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 09:34:23.951007 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._enter() Oct 27 09:34:23.951007 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 09:34:23.951007 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 09:34:23.951007 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 09:34:23.951007 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.creator() Oct 27 09:34:23.951007 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 09:34:23.951007 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application created_value = creator( Oct 27 09:34:23.951007 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 27 09:34:23.951859 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 27 09:34:23.951859 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 09:34:23.951859 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application Oct 27 09:34:23.951859 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 358/698] 10.222.0.65 () {56 vars in 1108 bytes} [Thu Oct 27 09:34:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 09:34:23.957206 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57e4a28-31df-4757-9797-dd5493d12790 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:34:24.055716 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93dca73-4935-4bc6-8560-efdcf72f2172 None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:34:24.064438 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57e4a28-31df-4757-9797-dd5493d12790 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:34:24.105496 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa2f67e-16e1-4e36-b5a5-be07c27fae10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:34:24.106026 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa2f67e-16e1-4e36-b5a5-be07c27fae10 None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:34:24.106305 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa2f67e-16e1-4e36-b5a5-be07c27fae10 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:34:24.106605 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa2f67e-16e1-4e36-b5a5-be07c27fae10 None admin] PATH_INFO: `/v3/domains` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:34:24.107253 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa2f67e-16e1-4e36-b5a5-be07c27fae10 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 09:34:24.107553 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa2f67e-16e1-4e36-b5a5-be07c27fae10 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:34:24.108941 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa2f67e-16e1-4e36-b5a5-be07c27fae10 None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:34:24.125925 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 341/699] 10.222.0.65 () {56 vars in 1109 bytes} [Thu Oct 27 09:34:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 09:34:24.137020 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa2f67e-16e1-4e36-b5a5-be07c27fae10 None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:34:24.163550 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:34:24.196959 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93dca73-4935-4bc6-8560-efdcf72f2172 None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:34:24.231352 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:34:24.237882 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfead00-f65b-49af-9a08-f93020d3387f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:34:24.238554 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfead00-f65b-49af-9a08-f93020d3387f None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:34:24.238985 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfead00-f65b-49af-9a08-f93020d3387f None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:34:24.239256 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfead00-f65b-49af-9a08-f93020d3387f None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:34:24.245440 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcfead00-f65b-49af-9a08-f93020d3387f None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:34:24.245440 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcfead00-f65b-49af-9a08-f93020d3387f None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:34:24.252787 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application [None req-dcfead00-f65b-49af-9a08-f93020d3387f None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 27 09:34:24.252787 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 09:34:24.252787 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 27 09:34:24.252787 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 27 09:34:24.252787 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 27 09:34:24.252787 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 27 09:34:24.252787 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 27 09:34:24.252787 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 27 09:34:24.252787 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 27 09:34:24.252787 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application Oct 27 09:34:24.252787 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 27 09:34:24.252787 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application Oct 27 09:34:24.252787 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 09:34:24.252787 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 09:34:24.252787 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 09:34:24.252787 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 09:34:24.252787 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 09:34:24.254022 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 09:34:24.254022 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 09:34:24.254022 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 09:34:24.254022 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 09:34:24.254022 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 09:34:24.254022 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 09:34:24.254022 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 27 09:34:24.254022 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 27 09:34:24.254022 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 27 09:34:24.254022 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 27 09:34:24.254022 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 09:34:24.254022 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 09:34:24.254022 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 09:34:24.254022 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 09:34:24.254022 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 09:34:24.254022 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 09:34:24.255069 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 09:34:24.255069 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application with Lock( Oct 27 09:34:24.255069 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 09:34:24.255069 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._enter() Oct 27 09:34:24.255069 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 09:34:24.255069 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 09:34:24.255069 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 09:34:24.255069 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.creator() Oct 27 09:34:24.255069 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 09:34:24.255069 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application created_value = creator( Oct 27 09:34:24.255069 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 27 09:34:24.255069 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 27 09:34:24.255069 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 27 09:34:24.255069 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application Oct 27 09:34:24.257129 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 359/700] 10.222.0.65 () {56 vars in 1114 bytes} [Thu Oct 27 09:34:24 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 09:34:24.264192 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfead00-f65b-49af-9a08-f93020d3387f None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:34:24.280718 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa2f67e-16e1-4e36-b5a5-be07c27fae10 None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:34:24.326009 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d75618-3bf1-4d02-9c1c-94a36eae3599 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:34:24.327199 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d75618-3bf1-4d02-9c1c-94a36eae3599 None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:34:24.327955 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d75618-3bf1-4d02-9c1c-94a36eae3599 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:34:24.328383 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d75618-3bf1-4d02-9c1c-94a36eae3599 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:34:24.337160 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d75618-3bf1-4d02-9c1c-94a36eae3599 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:34:24.339466 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d75618-3bf1-4d02-9c1c-94a36eae3599 None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:34:24.358009 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application [None req-10d75618-3bf1-4d02-9c1c-94a36eae3599 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 27 09:34:24.358009 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 09:34:24.358009 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 09:34:24.358009 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 09:34:24.358009 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 09:34:24.358009 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 09:34:24.358009 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 09:34:24.358009 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 09:34:24.358009 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 09:34:24.358009 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 09:34:24.358009 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 09:34:24.358009 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 09:34:24.358009 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 27 09:34:24.358009 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 27 09:34:24.358009 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 27 09:34:24.358975 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 27 09:34:24.358975 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 09:34:24.358975 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 09:34:24.358975 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 09:34:24.358975 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 09:34:24.358975 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 09:34:24.358975 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 09:34:24.358975 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 09:34:24.358975 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application with Lock( Oct 27 09:34:24.358975 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 09:34:24.358975 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._enter() Oct 27 09:34:24.358975 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 09:34:24.358975 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 09:34:24.358975 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 09:34:24.358975 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.creator() Oct 27 09:34:24.358975 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 09:34:24.358975 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application created_value = creator( Oct 27 09:34:24.360036 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 27 09:34:24.360036 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 27 09:34:24.360036 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 27 09:34:24.360036 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 27 09:34:24.360036 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 27 09:34:24.360036 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 27 09:34:24.360036 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 27 09:34:24.360036 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application Oct 27 09:34:24.363540 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 342/701] 10.222.0.65 () {56 vars in 1111 bytes} [Thu Oct 27 09:34:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 27 09:34:24.372265 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d75618-3bf1-4d02-9c1c-94a36eae3599 None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:34:24.378324 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfead00-f65b-49af-9a08-f93020d3387f None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:34:24.421401 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d77356-ca00-4d72-a4b5-59a46ae66501 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:34:24.422022 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d77356-ca00-4d72-a4b5-59a46ae66501 None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:34:24.422306 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d77356-ca00-4d72-a4b5-59a46ae66501 None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:34:24.422621 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d77356-ca00-4d72-a4b5-59a46ae66501 None admin] PATH_INFO: `/v3/services` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:34:24.423260 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d77356-ca00-4d72-a4b5-59a46ae66501 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 09:34:24.423567 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d77356-ca00-4d72-a4b5-59a46ae66501 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:34:24.425119 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d77356-ca00-4d72-a4b5-59a46ae66501 None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:34:24.436134 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 360/702] 10.222.0.65 () {56 vars in 1114 bytes} [Thu Oct 27 09:34:24 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 09:34:24.437380 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d77356-ca00-4d72-a4b5-59a46ae66501 None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:34:24.486331 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:34:24.504291 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:34:24.515633 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d75618-3bf1-4d02-9c1c-94a36eae3599 None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:34:24.548560 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d77356-ca00-4d72-a4b5-59a46ae66501 None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:34:24.557734 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a3f1e7-9ad8-46bd-944d-7e870849ccd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:34:24.558633 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a3f1e7-9ad8-46bd-944d-7e870849ccd2 None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:34:24.560041 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a3f1e7-9ad8-46bd-944d-7e870849ccd2 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:34:24.560472 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a3f1e7-9ad8-46bd-944d-7e870849ccd2 None admin] PATH_INFO: `/v3/projects` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:34:24.561428 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a3f1e7-9ad8-46bd-944d-7e870849ccd2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 09:34:24.561900 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a3f1e7-9ad8-46bd-944d-7e870849ccd2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:34:24.563705 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a3f1e7-9ad8-46bd-944d-7e870849ccd2 None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:34:24.583898 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 343/703] 10.222.0.65 () {56 vars in 1148 bytes} [Thu Oct 27 09:34:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 09:34:24.585250 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a3f1e7-9ad8-46bd-944d-7e870849ccd2 None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:34:24.587723 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f104f273-4d80-4492-87b6-317a511bf8a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:34:24.588345 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f104f273-4d80-4492-87b6-317a511bf8a4 None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:34:24.588627 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f104f273-4d80-4492-87b6-317a511bf8a4 None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:34:24.588954 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f104f273-4d80-4492-87b6-317a511bf8a4 None admin] PATH_INFO: `/v3/services` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:34:24.589588 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f104f273-4d80-4492-87b6-317a511bf8a4 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 09:34:24.589981 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f104f273-4d80-4492-87b6-317a511bf8a4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:34:24.591842 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f104f273-4d80-4492-87b6-317a511bf8a4 None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:34:24.597281 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 361/704] 10.222.0.65 () {56 vars in 1114 bytes} [Thu Oct 27 09:34:24 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 09:34:24.603206 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f104f273-4d80-4492-87b6-317a511bf8a4 None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:34:24.704516 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a3f1e7-9ad8-46bd-944d-7e870849ccd2 None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:34:24.720320 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f104f273-4d80-4492-87b6-317a511bf8a4 None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:34:24.744381 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e70c88e-dd54-4f9a-914a-ff5298a42122 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:34:24.745269 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e70c88e-dd54-4f9a-914a-ff5298a42122 None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:34:24.745699 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e70c88e-dd54-4f9a-914a-ff5298a42122 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:34:24.746152 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e70c88e-dd54-4f9a-914a-ff5298a42122 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:34:24.746589 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:34:24.748138 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e70c88e-dd54-4f9a-914a-ff5298a42122 None admin] RBAC: Adding query filter params (role.id=ed04e37a302d4d4c9d940d9dc8d11599, scope.project.id=dc2e3a7a1bcc480891c0b433291c00b1, user.id=c18a92a796934277ad64a51ef3f7bb23) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 09:34:24.748746 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e70c88e-dd54-4f9a-914a-ff5298a42122 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:34:24.750400 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e70c88e-dd54-4f9a-914a-ff5298a42122 None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:34:24.762879 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 344/705] 10.222.0.65 () {56 vars in 1374 bytes} [Thu Oct 27 09:34:24 2022] GET /identity/v3/role_assignments?user.id=c18a92a796934277ad64a51ef3f7bb23&scope.project.id=dc2e3a7a1bcc480891c0b433291c00b1&role.id=ed04e37a302d4d4c9d940d9dc8d11599 => generated 608 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 09:34:24.763683 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9543a83-e3f3-4b6d-98c4-faf9428b83ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:34:24.764320 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9543a83-e3f3-4b6d-98c4-faf9428b83ca None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:34:24.764604 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9543a83-e3f3-4b6d-98c4-faf9428b83ca None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:34:24.764936 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9543a83-e3f3-4b6d-98c4-faf9428b83ca None admin] PATH_INFO: `/v3/endpoints` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:34:24.765659 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9543a83-e3f3-4b6d-98c4-faf9428b83ca None admin] RBAC: Adding query filter params (interface=public, service_id=b6d0e565ff294b4090f691a33d10d710, region_id=RegionOne) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 09:34:24.766019 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9543a83-e3f3-4b6d-98c4-faf9428b83ca None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:34:24.767608 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9543a83-e3f3-4b6d-98c4-faf9428b83ca None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:34:24.781240 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e70c88e-dd54-4f9a-914a-ff5298a42122 None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:34:24.781683 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 362/706] 10.222.0.65 () {56 vars in 1251 bytes} [Thu Oct 27 09:34:24 2022] GET /identity/v3/endpoints?service_id=b6d0e565ff294b4090f691a33d10d710&interface=public®ion_id=RegionOne => generated 194 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 09:34:24.826838 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:34:24.907227 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e70c88e-dd54-4f9a-914a-ff5298a42122 None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:34:24.948521 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81179036-76e3-4187-a487-5cf52a4ea165 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:34:24.949138 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81179036-76e3-4187-a487-5cf52a4ea165 None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:34:24.949415 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81179036-76e3-4187-a487-5cf52a4ea165 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:34:24.949686 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81179036-76e3-4187-a487-5cf52a4ea165 None admin] PATH_INFO: `/v3/services` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:34:24.950298 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81179036-76e3-4187-a487-5cf52a4ea165 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:34:24.951837 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81179036-76e3-4187-a487-5cf52a4ea165 None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:34:24.959498 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 345/707] 10.222.0.65 () {56 vars in 1087 bytes} [Thu Oct 27 09:34:24 2022] GET /identity/v3/services => generated 1497 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 09:34:25.618826 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c4aafc-b956-4137-90f1-641905728007 None None] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:34:25.619351 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c4aafc-b956-4137-90f1-641905728007 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:34:25.619351 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c4aafc-b956-4137-90f1-641905728007 None None] PATH_INFO: `/` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:34:25.620944 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 363/708] 10.222.0.65 () {54 vars in 927 bytes} [Thu Oct 27 09:34:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 09:34:25.626712 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6231f0e4-bd8a-48e2-ac03-bc279094c561 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:34:25.627003 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6231f0e4-bd8a-48e2-ac03-bc279094c561 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:34:25.627281 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6231f0e4-bd8a-48e2-ac03-bc279094c561 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:34:25.646055 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-6231f0e4-bd8a-48e2-ac03-bc279094c561 None None] MFA Rules not processed for user `b5065084bf664b99bdeac46067cb0f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:34:25.647465 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-6231f0e4-bd8a-48e2-ac03-bc279094c561 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:34:25.713923 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:34:25.726646 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 346/709] 10.222.0.65 () {58 vars in 1024 bytes} [Thu Oct 27 09:34:25 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 27 09:34:25.976438 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c90618-4471-4415-bcb6-ddec63c0607f None None] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:34:25.976795 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c90618-4471-4415-bcb6-ddec63c0607f None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:34:25.976971 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c90618-4471-4415-bcb6-ddec63c0607f None None] PATH_INFO: `/` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:34:25.979149 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 364/710] 10.222.0.65 () {54 vars in 927 bytes} [Thu Oct 27 09:34:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 09:34:25.984510 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a87b2d3-a029-44b1-8285-c72a85cbe0c7 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:34:25.984958 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a87b2d3-a029-44b1-8285-c72a85cbe0c7 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:34:25.985034 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a87b2d3-a029-44b1-8285-c72a85cbe0c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:34:26.004108 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-6a87b2d3-a029-44b1-8285-c72a85cbe0c7 None None] MFA Rules not processed for user `b5065084bf664b99bdeac46067cb0f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:34:26.005282 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-6a87b2d3-a029-44b1-8285-c72a85cbe0c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:34:26.009810 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c90618-4471-4415-bcb6-ddec63c0607f None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:34:26.085702 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 347/711] 10.222.0.65 () {58 vars in 1024 bytes} [Thu Oct 27 09:34:25 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 27 09:34:26.127590 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c90618-4471-4415-bcb6-ddec63c0607f None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:34:26.163381 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8162e04e-0ea0-4c09-bf1c-f5ef5cdbb729 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:34:26.164011 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8162e04e-0ea0-4c09-bf1c-f5ef5cdbb729 None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:34:26.164291 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8162e04e-0ea0-4c09-bf1c-f5ef5cdbb729 None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:34:26.164560 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8162e04e-0ea0-4c09-bf1c-f5ef5cdbb729 None admin] PATH_INFO: `/v3/services/compute` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:34:26.165723 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8162e04e-0ea0-4c09-bf1c-f5ef5cdbb729 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:34:26.167131 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8162e04e-0ea0-4c09-bf1c-f5ef5cdbb729 None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:34:26.176263 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application [None req-8162e04e-0ea0-4c09-bf1c-f5ef5cdbb729 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Oct 27 09:34:26.176263 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 09:34:26.176263 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 27 09:34:26.176263 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 27 09:34:26.176263 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 27 09:34:26.176263 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 27 09:34:26.176263 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 27 09:34:26.176263 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 27 09:34:26.176263 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 27 09:34:26.176263 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application Oct 27 09:34:26.176263 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 27 09:34:26.176263 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application Oct 27 09:34:26.176263 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 09:34:26.176263 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 09:34:26.176263 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 09:34:26.176263 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 09:34:26.176263 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 09:34:26.177257 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 09:34:26.177257 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 09:34:26.177257 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 09:34:26.177257 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 09:34:26.177257 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 09:34:26.177257 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 09:34:26.177257 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 27 09:34:26.177257 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 27 09:34:26.177257 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 27 09:34:26.177257 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 27 09:34:26.177257 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 09:34:26.177257 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 09:34:26.177257 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 09:34:26.177257 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 09:34:26.177257 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 09:34:26.177257 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 09:34:26.178065 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 09:34:26.178065 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application with Lock( Oct 27 09:34:26.178065 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 09:34:26.178065 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._enter() Oct 27 09:34:26.178065 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 09:34:26.178065 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 09:34:26.178065 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 09:34:26.178065 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.creator() Oct 27 09:34:26.178065 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 09:34:26.178065 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application created_value = creator( Oct 27 09:34:26.178065 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 27 09:34:26.178065 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 27 09:34:26.178065 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 27 09:34:26.178065 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application Oct 27 09:34:26.178065 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 365/712] 10.222.0.65 () {56 vars in 1111 bytes} [Thu Oct 27 09:34:26 2022] GET /identity/v3/services/compute => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 09:34:26.186153 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a87b2d3-a029-44b1-8285-c72a85cbe0c7 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:34:26.293218 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a87b2d3-a029-44b1-8285-c72a85cbe0c7 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:34:26.322282 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:34:26.330811 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9401cca-8da8-43ae-936f-a2ed6929be21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:34:26.331727 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9401cca-8da8-43ae-936f-a2ed6929be21 None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:34:26.332203 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9401cca-8da8-43ae-936f-a2ed6929be21 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:34:26.332654 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9401cca-8da8-43ae-936f-a2ed6929be21 None admin] PATH_INFO: `/v3/services` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:34:26.333464 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9401cca-8da8-43ae-936f-a2ed6929be21 None admin] RBAC: Adding query filter params (name=compute) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 09:34:26.333929 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9401cca-8da8-43ae-936f-a2ed6929be21 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:34:26.335464 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9401cca-8da8-43ae-936f-a2ed6929be21 None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:34:26.340823 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 348/713] 10.222.0.65 () {56 vars in 1112 bytes} [Thu Oct 27 09:34:26 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 09:34:26.346675 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8162e04e-0ea0-4c09-bf1c-f5ef5cdbb729 None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:34:26.359075 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9401cca-8da8-43ae-936f-a2ed6929be21 None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:34:26.403389 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:34:26.459193 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8162e04e-0ea0-4c09-bf1c-f5ef5cdbb729 None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:34:26.488846 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9401cca-8da8-43ae-936f-a2ed6929be21 None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:34:26.506583 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d100eba7-404f-4480-851f-2a92f6a2a5ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:34:26.507199 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d100eba7-404f-4480-851f-2a92f6a2a5ff None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:34:26.510539 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d100eba7-404f-4480-851f-2a92f6a2a5ff None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:34:26.510539 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d100eba7-404f-4480-851f-2a92f6a2a5ff None admin] PATH_INFO: `/v3/services` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:34:26.510539 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d100eba7-404f-4480-851f-2a92f6a2a5ff None admin] RBAC: Adding query filter params (type=compute) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 09:34:26.510539 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d100eba7-404f-4480-851f-2a92f6a2a5ff None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:34:26.511169 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d100eba7-404f-4480-851f-2a92f6a2a5ff None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:34:26.516623 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 366/714] 10.222.0.65 () {56 vars in 1112 bytes} [Thu Oct 27 09:34:26 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 09:34:26.533847 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd05e098-f1d7-4edd-8158-fc495f2365f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:34:26.534501 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd05e098-f1d7-4edd-8158-fc495f2365f5 None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:34:26.534830 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd05e098-f1d7-4edd-8158-fc495f2365f5 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:34:26.535101 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd05e098-f1d7-4edd-8158-fc495f2365f5 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:34:26.535693 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd05e098-f1d7-4edd-8158-fc495f2365f5 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:34:26.537090 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd05e098-f1d7-4edd-8158-fc495f2365f5 None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:34:26.547333 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application [None req-cd05e098-f1d7-4edd-8158-fc495f2365f5 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 27 09:34:26.547333 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 09:34:26.547333 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 27 09:34:26.547333 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 27 09:34:26.547333 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 27 09:34:26.547333 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 27 09:34:26.547333 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 27 09:34:26.547333 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 27 09:34:26.547333 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 27 09:34:26.547333 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application Oct 27 09:34:26.547333 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 27 09:34:26.547333 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application Oct 27 09:34:26.547333 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 09:34:26.547333 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 09:34:26.547333 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 09:34:26.547333 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 09:34:26.547333 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 09:34:26.548451 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 09:34:26.548451 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 09:34:26.548451 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 09:34:26.548451 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 09:34:26.548451 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 09:34:26.548451 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 09:34:26.548451 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 27 09:34:26.548451 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 27 09:34:26.548451 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 27 09:34:26.548451 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 27 09:34:26.548451 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 09:34:26.548451 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 09:34:26.548451 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 09:34:26.548451 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 09:34:26.548451 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 09:34:26.548451 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 09:34:26.549274 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 09:34:26.549274 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application with Lock( Oct 27 09:34:26.549274 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 09:34:26.549274 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._enter() Oct 27 09:34:26.549274 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 09:34:26.549274 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 09:34:26.549274 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 09:34:26.549274 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.creator() Oct 27 09:34:26.549274 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 09:34:26.549274 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application created_value = creator( Oct 27 09:34:26.549274 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 27 09:34:26.549274 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 27 09:34:26.549274 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 27 09:34:26.549274 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application Oct 27 09:34:26.549274 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 349/715] 10.222.0.65 () {56 vars in 1126 bytes} [Thu Oct 27 09:34:26 2022] GET /identity/v3/services/object-store => generated 93 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 27 09:34:26.557203 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d100eba7-404f-4480-851f-2a92f6a2a5ff None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:34:26.678987 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d100eba7-404f-4480-851f-2a92f6a2a5ff None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:34:26.695016 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:34:26.719530 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651b2560-417a-4ccb-903e-34496a223c6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:34:26.719769 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651b2560-417a-4ccb-903e-34496a223c6d None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:34:26.720010 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651b2560-417a-4ccb-903e-34496a223c6d None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:34:26.720319 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651b2560-417a-4ccb-903e-34496a223c6d None admin] PATH_INFO: `/v3/services` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:34:26.720963 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651b2560-417a-4ccb-903e-34496a223c6d None admin] RBAC: Adding query filter params (name=object-store) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 09:34:26.721264 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651b2560-417a-4ccb-903e-34496a223c6d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:34:26.722709 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651b2560-417a-4ccb-903e-34496a223c6d None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:34:26.729056 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 367/716] 10.222.0.65 () {56 vars in 1122 bytes} [Thu Oct 27 09:34:26 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 09:34:26.734588 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd05e098-f1d7-4edd-8158-fc495f2365f5 None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:34:26.804364 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:34:26.855451 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd05e098-f1d7-4edd-8158-fc495f2365f5 None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:34:26.894652 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91aafad9-4d96-4328-ab16-139a60d8595e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:34:26.895266 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91aafad9-4d96-4328-ab16-139a60d8595e None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:34:26.895548 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91aafad9-4d96-4328-ab16-139a60d8595e None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:34:26.895820 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91aafad9-4d96-4328-ab16-139a60d8595e None admin] PATH_INFO: `/v3/services` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:34:26.896453 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91aafad9-4d96-4328-ab16-139a60d8595e None admin] RBAC: Adding query filter params (type=object-store) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 09:34:26.896754 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91aafad9-4d96-4328-ab16-139a60d8595e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:34:26.898200 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91aafad9-4d96-4328-ab16-139a60d8595e None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:34:26.903893 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 350/717] 10.222.0.65 () {56 vars in 1122 bytes} [Thu Oct 27 09:34:26 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 09:34:26.909712 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651b2560-417a-4ccb-903e-34496a223c6d None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:34:27.020583 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651b2560-417a-4ccb-903e-34496a223c6d None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:34:27.058989 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90985a57-5066-42c5-9df1-43cbd05450d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:34:27.059520 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90985a57-5066-42c5-9df1-43cbd05450d3 None admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:34:27.059797 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90985a57-5066-42c5-9df1-43cbd05450d3 None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:34:27.060068 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90985a57-5066-42c5-9df1-43cbd05450d3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:34:27.060740 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90985a57-5066-42c5-9df1-43cbd05450d3 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:34:27.062189 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90985a57-5066-42c5-9df1-43cbd05450d3 None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:34:27.100320 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ce71af-7d29-4ce1-9511-ef89a4c1c06c None None] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:34:27.100862 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ce71af-7d29-4ce1-9511-ef89a4c1c06c None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:34:27.100862 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ce71af-7d29-4ce1-9511-ef89a4c1c06c None None] PATH_INFO: `/` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:34:27.103006 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 351/718] 10.222.0.65 () {54 vars in 927 bytes} [Thu Oct 27 09:34:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 09:34:27.109971 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae282113-8ac1-432b-bd2c-13df43011374 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:34:27.110321 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae282113-8ac1-432b-bd2c-13df43011374 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:34:27.110696 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae282113-8ac1-432b-bd2c-13df43011374 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:34:27.131596 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-ae282113-8ac1-432b-bd2c-13df43011374 None None] MFA Rules not processed for user `b5065084bf664b99bdeac46067cb0f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:34:27.132896 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-ae282113-8ac1-432b-bd2c-13df43011374 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:34:27.165248 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 368/719] 10.222.0.65 () {60 vars in 1144 bytes} [Thu Oct 27 09:34:26 2022] POST /identity/v3/endpoints => generated 349 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 09:34:27.232615 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 352/720] 10.222.0.65 () {58 vars in 1024 bytes} [Thu Oct 27 09:34:27 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 27 09:34:27.317453 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b7bdca-97b4-4658-b5af-96465fc76634 None None] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:34:27.317634 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b7bdca-97b4-4658-b5af-96465fc76634 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:34:27.317915 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b7bdca-97b4-4658-b5af-96465fc76634 None None] PATH_INFO: `/` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:34:27.319605 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 369/721] 10.222.0.65 () {54 vars in 927 bytes} [Thu Oct 27 09:34:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 09:34:27.325583 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784913d3-18a0-428c-b34f-3db666b3265e None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:34:27.325911 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784913d3-18a0-428c-b34f-3db666b3265e None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:34:27.326174 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784913d3-18a0-428c-b34f-3db666b3265e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:34:27.346074 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-784913d3-18a0-428c-b34f-3db666b3265e None None] MFA Rules not processed for user `b5065084bf664b99bdeac46067cb0f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:34:27.347336 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-784913d3-18a0-428c-b34f-3db666b3265e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:34:27.399913 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:34:27.426140 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 353/722] 10.222.0.65 () {58 vars in 1024 bytes} [Thu Oct 27 09:34:27 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 27 09:34:27.528300 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b7bdca-97b4-4658-b5af-96465fc76634 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:34:27.566476 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:34:27.641048 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b7bdca-97b4-4658-b5af-96465fc76634 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:34:27.677511 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17038352-cc61-4461-8a09-da25b5b052ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:34:27.678149 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17038352-cc61-4461-8a09-da25b5b052ff None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:34:27.678728 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17038352-cc61-4461-8a09-da25b5b052ff None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:34:27.679003 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17038352-cc61-4461-8a09-da25b5b052ff None admin] PATH_INFO: `/v3/services/image` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:34:27.679584 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17038352-cc61-4461-8a09-da25b5b052ff None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:34:27.681837 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17038352-cc61-4461-8a09-da25b5b052ff None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:34:27.691263 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application [None req-17038352-cc61-4461-8a09-da25b5b052ff None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Oct 27 09:34:27.691263 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 09:34:27.691263 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 27 09:34:27.691263 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 27 09:34:27.691263 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 27 09:34:27.691263 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 27 09:34:27.691263 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 27 09:34:27.691263 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 27 09:34:27.691263 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 27 09:34:27.691263 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application Oct 27 09:34:27.691263 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 27 09:34:27.691263 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application Oct 27 09:34:27.691263 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 09:34:27.691263 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 09:34:27.691263 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 09:34:27.691263 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 09:34:27.691263 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 09:34:27.692246 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 09:34:27.692246 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 09:34:27.692246 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 09:34:27.692246 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 09:34:27.692246 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 09:34:27.692246 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 09:34:27.692246 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 27 09:34:27.692246 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 27 09:34:27.692246 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 27 09:34:27.692246 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 27 09:34:27.692246 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 09:34:27.692246 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 09:34:27.692246 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 09:34:27.692246 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 09:34:27.692246 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 09:34:27.692246 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 09:34:27.693069 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 09:34:27.693069 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application with Lock( Oct 27 09:34:27.693069 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 09:34:27.693069 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._enter() Oct 27 09:34:27.693069 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 09:34:27.693069 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 09:34:27.693069 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 09:34:27.693069 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.creator() Oct 27 09:34:27.693069 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 09:34:27.693069 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application created_value = creator( Oct 27 09:34:27.693069 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 27 09:34:27.693069 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 27 09:34:27.693069 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 27 09:34:27.693069 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application Oct 27 09:34:27.693069 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 370/723] 10.222.0.65 () {56 vars in 1105 bytes} [Thu Oct 27 09:34:27 2022] GET /identity/v3/services/image => generated 86 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 09:34:27.698324 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784913d3-18a0-428c-b34f-3db666b3265e None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:34:27.711707 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17038352-cc61-4461-8a09-da25b5b052ff None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:34:27.823234 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:34:27.827585 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17038352-cc61-4461-8a09-da25b5b052ff None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:34:27.827840 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784913d3-18a0-428c-b34f-3db666b3265e None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:34:27.871263 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91f692a-01d3-4dba-82a9-d787e847a6b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:34:27.872284 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91f692a-01d3-4dba-82a9-d787e847a6b1 None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:34:27.872823 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91f692a-01d3-4dba-82a9-d787e847a6b1 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:34:27.873332 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91f692a-01d3-4dba-82a9-d787e847a6b1 None admin] PATH_INFO: `/v3/services` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:34:27.874220 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91f692a-01d3-4dba-82a9-d787e847a6b1 None admin] RBAC: Adding query filter params (name=image) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 09:34:27.874722 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91f692a-01d3-4dba-82a9-d787e847a6b1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:34:27.876360 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91f692a-01d3-4dba-82a9-d787e847a6b1 None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:34:27.881829 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e85d55-3650-4be8-8685-7e3c5da79d79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:34:27.886717 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e85d55-3650-4be8-8685-7e3c5da79d79 None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:34:27.886717 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e85d55-3650-4be8-8685-7e3c5da79d79 None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:34:27.886717 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e85d55-3650-4be8-8685-7e3c5da79d79 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:34:27.886717 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e85d55-3650-4be8-8685-7e3c5da79d79 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:34:27.886717 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e85d55-3650-4be8-8685-7e3c5da79d79 None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:34:27.887514 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 354/724] 10.222.0.65 () {56 vars in 1108 bytes} [Thu Oct 27 09:34:27 2022] GET /identity/v3/services?name=image => generated 122 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 09:34:27.890058 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91f692a-01d3-4dba-82a9-d787e847a6b1 None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:34:27.895859 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application [None req-38e85d55-3650-4be8-8685-7e3c5da79d79 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 27 09:34:27.895859 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 09:34:27.895859 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 27 09:34:27.895859 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 27 09:34:27.895859 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 27 09:34:27.895859 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 27 09:34:27.895859 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 27 09:34:27.895859 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 27 09:34:27.895859 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 27 09:34:27.895859 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application Oct 27 09:34:27.895859 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 27 09:34:27.895859 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application Oct 27 09:34:27.895859 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 09:34:27.895859 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 09:34:27.895859 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 09:34:27.895859 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 09:34:27.895859 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 09:34:27.896818 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 09:34:27.896818 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 09:34:27.896818 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 09:34:27.896818 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 09:34:27.896818 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 09:34:27.896818 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 09:34:27.896818 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 27 09:34:27.896818 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 27 09:34:27.896818 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 27 09:34:27.896818 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 27 09:34:27.896818 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 09:34:27.896818 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 09:34:27.896818 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 09:34:27.896818 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 09:34:27.896818 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 09:34:27.896818 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 09:34:27.897646 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 09:34:27.897646 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application with Lock( Oct 27 09:34:27.897646 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 09:34:27.897646 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._enter() Oct 27 09:34:27.897646 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 09:34:27.897646 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 09:34:27.897646 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 09:34:27.897646 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.creator() Oct 27 09:34:27.897646 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 09:34:27.897646 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application created_value = creator( Oct 27 09:34:27.897646 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 27 09:34:27.897646 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 27 09:34:27.897646 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 27 09:34:27.897646 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application Oct 27 09:34:27.897646 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 371/725] 10.222.0.65 () {56 vars in 1114 bytes} [Thu Oct 27 09:34:27 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 27 09:34:27.903805 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e85d55-3650-4be8-8685-7e3c5da79d79 None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:34:27.941238 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:34:28.006810 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91f692a-01d3-4dba-82a9-d787e847a6b1 None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:34:28.015781 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e85d55-3650-4be8-8685-7e3c5da79d79 None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:34:28.046480 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd9006d-e624-46dc-b8bc-ee42daca307e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:34:28.047274 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd9006d-e624-46dc-b8bc-ee42daca307e None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:34:28.047648 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd9006d-e624-46dc-b8bc-ee42daca307e None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:34:28.048111 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd9006d-e624-46dc-b8bc-ee42daca307e None admin] PATH_INFO: `/v3/services` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:34:28.048860 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd9006d-e624-46dc-b8bc-ee42daca307e None admin] RBAC: Adding query filter params (type=image) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 09:34:28.049386 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd9006d-e624-46dc-b8bc-ee42daca307e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:34:28.050786 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd9006d-e624-46dc-b8bc-ee42daca307e None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:34:28.054742 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfc5427-b457-445f-81fc-9f1fa169b711 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:34:28.056061 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfc5427-b457-445f-81fc-9f1fa169b711 None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:34:28.056635 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfc5427-b457-445f-81fc-9f1fa169b711 None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:34:28.057143 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfc5427-b457-445f-81fc-9f1fa169b711 None admin] PATH_INFO: `/v3/services` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:34:28.057988 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfc5427-b457-445f-81fc-9f1fa169b711 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 09:34:28.058494 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfc5427-b457-445f-81fc-9f1fa169b711 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:34:28.060149 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfc5427-b457-445f-81fc-9f1fa169b711 None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:34:28.061841 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 355/726] 10.222.0.65 () {56 vars in 1108 bytes} [Thu Oct 27 09:34:27 2022] GET /identity/v3/services?type=image => generated 122 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 09:34:28.071902 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 372/727] 10.222.0.65 () {56 vars in 1114 bytes} [Thu Oct 27 09:34:27 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 09:34:28.073025 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd9006d-e624-46dc-b8bc-ee42daca307e None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:34:28.192235 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd9006d-e624-46dc-b8bc-ee42daca307e None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:34:28.200987 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:34:28.232590 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78dd4055-a018-48d2-81d3-daadf4296b25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:34:28.233212 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dd4055-a018-48d2-81d3-daadf4296b25 None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:34:28.233492 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dd4055-a018-48d2-81d3-daadf4296b25 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:34:28.233762 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dd4055-a018-48d2-81d3-daadf4296b25 None admin] PATH_INFO: `/v3/services` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:34:28.234498 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78dd4055-a018-48d2-81d3-daadf4296b25 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 09:34:28.235500 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78dd4055-a018-48d2-81d3-daadf4296b25 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:34:28.237298 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78dd4055-a018-48d2-81d3-daadf4296b25 None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:34:28.244987 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 356/728] 10.222.0.65 () {56 vars in 1114 bytes} [Thu Oct 27 09:34:28 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 09:34:28.250737 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfc5427-b457-445f-81fc-9f1fa169b711 None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:34:28.282625 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:34:28.364714 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfc5427-b457-445f-81fc-9f1fa169b711 None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:34:28.402647 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c52d483-084f-4375-94b9-379132969ffe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:34:28.403303 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c52d483-084f-4375-94b9-379132969ffe None admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:34:28.403581 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c52d483-084f-4375-94b9-379132969ffe None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:34:28.403851 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c52d483-084f-4375-94b9-379132969ffe None admin] PATH_INFO: `/v3/endpoints` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:34:28.404513 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c52d483-084f-4375-94b9-379132969ffe None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:34:28.405885 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c52d483-084f-4375-94b9-379132969ffe None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:34:28.486314 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 373/729] 10.222.0.65 () {60 vars in 1144 bytes} [Thu Oct 27 09:34:28 2022] POST /identity/v3/endpoints => generated 346 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 09:34:28.846067 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb242953-a305-4678-9730-77e5c2cd56be None None] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:34:28.848100 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb242953-a305-4678-9730-77e5c2cd56be None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:34:28.848588 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb242953-a305-4678-9730-77e5c2cd56be None None] PATH_INFO: `/` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:34:28.856245 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 357/730] 10.222.0.65 () {54 vars in 927 bytes} [Thu Oct 27 09:34:28 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 09:34:28.858120 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8123b7-006b-483f-b2da-3934fb46c8b5 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:34:28.858962 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8123b7-006b-483f-b2da-3934fb46c8b5 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:34:28.859436 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8123b7-006b-483f-b2da-3934fb46c8b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:34:28.882071 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-4a8123b7-006b-483f-b2da-3934fb46c8b5 None None] MFA Rules not processed for user `b5065084bf664b99bdeac46067cb0f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:34:28.884275 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-4a8123b7-006b-483f-b2da-3934fb46c8b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:34:28.967055 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 374/731] 10.222.0.65 () {58 vars in 1024 bytes} [Thu Oct 27 09:34:28 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 27 09:34:29.240903 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb242953-a305-4678-9730-77e5c2cd56be None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:34:29.362011 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb242953-a305-4678-9730-77e5c2cd56be None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:34:29.405061 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b660da9c-ded0-4180-b41c-2799554d5408 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:34:29.405680 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b660da9c-ded0-4180-b41c-2799554d5408 None admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:34:29.405964 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b660da9c-ded0-4180-b41c-2799554d5408 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:34:29.406247 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b660da9c-ded0-4180-b41c-2799554d5408 None admin] PATH_INFO: `/v3/services` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:34:29.406946 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b660da9c-ded0-4180-b41c-2799554d5408 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:34:29.408329 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b660da9c-ded0-4180-b41c-2799554d5408 None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:34:29.486123 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e3e300-a7d8-40f2-a7c4-9382f2baca29 None None] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:34:29.486763 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e3e300-a7d8-40f2-a7c4-9382f2baca29 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:34:29.486973 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e3e300-a7d8-40f2-a7c4-9382f2baca29 None None] PATH_INFO: `/` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:34:29.488509 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 375/732] 10.222.0.65 () {54 vars in 927 bytes} [Thu Oct 27 09:34:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 27 09:34:29.506667 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a025cd6-8f08-44fa-8dff-30999f6a0483 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:34:29.506667 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a025cd6-8f08-44fa-8dff-30999f6a0483 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:34:29.506667 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a025cd6-8f08-44fa-8dff-30999f6a0483 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:34:29.506996 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 358/733] 10.222.0.65 () {60 vars in 1141 bytes} [Thu Oct 27 09:34:29 2022] POST /identity/v3/services => generated 242 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 09:34:29.518945 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-7a025cd6-8f08-44fa-8dff-30999f6a0483 None None] MFA Rules not processed for user `b5065084bf664b99bdeac46067cb0f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:34:29.520230 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-7a025cd6-8f08-44fa-8dff-30999f6a0483 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:34:29.523046 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:34:29.611755 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 376/734] 10.222.0.65 () {58 vars in 1024 bytes} [Thu Oct 27 09:34:29 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 27 09:34:29.898567 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b660da9c-ded0-4180-b41c-2799554d5408 None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:34:29.931935 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:34:30.017072 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b660da9c-ded0-4180-b41c-2799554d5408 None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:34:30.058903 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3568fddc-4b8a-4780-bd81-18f5ee1e285a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:34:30.060100 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3568fddc-4b8a-4780-bd81-18f5ee1e285a None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:34:30.060614 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3568fddc-4b8a-4780-bd81-18f5ee1e285a None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:34:30.061090 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3568fddc-4b8a-4780-bd81-18f5ee1e285a None admin] PATH_INFO: `/v3/services/object-store` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:34:30.061877 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3568fddc-4b8a-4780-bd81-18f5ee1e285a None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:34:30.063469 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3568fddc-4b8a-4780-bd81-18f5ee1e285a None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:34:30.073567 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application [None req-3568fddc-4b8a-4780-bd81-18f5ee1e285a None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 27 09:34:30.073567 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 09:34:30.073567 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 27 09:34:30.073567 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 27 09:34:30.073567 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 27 09:34:30.073567 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 27 09:34:30.073567 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 27 09:34:30.073567 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 27 09:34:30.073567 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 27 09:34:30.073567 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application Oct 27 09:34:30.073567 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 27 09:34:30.073567 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application Oct 27 09:34:30.073567 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 09:34:30.073567 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 09:34:30.073567 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 09:34:30.073567 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 09:34:30.073567 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 09:34:30.074599 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 09:34:30.074599 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 09:34:30.074599 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 09:34:30.074599 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 09:34:30.074599 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 09:34:30.074599 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 09:34:30.074599 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 27 09:34:30.074599 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 27 09:34:30.074599 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 27 09:34:30.074599 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 27 09:34:30.074599 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 09:34:30.074599 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 09:34:30.074599 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 09:34:30.074599 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 09:34:30.074599 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 09:34:30.074599 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 09:34:30.075434 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 09:34:30.075434 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application with Lock( Oct 27 09:34:30.075434 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 09:34:30.075434 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._enter() Oct 27 09:34:30.075434 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 09:34:30.075434 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 09:34:30.075434 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 09:34:30.075434 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.creator() Oct 27 09:34:30.075434 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 09:34:30.075434 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application created_value = creator( Oct 27 09:34:30.075434 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 27 09:34:30.075434 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 27 09:34:30.075434 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 27 09:34:30.075434 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application Oct 27 09:34:30.078099 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 359/735] 10.222.0.65 () {56 vars in 1126 bytes} [Thu Oct 27 09:34:29 2022] GET /identity/v3/services/object-store => generated 93 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 09:34:30.084004 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a025cd6-8f08-44fa-8dff-30999f6a0483 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:34:30.192204 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a025cd6-8f08-44fa-8dff-30999f6a0483 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:34:30.228986 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f4320b-31e2-469a-88ba-1e83b4c0b38e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:34:30.229613 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f4320b-31e2-469a-88ba-1e83b4c0b38e None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:34:30.229896 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f4320b-31e2-469a-88ba-1e83b4c0b38e None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:34:30.230173 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f4320b-31e2-469a-88ba-1e83b4c0b38e None admin] PATH_INFO: `/v3/services` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:34:30.230840 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f4320b-31e2-469a-88ba-1e83b4c0b38e None admin] RBAC: Adding query filter params (name=object-store) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 09:34:30.231149 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f4320b-31e2-469a-88ba-1e83b4c0b38e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:34:30.232526 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f4320b-31e2-469a-88ba-1e83b4c0b38e None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:34:30.234832 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:34:30.238938 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 377/736] 10.222.0.65 () {56 vars in 1122 bytes} [Thu Oct 27 09:34:30 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 09:34:30.245180 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3568fddc-4b8a-4780-bd81-18f5ee1e285a None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:34:30.356510 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:34:30.366198 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3568fddc-4b8a-4780-bd81-18f5ee1e285a None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:34:30.377593 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84b2b9e-dfd3-4dc4-b9de-92833668ecdb None None] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:34:30.378195 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84b2b9e-dfd3-4dc4-b9de-92833668ecdb None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:34:30.378724 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84b2b9e-dfd3-4dc4-b9de-92833668ecdb None None] PATH_INFO: `/` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:34:30.380572 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 378/737] 10.222.0.65 () {54 vars in 927 bytes} [Thu Oct 27 09:34:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 09:34:30.387099 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01eaec8-d59e-478f-8544-06649e62b7b1 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:34:30.387703 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01eaec8-d59e-478f-8544-06649e62b7b1 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:34:30.388176 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01eaec8-d59e-478f-8544-06649e62b7b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:34:30.405623 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb06deb-e54c-4f10-8023-6f53563ffd85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:34:30.406240 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb06deb-e54c-4f10-8023-6f53563ffd85 None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:34:30.406551 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb06deb-e54c-4f10-8023-6f53563ffd85 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:34:30.406828 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb06deb-e54c-4f10-8023-6f53563ffd85 None admin] PATH_INFO: `/v3/services` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:34:30.407527 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb06deb-e54c-4f10-8023-6f53563ffd85 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 09:34:30.407841 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb06deb-e54c-4f10-8023-6f53563ffd85 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:34:30.409548 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-e01eaec8-d59e-478f-8544-06649e62b7b1 None None] MFA Rules not processed for user `b5065084bf664b99bdeac46067cb0f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:34:30.410402 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb06deb-e54c-4f10-8023-6f53563ffd85 None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:34:30.411195 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-e01eaec8-d59e-478f-8544-06649e62b7b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:34:30.416902 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 360/738] 10.222.0.65 () {56 vars in 1122 bytes} [Thu Oct 27 09:34:30 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 09:34:30.424265 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb06deb-e54c-4f10-8023-6f53563ffd85 None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:34:30.514671 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 379/739] 10.222.0.65 () {58 vars in 1024 bytes} [Thu Oct 27 09:34:30 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 27 09:34:30.554606 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb06deb-e54c-4f10-8023-6f53563ffd85 None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:34:30.591404 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f32e41-5407-4a8a-85aa-eece8ccd62d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:34:30.593523 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f32e41-5407-4a8a-85aa-eece8ccd62d1 None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:34:30.593523 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f32e41-5407-4a8a-85aa-eece8ccd62d1 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:34:30.593523 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f32e41-5407-4a8a-85aa-eece8ccd62d1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:34:30.593785 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f32e41-5407-4a8a-85aa-eece8ccd62d1 None admin] RBAC: Adding query filter params (interface=admin, service_id=895719fe19664df48f4bdc52cf441355, region_id=RegionOne) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 09:34:30.593865 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f32e41-5407-4a8a-85aa-eece8ccd62d1 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:34:30.595379 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f32e41-5407-4a8a-85aa-eece8ccd62d1 None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:34:30.601086 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 361/740] 10.222.0.65 () {56 vars in 1249 bytes} [Thu Oct 27 09:34:30 2022] GET /identity/v3/endpoints?service_id=895719fe19664df48f4bdc52cf441355&interface=admin®ion_id=RegionOne => generated 193 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 09:34:30.607169 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01eaec8-d59e-478f-8544-06649e62b7b1 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:34:30.717739 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01eaec8-d59e-478f-8544-06649e62b7b1 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:34:30.746937 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:34:30.749185 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cef9ca7-e551-48db-9063-b1477ac275aa None None] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:34:30.749467 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cef9ca7-e551-48db-9063-b1477ac275aa None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:34:30.750067 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cef9ca7-e551-48db-9063-b1477ac275aa None None] PATH_INFO: `/` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:34:30.752419 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 362/741] 10.222.0.65 () {54 vars in 927 bytes} [Thu Oct 27 09:34:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 09:34:30.757695 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f82e8f-4ffc-4044-a10f-2895413a4c24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:34:30.759317 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a15768f-c578-457b-ad23-34d2cd3ade46 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:34:30.759317 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a15768f-c578-457b-ad23-34d2cd3ade46 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:34:30.759317 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a15768f-c578-457b-ad23-34d2cd3ade46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:34:30.759582 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f82e8f-4ffc-4044-a10f-2895413a4c24 None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:34:30.759582 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f82e8f-4ffc-4044-a10f-2895413a4c24 None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:34:30.759582 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f82e8f-4ffc-4044-a10f-2895413a4c24 None admin] PATH_INFO: `/v3/services` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:34:30.759947 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f82e8f-4ffc-4044-a10f-2895413a4c24 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:34:30.761307 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f82e8f-4ffc-4044-a10f-2895413a4c24 None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:34:30.768685 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 380/742] 10.222.0.65 () {56 vars in 1087 bytes} [Thu Oct 27 09:34:30 2022] GET /identity/v3/services => generated 1727 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 09:34:30.777878 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-6a15768f-c578-457b-ad23-34d2cd3ade46 None None] MFA Rules not processed for user `b5065084bf664b99bdeac46067cb0f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:34:30.779541 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-6a15768f-c578-457b-ad23-34d2cd3ade46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:34:30.797910 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:34:30.809152 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f82e8f-4ffc-4044-a10f-2895413a4c24 None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:34:30.878292 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 363/743] 10.222.0.65 () {58 vars in 1024 bytes} [Thu Oct 27 09:34:30 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 27 09:34:30.946822 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f82e8f-4ffc-4044-a10f-2895413a4c24 None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:34:30.987978 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae725a9d-b71d-427a-89d8-f9347fef06d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:34:30.988594 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae725a9d-b71d-427a-89d8-f9347fef06d8 None admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:34:30.988876 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae725a9d-b71d-427a-89d8-f9347fef06d8 None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:34:30.989154 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae725a9d-b71d-427a-89d8-f9347fef06d8 None admin] PATH_INFO: `/v3/services` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:34:30.989811 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae725a9d-b71d-427a-89d8-f9347fef06d8 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:34:30.991230 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae725a9d-b71d-427a-89d8-f9347fef06d8 None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:34:31.086701 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 381/744] 10.222.0.65 () {60 vars in 1141 bytes} [Thu Oct 27 09:34:30 2022] POST /identity/v3/services => generated 242 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 09:34:31.154118 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a15768f-c578-457b-ad23-34d2cd3ade46 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:34:31.266407 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a15768f-c578-457b-ad23-34d2cd3ade46 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:34:31.314067 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55e4f79-70e1-4ee7-8a60-76dad9da8612 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:34:31.314712 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55e4f79-70e1-4ee7-8a60-76dad9da8612 None admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:34:31.314988 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55e4f79-70e1-4ee7-8a60-76dad9da8612 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:34:31.315258 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55e4f79-70e1-4ee7-8a60-76dad9da8612 None admin] PATH_INFO: `/v3/projects` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:34:31.315889 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55e4f79-70e1-4ee7-8a60-76dad9da8612 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:34:31.317299 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55e4f79-70e1-4ee7-8a60-76dad9da8612 None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:34:31.320189 dv-cinder-797970-7-smb devstack@keystone.service[88312]: WARNING keystone.server.flask.common [None req-a55e4f79-70e1-4ee7-8a60-76dad9da8612 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Oct 27 09:34:31.381716 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.sql.core [None req-a55e4f79-70e1-4ee7-8a60-76dad9da8612 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Oct 27 09:34:31.381716 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 27 09:34:31.381716 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [parameters: {'id': '5ba2927b8fd545f085ceb07096722858', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Oct 27 09:34:31.381716 dv-cinder-797970-7-smb devstack@keystone.service[88312]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=88312) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 27 09:34:31.390408 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application [None req-a55e4f79-70e1-4ee7-8a60-76dad9da8612 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 5ba2927b8fd545f085ceb07096722858.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 5ba2927b8fd545f085ceb07096722858. Oct 27 09:34:31.390408 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 09:34:31.390408 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 27 09:34:31.390408 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 27 09:34:31.390408 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 27 09:34:31.390408 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 27 09:34:31.390408 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 27 09:34:31.390408 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application result = self._query(query) Oct 27 09:34:31.390408 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 27 09:34:31.390408 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application conn.query(q) Oct 27 09:34:31.390408 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 27 09:34:31.390408 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 27 09:34:31.390408 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 27 09:34:31.391359 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application result.read() Oct 27 09:34:31.391359 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 27 09:34:31.391359 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 27 09:34:31.391359 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 27 09:34:31.391359 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 27 09:34:31.391359 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 27 09:34:31.391359 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 27 09:34:31.391359 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 27 09:34:31.391359 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 27 09:34:31.391359 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Oct 27 09:34:31.391359 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application Oct 27 09:34:31.391359 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 27 09:34:31.391359 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application Oct 27 09:34:31.391359 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 09:34:31.391359 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 27 09:34:31.391359 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 27 09:34:31.391359 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Oct 27 09:34:31.391359 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return project_ref.to_dict() Oct 27 09:34:31.392323 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 27 09:34:31.392323 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application next(self.gen) Oct 27 09:34:31.392323 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1068, in _transaction_scope Oct 27 09:34:31.392323 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application yield resource Oct 27 09:34:31.392323 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 27 09:34:31.392323 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application next(self.gen) Oct 27 09:34:31.392323 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 670, in _session Oct 27 09:34:31.392323 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application self.session.rollback() Oct 27 09:34:31.392323 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 27 09:34:31.392323 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application self.force_reraise() Oct 27 09:34:31.392323 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 27 09:34:31.392323 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application raise self.value Oct 27 09:34:31.392323 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 667, in _session Oct 27 09:34:31.392323 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 27 09:34:31.392323 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 695, in _end_session_transaction Oct 27 09:34:31.392323 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application session.commit() Oct 27 09:34:31.392323 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 27 09:34:31.393221 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 27 09:34:31.393221 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 27 09:34:31.393221 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application self._prepare_impl() Oct 27 09:34:31.393221 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 27 09:34:31.393221 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application self.session.flush() Oct 27 09:34:31.393221 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 27 09:34:31.393221 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application self._flush(objects) Oct 27 09:34:31.393221 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 27 09:34:31.393221 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 27 09:34:31.393221 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 27 09:34:31.393221 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application compat.raise_( Oct 27 09:34:31.393221 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 27 09:34:31.393221 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application raise exception Oct 27 09:34:31.393221 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 27 09:34:31.393221 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application flush_context.execute() Oct 27 09:34:31.393221 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 27 09:34:31.393221 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application rec.execute(self) Oct 27 09:34:31.394122 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 27 09:34:31.394122 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 27 09:34:31.394122 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 27 09:34:31.394122 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 27 09:34:31.394122 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Oct 27 09:34:31.394122 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application c = connection._execute_20( Oct 27 09:34:31.394122 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 27 09:34:31.394122 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 27 09:34:31.394122 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 27 09:34:31.394122 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 27 09:34:31.394122 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 27 09:34:31.394122 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 27 09:34:31.394122 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 27 09:34:31.394122 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 27 09:34:31.394122 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 27 09:34:31.394955 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 27 09:34:31.394955 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 27 09:34:31.394955 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application raise exception Oct 27 09:34:31.394955 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 27 09:34:31.394955 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 27 09:34:31.394955 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 27 09:34:31.394955 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 27 09:34:31.394955 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 27 09:34:31.394955 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application result = self._query(query) Oct 27 09:34:31.394955 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 27 09:34:31.394955 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application conn.query(q) Oct 27 09:34:31.394955 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 27 09:34:31.394955 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 27 09:34:31.394955 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 27 09:34:31.394955 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application result.read() Oct 27 09:34:31.394955 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 27 09:34:31.394955 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 27 09:34:31.395817 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 27 09:34:31.395817 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 27 09:34:31.395817 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 27 09:34:31.395817 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 27 09:34:31.395817 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 27 09:34:31.395817 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 27 09:34:31.395817 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Oct 27 09:34:31.395817 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 27 09:34:31.395817 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application [parameters: {'id': '5ba2927b8fd545f085ceb07096722858', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Oct 27 09:34:31.395817 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 27 09:34:31.395817 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application Oct 27 09:34:31.395817 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 27 09:34:31.395817 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application Oct 27 09:34:31.395817 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 09:34:31.395817 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Oct 27 09:34:31.396617 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Oct 27 09:34:31.396617 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 27 09:34:31.396617 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 27 09:34:31.396617 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Oct 27 09:34:31.396617 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application Oct 27 09:34:31.396617 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 27 09:34:31.396617 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application Oct 27 09:34:31.396617 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 09:34:31.396617 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 09:34:31.396617 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 09:34:31.396617 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 09:34:31.396617 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 09:34:31.396617 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 09:34:31.396617 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 09:34:31.396617 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 09:34:31.396617 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 09:34:31.396617 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 09:34:31.399625 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 09:34:31.399625 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Oct 27 09:34:31.399625 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Oct 27 09:34:31.399625 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 09:34:31.399625 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 09:34:31.399625 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Oct 27 09:34:31.399625 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application raise exception.Conflict( Oct 27 09:34:31.399625 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 5ba2927b8fd545f085ceb07096722858. Oct 27 09:34:31.399625 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application Oct 27 09:34:31.399625 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 364/745] 10.222.0.65 () {60 vars in 1140 bytes} [Thu Oct 27 09:34:31 2022] POST /identity/v3/projects => generated 262 bytes in 238 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Oct 27 09:34:31.401058 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae725a9d-b71d-427a-89d8-f9347fef06d8 None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:34:31.460266 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:34:31.514195 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae725a9d-b71d-427a-89d8-f9347fef06d8 None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:34:31.553870 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51967b2f-c97f-4781-9e44-3984a03aa4d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:34:31.564777 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51967b2f-c97f-4781-9e44-3984a03aa4d5 None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:34:31.564777 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51967b2f-c97f-4781-9e44-3984a03aa4d5 None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:34:31.564777 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51967b2f-c97f-4781-9e44-3984a03aa4d5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:34:31.564777 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51967b2f-c97f-4781-9e44-3984a03aa4d5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:34:31.564777 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51967b2f-c97f-4781-9e44-3984a03aa4d5 None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:34:31.578065 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application [None req-51967b2f-c97f-4781-9e44-3984a03aa4d5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 27 09:34:31.578065 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 09:34:31.578065 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 09:34:31.578065 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 09:34:31.578065 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 09:34:31.578065 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 09:34:31.578065 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 09:34:31.578065 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 09:34:31.578065 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 09:34:31.578065 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 09:34:31.578065 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 09:34:31.578065 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 09:34:31.578065 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 27 09:34:31.578065 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 27 09:34:31.578065 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 27 09:34:31.579049 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 27 09:34:31.579049 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 09:34:31.579049 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 09:34:31.579049 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 09:34:31.579049 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 09:34:31.579049 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 09:34:31.579049 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 09:34:31.579049 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 09:34:31.579049 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application with Lock( Oct 27 09:34:31.579049 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 09:34:31.579049 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._enter() Oct 27 09:34:31.579049 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 09:34:31.579049 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 09:34:31.579049 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 09:34:31.579049 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.creator() Oct 27 09:34:31.579049 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 09:34:31.579049 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application created_value = creator( Oct 27 09:34:31.579986 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 27 09:34:31.579986 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 27 09:34:31.579986 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 27 09:34:31.579986 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 27 09:34:31.579986 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 27 09:34:31.579986 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 27 09:34:31.579986 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 27 09:34:31.579986 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application Oct 27 09:34:31.582828 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 382/746] 10.222.0.65 () {56 vars in 1111 bytes} [Thu Oct 27 09:34:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 09:34:31.585711 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55e4f79-70e1-4ee7-8a60-76dad9da8612 None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:34:31.590935 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:34:31.694138 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55e4f79-70e1-4ee7-8a60-76dad9da8612 None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:34:31.734555 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3badd529-1bb2-4df6-a6d2-4745d7081d3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:34:31.735186 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3badd529-1bb2-4df6-a6d2-4745d7081d3f None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:34:31.735472 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3badd529-1bb2-4df6-a6d2-4745d7081d3f None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:34:31.735747 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3badd529-1bb2-4df6-a6d2-4745d7081d3f None admin] PATH_INFO: `/v3/projects` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:34:31.736687 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3badd529-1bb2-4df6-a6d2-4745d7081d3f None admin] RBAC: Adding query filter params (name=service) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 09:34:31.736997 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3badd529-1bb2-4df6-a6d2-4745d7081d3f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:34:31.738696 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3badd529-1bb2-4df6-a6d2-4745d7081d3f None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:34:31.763359 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 365/747] 10.222.0.65 () {56 vars in 1112 bytes} [Thu Oct 27 09:34:31 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 09:34:31.925897 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b22787-2c7b-494a-b527-1d8d96176b4c None None] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:34:31.926169 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b22787-2c7b-494a-b527-1d8d96176b4c None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:34:31.926442 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b22787-2c7b-494a-b527-1d8d96176b4c None None] PATH_INFO: `/` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:34:31.928156 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 383/748] 10.222.0.65 () {54 vars in 927 bytes} [Thu Oct 27 09:34:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 09:34:31.935349 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78d2fbe-1653-4932-9d10-b13b9d2f8278 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:34:31.935730 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78d2fbe-1653-4932-9d10-b13b9d2f8278 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:34:31.935918 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78d2fbe-1653-4932-9d10-b13b9d2f8278 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:34:31.956518 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-f78d2fbe-1653-4932-9d10-b13b9d2f8278 None None] MFA Rules not processed for user `b5065084bf664b99bdeac46067cb0f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:34:31.958380 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-f78d2fbe-1653-4932-9d10-b13b9d2f8278 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:34:32.022583 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:34:32.034859 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 366/749] 10.222.0.65 () {58 vars in 1024 bytes} [Thu Oct 27 09:34:31 2022] POST /identity/v3/auth/tokens => generated 1666 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 27 09:34:32.320129 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b22787-2c7b-494a-b527-1d8d96176b4c None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:34:32.435402 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b22787-2c7b-494a-b527-1d8d96176b4c None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:34:32.449466 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:34:32.471410 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b8c00b-34bc-47ae-ab25-b3a9b29127bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:34:32.472177 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b8c00b-34bc-47ae-ab25-b3a9b29127bc None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:34:32.472458 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b8c00b-34bc-47ae-ab25-b3a9b29127bc None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:34:32.472756 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b8c00b-34bc-47ae-ab25-b3a9b29127bc None admin] PATH_INFO: `/v3/services/compute` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:34:32.473412 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b8c00b-34bc-47ae-ab25-b3a9b29127bc None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:34:32.474893 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b8c00b-34bc-47ae-ab25-b3a9b29127bc None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:34:32.485244 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application [None req-41b8c00b-34bc-47ae-ab25-b3a9b29127bc None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Oct 27 09:34:32.485244 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 09:34:32.485244 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 27 09:34:32.485244 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 27 09:34:32.485244 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 27 09:34:32.485244 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 27 09:34:32.485244 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 27 09:34:32.485244 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 27 09:34:32.485244 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 27 09:34:32.485244 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application Oct 27 09:34:32.485244 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 27 09:34:32.485244 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application Oct 27 09:34:32.485244 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 09:34:32.485244 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 09:34:32.485244 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 09:34:32.485244 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 09:34:32.485244 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 09:34:32.486632 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 09:34:32.486632 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 09:34:32.486632 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 09:34:32.486632 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 09:34:32.486632 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 09:34:32.486632 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 09:34:32.486632 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 27 09:34:32.486632 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 27 09:34:32.486632 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 27 09:34:32.486632 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 27 09:34:32.486632 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 09:34:32.486632 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 09:34:32.486632 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 09:34:32.486632 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 09:34:32.486632 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 09:34:32.486632 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 09:34:32.487476 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 09:34:32.487476 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application with Lock( Oct 27 09:34:32.487476 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 09:34:32.487476 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._enter() Oct 27 09:34:32.487476 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 09:34:32.487476 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 09:34:32.487476 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 09:34:32.487476 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.creator() Oct 27 09:34:32.487476 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 09:34:32.487476 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application created_value = creator( Oct 27 09:34:32.487476 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 27 09:34:32.487476 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 27 09:34:32.487476 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 27 09:34:32.487476 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application Oct 27 09:34:32.487476 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 384/750] 10.222.0.65 () {56 vars in 1111 bytes} [Thu Oct 27 09:34:32 2022] GET /identity/v3/services/compute => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 09:34:32.495618 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78d2fbe-1653-4932-9d10-b13b9d2f8278 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:34:32.612089 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78d2fbe-1653-4932-9d10-b13b9d2f8278 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:34:32.652082 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7b882a-9901-4b7c-973f-2775356b46d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:34:32.652696 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7b882a-9901-4b7c-973f-2775356b46d3 None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:34:32.652980 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7b882a-9901-4b7c-973f-2775356b46d3 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:34:32.653261 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7b882a-9901-4b7c-973f-2775356b46d3 None admin] PATH_INFO: `/v3/services` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:34:32.653901 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7b882a-9901-4b7c-973f-2775356b46d3 None admin] RBAC: Adding query filter params (name=compute) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 09:34:32.654206 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7b882a-9901-4b7c-973f-2775356b46d3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:34:32.655650 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7b882a-9901-4b7c-973f-2775356b46d3 None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:34:32.661353 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 367/751] 10.222.0.65 () {56 vars in 1112 bytes} [Thu Oct 27 09:34:32 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 09:34:32.667802 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b8c00b-34bc-47ae-ab25-b3a9b29127bc None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:34:32.784972 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b8c00b-34bc-47ae-ab25-b3a9b29127bc None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:34:32.823320 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02b2f3b-d24e-454a-b122-0050f4586546 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:34:32.824259 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02b2f3b-d24e-454a-b122-0050f4586546 None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:34:32.824744 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02b2f3b-d24e-454a-b122-0050f4586546 None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:34:32.825197 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02b2f3b-d24e-454a-b122-0050f4586546 None admin] PATH_INFO: `/v3/services` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:34:32.826023 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02b2f3b-d24e-454a-b122-0050f4586546 None admin] RBAC: Adding query filter params (type=compute) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 09:34:32.826507 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02b2f3b-d24e-454a-b122-0050f4586546 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:34:32.828111 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02b2f3b-d24e-454a-b122-0050f4586546 None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:34:32.834135 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 385/752] 10.222.0.65 () {56 vars in 1112 bytes} [Thu Oct 27 09:34:32 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 09:34:32.841100 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7b882a-9901-4b7c-973f-2775356b46d3 None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:34:32.913989 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:34:32.967558 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7b882a-9901-4b7c-973f-2775356b46d3 None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:34:33.005763 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a77fc64-33ae-4b7f-bfaf-75a61476ee97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:34:33.006798 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a77fc64-33ae-4b7f-bfaf-75a61476ee97 None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:34:33.007281 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a77fc64-33ae-4b7f-bfaf-75a61476ee97 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:34:33.007770 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a77fc64-33ae-4b7f-bfaf-75a61476ee97 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:34:33.009221 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a77fc64-33ae-4b7f-bfaf-75a61476ee97 None admin] RBAC: Adding query filter params (interface=public, service_id=83b4b562666749a49ea71889f7691de0, region_id=RegionOne) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 09:34:33.009759 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a77fc64-33ae-4b7f-bfaf-75a61476ee97 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:34:33.011367 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a77fc64-33ae-4b7f-bfaf-75a61476ee97 None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:34:33.017470 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 368/753] 10.222.0.65 () {56 vars in 1251 bytes} [Thu Oct 27 09:34:32 2022] GET /identity/v3/endpoints?service_id=83b4b562666749a49ea71889f7691de0&interface=public®ion_id=RegionOne => generated 194 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 09:34:33.023021 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02b2f3b-d24e-454a-b122-0050f4586546 None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:34:33.028721 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668f0c47-c3e6-4d36-a4f2-2d90d184a9b1 None None] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:34:33.029018 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668f0c47-c3e6-4d36-a4f2-2d90d184a9b1 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:34:33.029298 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668f0c47-c3e6-4d36-a4f2-2d90d184a9b1 None None] PATH_INFO: `/` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:34:33.030941 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 369/754] 10.222.0.65 () {54 vars in 927 bytes} [Thu Oct 27 09:34:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 27 09:34:33.035830 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086515d4-fca8-411a-8b5d-63b0ce84d171 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:34:33.036335 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086515d4-fca8-411a-8b5d-63b0ce84d171 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:34:33.036792 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086515d4-fca8-411a-8b5d-63b0ce84d171 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:34:33.057108 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-086515d4-fca8-411a-8b5d-63b0ce84d171 None None] MFA Rules not processed for user `b5065084bf664b99bdeac46067cb0f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:34:33.058673 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-086515d4-fca8-411a-8b5d-63b0ce84d171 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:34:33.074720 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:34:33.144943 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 370/755] 10.222.0.65 () {58 vars in 1024 bytes} [Thu Oct 27 09:34:33 2022] POST /identity/v3/auth/tokens => generated 1666 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 27 09:34:33.145864 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02b2f3b-d24e-454a-b122-0050f4586546 None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:34:33.188178 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2c9693-2e6b-4f95-8be0-7a44f0ae56e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:34:33.188710 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2c9693-2e6b-4f95-8be0-7a44f0ae56e0 None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:34:33.188992 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2c9693-2e6b-4f95-8be0-7a44f0ae56e0 None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:34:33.189269 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2c9693-2e6b-4f95-8be0-7a44f0ae56e0 None admin] PATH_INFO: `/v3/services` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:34:33.189878 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2c9693-2e6b-4f95-8be0-7a44f0ae56e0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:34:33.191402 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2c9693-2e6b-4f95-8be0-7a44f0ae56e0 None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:34:33.199844 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 386/756] 10.222.0.65 () {56 vars in 1087 bytes} [Thu Oct 27 09:34:33 2022] GET /identity/v3/services => generated 1957 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 09:34:33.418869 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086515d4-fca8-411a-8b5d-63b0ce84d171 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:34:33.474720 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:34:33.530246 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086515d4-fca8-411a-8b5d-63b0ce84d171 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:34:33.557511 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944402b1-7430-40da-8fd2-7eca9e74b630 None None] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:34:33.558057 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944402b1-7430-40da-8fd2-7eca9e74b630 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:34:33.558057 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944402b1-7430-40da-8fd2-7eca9e74b630 None None] PATH_INFO: `/` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:34:33.559703 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 387/757] 10.222.0.65 () {54 vars in 927 bytes} [Thu Oct 27 09:34:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 27 09:34:33.565323 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ebad18-f2b1-4f6a-8f8f-9c56a61a4f0f None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:34:33.565715 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ebad18-f2b1-4f6a-8f8f-9c56a61a4f0f None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:34:33.566057 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ebad18-f2b1-4f6a-8f8f-9c56a61a4f0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:34:33.571682 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56f5a4d-b9d4-4ac8-ab9a-99e556a0001e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:34:33.572343 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56f5a4d-b9d4-4ac8-ab9a-99e556a0001e None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:34:33.572627 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56f5a4d-b9d4-4ac8-ab9a-99e556a0001e None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:34:33.572900 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56f5a4d-b9d4-4ac8-ab9a-99e556a0001e None admin] PATH_INFO: `/v3/services/object-store` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:34:33.573538 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56f5a4d-b9d4-4ac8-ab9a-99e556a0001e None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:34:33.574968 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56f5a4d-b9d4-4ac8-ab9a-99e556a0001e None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:34:33.584254 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application [None req-e56f5a4d-b9d4-4ac8-ab9a-99e556a0001e None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 27 09:34:33.584254 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 09:34:33.584254 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 27 09:34:33.584254 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 27 09:34:33.584254 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 27 09:34:33.584254 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 27 09:34:33.584254 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 27 09:34:33.584254 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 27 09:34:33.584254 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 27 09:34:33.584254 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application Oct 27 09:34:33.584254 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 27 09:34:33.584254 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application Oct 27 09:34:33.584254 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 09:34:33.584254 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 09:34:33.584254 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 09:34:33.584254 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 09:34:33.584254 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 09:34:33.585333 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 09:34:33.585333 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 09:34:33.585333 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 09:34:33.585333 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 09:34:33.585333 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 09:34:33.585333 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 09:34:33.585333 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 27 09:34:33.585333 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 27 09:34:33.585333 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 27 09:34:33.585333 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 27 09:34:33.585333 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 09:34:33.585333 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 09:34:33.585333 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 09:34:33.585333 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 09:34:33.585333 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 09:34:33.585333 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 09:34:33.587087 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 09:34:33.587087 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application with Lock( Oct 27 09:34:33.587087 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 09:34:33.587087 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._enter() Oct 27 09:34:33.587087 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 09:34:33.587087 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 09:34:33.587087 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 09:34:33.587087 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.creator() Oct 27 09:34:33.587087 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 09:34:33.587087 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application created_value = creator( Oct 27 09:34:33.587087 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 27 09:34:33.587087 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 27 09:34:33.587087 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 27 09:34:33.587087 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application Oct 27 09:34:33.587087 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 371/758] 10.222.0.65 () {56 vars in 1126 bytes} [Thu Oct 27 09:34:33 2022] GET /identity/v3/services/object-store => generated 93 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 09:34:33.592942 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-46ebad18-f2b1-4f6a-8f8f-9c56a61a4f0f None None] MFA Rules not processed for user `b5065084bf664b99bdeac46067cb0f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:34:33.593259 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56f5a4d-b9d4-4ac8-ab9a-99e556a0001e None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:34:33.595042 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-46ebad18-f2b1-4f6a-8f8f-9c56a61a4f0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:34:33.685071 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 388/759] 10.222.0.65 () {58 vars in 1024 bytes} [Thu Oct 27 09:34:33 2022] POST /identity/v3/auth/tokens => generated 1666 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 27 09:34:33.723822 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56f5a4d-b9d4-4ac8-ab9a-99e556a0001e None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:34:33.739508 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:34:33.761633 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91379007-292f-4fe6-a132-811e3960962f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:34:33.762654 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91379007-292f-4fe6-a132-811e3960962f None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:34:33.763159 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91379007-292f-4fe6-a132-811e3960962f None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:34:33.763633 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91379007-292f-4fe6-a132-811e3960962f None admin] PATH_INFO: `/v3/services` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:34:33.764466 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91379007-292f-4fe6-a132-811e3960962f None admin] RBAC: Adding query filter params (name=object-store) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 09:34:33.764978 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91379007-292f-4fe6-a132-811e3960962f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:34:33.766561 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91379007-292f-4fe6-a132-811e3960962f None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:34:33.772528 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 372/760] 10.222.0.65 () {56 vars in 1122 bytes} [Thu Oct 27 09:34:33 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 09:34:33.780377 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ebad18-f2b1-4f6a-8f8f-9c56a61a4f0f None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:34:33.817233 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:34:33.895194 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ebad18-f2b1-4f6a-8f8f-9c56a61a4f0f None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:34:33.933389 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0663e317-ac47-460f-ab1a-298e30b17ae7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:34:33.934400 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0663e317-ac47-460f-ab1a-298e30b17ae7 None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:34:33.934913 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0663e317-ac47-460f-ab1a-298e30b17ae7 None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:34:33.935380 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0663e317-ac47-460f-ab1a-298e30b17ae7 None admin] PATH_INFO: `/v3/services` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:34:33.936205 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0663e317-ac47-460f-ab1a-298e30b17ae7 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 09:34:33.936702 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0663e317-ac47-460f-ab1a-298e30b17ae7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:34:33.938276 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0663e317-ac47-460f-ab1a-298e30b17ae7 None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:34:33.944032 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 389/761] 10.222.0.65 () {56 vars in 1122 bytes} [Thu Oct 27 09:34:33 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 09:34:33.951794 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91379007-292f-4fe6-a132-811e3960962f None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:34:33.990867 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0663e317-ac47-460f-ab1a-298e30b17ae7 None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:34:34.067333 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91379007-292f-4fe6-a132-811e3960962f None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:34:34.114283 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e6583c-617f-4870-9704-3a5610093d51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:34:34.114958 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e6583c-617f-4870-9704-3a5610093d51 None admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:34:34.115237 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e6583c-617f-4870-9704-3a5610093d51 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:34:34.115511 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e6583c-617f-4870-9704-3a5610093d51 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:34:34.116194 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e6583c-617f-4870-9704-3a5610093d51 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:34:34.118389 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e6583c-617f-4870-9704-3a5610093d51 None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:34:34.126286 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:34:34.130645 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0663e317-ac47-460f-ab1a-298e30b17ae7 None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:34:34.165451 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e74db6-88bb-4aa6-8236-e9b41cd44b74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:34:34.166075 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e74db6-88bb-4aa6-8236-e9b41cd44b74 None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:34:34.166352 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e74db6-88bb-4aa6-8236-e9b41cd44b74 None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:34:34.166650 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e74db6-88bb-4aa6-8236-e9b41cd44b74 None admin] PATH_INFO: `/v3/services/image` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:34:34.167225 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e74db6-88bb-4aa6-8236-e9b41cd44b74 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:34:34.168712 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e74db6-88bb-4aa6-8236-e9b41cd44b74 None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:34:34.177521 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application [None req-e7e74db6-88bb-4aa6-8236-e9b41cd44b74 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Oct 27 09:34:34.177521 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 09:34:34.177521 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 27 09:34:34.177521 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 27 09:34:34.177521 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 27 09:34:34.177521 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 27 09:34:34.177521 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 27 09:34:34.177521 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 27 09:34:34.177521 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 27 09:34:34.177521 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application Oct 27 09:34:34.177521 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 27 09:34:34.177521 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application Oct 27 09:34:34.177521 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 09:34:34.177521 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 09:34:34.177521 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 09:34:34.177521 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 09:34:34.177521 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 09:34:34.178589 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 09:34:34.178589 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 09:34:34.178589 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 09:34:34.178589 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 09:34:34.178589 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 09:34:34.178589 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 09:34:34.178589 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 27 09:34:34.178589 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 27 09:34:34.178589 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 27 09:34:34.178589 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 27 09:34:34.178589 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 09:34:34.178589 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 09:34:34.178589 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 09:34:34.178589 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 09:34:34.178589 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 09:34:34.178589 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 09:34:34.184629 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 09:34:34.184629 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application with Lock( Oct 27 09:34:34.184629 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 09:34:34.184629 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._enter() Oct 27 09:34:34.184629 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 09:34:34.184629 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 09:34:34.184629 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 09:34:34.184629 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.creator() Oct 27 09:34:34.184629 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 09:34:34.184629 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application created_value = creator( Oct 27 09:34:34.184629 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 27 09:34:34.184629 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 27 09:34:34.184629 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 27 09:34:34.184629 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application Oct 27 09:34:34.184629 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 390/762] 10.222.0.65 () {56 vars in 1105 bytes} [Thu Oct 27 09:34:33 2022] GET /identity/v3/services/image => generated 86 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 27 09:34:34.186905 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e74db6-88bb-4aa6-8236-e9b41cd44b74 None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:34:34.230991 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 373/763] 10.222.0.65 () {60 vars in 1144 bytes} [Thu Oct 27 09:34:33 2022] POST /identity/v3/endpoints => generated 325 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 09:34:34.236432 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a32fc1-7560-46ce-9439-e636d2c88e72 None None] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:34:34.236432 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a32fc1-7560-46ce-9439-e636d2c88e72 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:34:34.236432 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a32fc1-7560-46ce-9439-e636d2c88e72 None None] PATH_INFO: `/` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:34:34.236432 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 374/764] 10.222.0.65 () {54 vars in 927 bytes} [Thu Oct 27 09:34:34 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 09:34:34.245058 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f58dbb-c5f6-41b4-9fca-7ab72250d018 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:34:34.245755 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f58dbb-c5f6-41b4-9fca-7ab72250d018 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:34:34.246290 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f58dbb-c5f6-41b4-9fca-7ab72250d018 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:34:34.276058 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-57f58dbb-c5f6-41b4-9fca-7ab72250d018 None None] MFA Rules not processed for user `b5065084bf664b99bdeac46067cb0f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:34:34.277969 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-57f58dbb-c5f6-41b4-9fca-7ab72250d018 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:34:34.322326 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:34:34.326060 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e74db6-88bb-4aa6-8236-e9b41cd44b74 None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:34:34.381552 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f692f26-2c73-4fa6-8516-0234fbb2177f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:34:34.383457 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f692f26-2c73-4fa6-8516-0234fbb2177f None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:34:34.384088 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f692f26-2c73-4fa6-8516-0234fbb2177f None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:34:34.384683 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f692f26-2c73-4fa6-8516-0234fbb2177f None admin] PATH_INFO: `/v3/services` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:34:34.385856 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f692f26-2c73-4fa6-8516-0234fbb2177f None admin] RBAC: Adding query filter params (name=image) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 09:34:34.386361 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f692f26-2c73-4fa6-8516-0234fbb2177f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:34:34.388102 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f692f26-2c73-4fa6-8516-0234fbb2177f None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:34:34.392609 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 375/765] 10.222.0.65 () {58 vars in 1024 bytes} [Thu Oct 27 09:34:34 2022] POST /identity/v3/auth/tokens => generated 1813 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 27 09:34:34.406255 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 391/766] 10.222.0.65 () {56 vars in 1108 bytes} [Thu Oct 27 09:34:34 2022] GET /identity/v3/services?name=image => generated 122 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 09:34:34.407565 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f58dbb-c5f6-41b4-9fca-7ab72250d018 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:34:34.521713 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f58dbb-c5f6-41b4-9fca-7ab72250d018 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:34:34.559069 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba0dd39-49a8-4e48-93cb-0d8a9124696c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:34:34.559704 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba0dd39-49a8-4e48-93cb-0d8a9124696c None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:34:34.559953 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba0dd39-49a8-4e48-93cb-0d8a9124696c None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:34:34.560208 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba0dd39-49a8-4e48-93cb-0d8a9124696c None admin] PATH_INFO: `/v3/services` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:34:34.564135 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba0dd39-49a8-4e48-93cb-0d8a9124696c None admin] RBAC: Adding query filter params (type=image) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 09:34:34.564135 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba0dd39-49a8-4e48-93cb-0d8a9124696c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:34:34.564135 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba0dd39-49a8-4e48-93cb-0d8a9124696c None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:34:34.568172 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 376/767] 10.222.0.65 () {56 vars in 1108 bytes} [Thu Oct 27 09:34:34 2022] GET /identity/v3/services?type=image => generated 350 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 09:34:34.574050 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f692f26-2c73-4fa6-8516-0234fbb2177f None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:34:34.605638 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:34:34.674807 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba0dd39-49a8-4e48-93cb-0d8a9124696c None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:34:34.688365 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f692f26-2c73-4fa6-8516-0234fbb2177f None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:34:34.724465 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618ffef7-9b62-43c3-a1cb-e59ef4024093 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:34:34.725075 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618ffef7-9b62-43c3-a1cb-e59ef4024093 None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:34:34.725358 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618ffef7-9b62-43c3-a1cb-e59ef4024093 None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:34:34.725634 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618ffef7-9b62-43c3-a1cb-e59ef4024093 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:34:34.726333 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618ffef7-9b62-43c3-a1cb-e59ef4024093 None admin] RBAC: Adding query filter params (interface=public, service_id=7fa693f52c3e4421aa091022cdb3cf55, region_id=RegionOne) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 09:34:34.727444 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618ffef7-9b62-43c3-a1cb-e59ef4024093 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:34:34.729020 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618ffef7-9b62-43c3-a1cb-e59ef4024093 None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:34:34.734685 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 392/768] 10.222.0.65 () {56 vars in 1251 bytes} [Thu Oct 27 09:34:34 2022] GET /identity/v3/endpoints?service_id=7fa693f52c3e4421aa091022cdb3cf55&interface=public®ion_id=RegionOne => generated 194 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 09:34:34.735482 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:34:34.740480 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618ffef7-9b62-43c3-a1cb-e59ef4024093 None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:34:34.782988 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba0dd39-49a8-4e48-93cb-0d8a9124696c None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:34:34.823840 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b5d51b-826b-46f8-919c-69991959883f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:34:34.824663 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b5d51b-826b-46f8-919c-69991959883f None admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:34:34.824944 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b5d51b-826b-46f8-919c-69991959883f None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:34:34.825217 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b5d51b-826b-46f8-919c-69991959883f None admin] PATH_INFO: `/v3/users` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:34:34.825865 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b5d51b-826b-46f8-919c-69991959883f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:34:34.827475 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b5d51b-826b-46f8-919c-69991959883f None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:34:34.848190 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:34:34.863666 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618ffef7-9b62-43c3-a1cb-e59ef4024093 None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:34:34.880534 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.sql.core [None req-24b5d51b-826b-46f8-919c-69991959883f None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Oct 27 09:34:34.880534 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Oct 27 09:34:34.880534 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [parameters: {'user_id': '5a1bcfe40f3b4a349b3702f09be692d8', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Oct 27 09:34:34.880534 dv-cinder-797970-7-smb devstack@keystone.service[88312]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=88312) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 27 09:34:34.891078 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application [None req-24b5d51b-826b-46f8-919c-69991959883f None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Oct 27 09:34:34.891078 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 09:34:34.891078 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 27 09:34:34.891078 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 27 09:34:34.891078 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 27 09:34:34.891078 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 27 09:34:34.891078 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 27 09:34:34.891078 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application result = self._query(query) Oct 27 09:34:34.891078 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 27 09:34:34.891078 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application conn.query(q) Oct 27 09:34:34.891078 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 27 09:34:34.891078 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 27 09:34:34.891078 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 27 09:34:34.891078 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application result.read() Oct 27 09:34:34.891078 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 27 09:34:34.892864 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 27 09:34:34.892864 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 27 09:34:34.892864 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 27 09:34:34.892864 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 27 09:34:34.892864 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 27 09:34:34.892864 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 27 09:34:34.892864 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 27 09:34:34.892864 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Oct 27 09:34:34.892864 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application Oct 27 09:34:34.892864 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 27 09:34:34.892864 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application Oct 27 09:34:34.892864 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 09:34:34.892864 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 27 09:34:34.892864 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 27 09:34:34.892864 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Oct 27 09:34:34.892864 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Oct 27 09:34:34.892864 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 27 09:34:34.892864 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application next(self.gen) Oct 27 09:34:34.893792 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1068, in _transaction_scope Oct 27 09:34:34.893792 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application yield resource Oct 27 09:34:34.893792 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 27 09:34:34.893792 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application next(self.gen) Oct 27 09:34:34.893792 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 670, in _session Oct 27 09:34:34.893792 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application self.session.rollback() Oct 27 09:34:34.893792 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 27 09:34:34.893792 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application self.force_reraise() Oct 27 09:34:34.893792 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 27 09:34:34.893792 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application raise self.value Oct 27 09:34:34.893792 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 667, in _session Oct 27 09:34:34.893792 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 27 09:34:34.893792 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 695, in _end_session_transaction Oct 27 09:34:34.893792 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application session.commit() Oct 27 09:34:34.893792 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 27 09:34:34.893792 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 27 09:34:34.893792 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 27 09:34:34.894704 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application self._prepare_impl() Oct 27 09:34:34.894704 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 27 09:34:34.894704 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application self.session.flush() Oct 27 09:34:34.894704 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 27 09:34:34.894704 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application self._flush(objects) Oct 27 09:34:34.894704 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 27 09:34:34.894704 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 27 09:34:34.894704 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 27 09:34:34.894704 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application compat.raise_( Oct 27 09:34:34.894704 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 27 09:34:34.894704 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application raise exception Oct 27 09:34:34.894704 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 27 09:34:34.894704 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application flush_context.execute() Oct 27 09:34:34.894704 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 27 09:34:34.894704 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application rec.execute(self) Oct 27 09:34:34.894704 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 27 09:34:34.894704 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 27 09:34:34.895730 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 27 09:34:34.895730 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 27 09:34:34.895730 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Oct 27 09:34:34.895730 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application result = connection._execute_20( Oct 27 09:34:34.895730 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 27 09:34:34.895730 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 27 09:34:34.895730 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 27 09:34:34.895730 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 27 09:34:34.895730 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 27 09:34:34.895730 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 27 09:34:34.895730 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 27 09:34:34.895730 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 27 09:34:34.895730 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 27 09:34:34.895730 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 27 09:34:34.895730 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 27 09:34:34.895730 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application raise exception Oct 27 09:34:34.896932 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 27 09:34:34.896932 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 27 09:34:34.896932 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 27 09:34:34.896932 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 27 09:34:34.896932 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 27 09:34:34.896932 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application result = self._query(query) Oct 27 09:34:34.896932 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 27 09:34:34.896932 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application conn.query(q) Oct 27 09:34:34.896932 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 27 09:34:34.896932 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 27 09:34:34.896932 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 27 09:34:34.896932 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application result.read() Oct 27 09:34:34.896932 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 27 09:34:34.896932 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 27 09:34:34.896932 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 27 09:34:34.896932 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 27 09:34:34.897972 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 27 09:34:34.897972 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 27 09:34:34.897972 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 27 09:34:34.897972 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 27 09:34:34.897972 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Oct 27 09:34:34.897972 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Oct 27 09:34:34.897972 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application [parameters: {'user_id': '5a1bcfe40f3b4a349b3702f09be692d8', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Oct 27 09:34:34.897972 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 27 09:34:34.897972 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application Oct 27 09:34:34.897972 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 27 09:34:34.897972 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application Oct 27 09:34:34.897972 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 09:34:34.897972 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 09:34:34.897972 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 09:34:34.897972 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 09:34:34.900708 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 09:34:34.900708 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 09:34:34.900708 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 09:34:34.900708 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 09:34:34.900708 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 09:34:34.900708 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 09:34:34.900708 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 09:34:34.900708 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Oct 27 09:34:34.900708 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Oct 27 09:34:34.900708 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 09:34:34.900708 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 09:34:34.900708 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 27 09:34:34.900708 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 27 09:34:34.900708 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 27 09:34:34.900708 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 27 09:34:34.900708 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Oct 27 09:34:34.900708 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Oct 27 09:34:34.902931 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Oct 27 09:34:34.902931 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Oct 27 09:34:34.902931 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 27 09:34:34.902931 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 27 09:34:34.902931 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Oct 27 09:34:34.902931 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application Oct 27 09:34:34.902931 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 377/769] 10.222.0.65 () {60 vars in 1131 bytes} [Thu Oct 27 09:34:34 2022] POST /identity/v3/users => generated 160 bytes in 225 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Oct 27 09:34:34.910599 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b5d51b-826b-46f8-919c-69991959883f None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:34:34.916720 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938d0bfb-7402-4c5e-942a-0ff89d43002c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:34:34.916720 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938d0bfb-7402-4c5e-942a-0ff89d43002c None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:34:34.916720 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938d0bfb-7402-4c5e-942a-0ff89d43002c None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:34:34.916720 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938d0bfb-7402-4c5e-942a-0ff89d43002c None admin] PATH_INFO: `/v3/services` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:34:34.917141 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938d0bfb-7402-4c5e-942a-0ff89d43002c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:34:34.917141 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938d0bfb-7402-4c5e-942a-0ff89d43002c None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:34:34.923417 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 393/770] 10.222.0.65 () {56 vars in 1087 bytes} [Thu Oct 27 09:34:34 2022] GET /identity/v3/services => generated 1957 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 09:34:35.028214 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:34:35.040693 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b5d51b-826b-46f8-919c-69991959883f None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:34:35.080229 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d93eeb-cf71-4a69-b562-5462b95eb071 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:34:35.080885 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d93eeb-cf71-4a69-b562-5462b95eb071 None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:34:35.081170 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d93eeb-cf71-4a69-b562-5462b95eb071 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:34:35.081638 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d93eeb-cf71-4a69-b562-5462b95eb071 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:34:35.090591 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d93eeb-cf71-4a69-b562-5462b95eb071 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:34:35.092291 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d93eeb-cf71-4a69-b562-5462b95eb071 None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:34:35.105939 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application [None req-f9d93eeb-cf71-4a69-b562-5462b95eb071 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Oct 27 09:34:35.105939 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 09:34:35.105939 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 09:34:35.105939 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 09:34:35.105939 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 09:34:35.105939 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 09:34:35.105939 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 09:34:35.105939 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 09:34:35.105939 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 09:34:35.105939 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 09:34:35.105939 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 09:34:35.105939 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 09:34:35.105939 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 27 09:34:35.105939 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 27 09:34:35.105939 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 27 09:34:35.105939 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 27 09:34:35.107235 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 09:34:35.107235 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 09:34:35.107235 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 27 09:34:35.107235 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 27 09:34:35.107235 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 27 09:34:35.107235 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 27 09:34:35.107235 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 09:34:35.107235 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 09:34:35.107235 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 09:34:35.107235 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 09:34:35.107235 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 09:34:35.107235 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application with Lock( Oct 27 09:34:35.107235 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 09:34:35.107235 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._enter() Oct 27 09:34:35.107235 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 09:34:35.107235 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 09:34:35.107235 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 09:34:35.107235 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.creator() Oct 27 09:34:35.108349 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 09:34:35.108349 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application created_value = creator( Oct 27 09:34:35.108349 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 27 09:34:35.108349 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 27 09:34:35.108349 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 27 09:34:35.108349 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 27 09:34:35.108349 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 27 09:34:35.108349 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 27 09:34:35.108349 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Oct 27 09:34:35.108349 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application Oct 27 09:34:35.108349 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 378/771] 10.222.0.65 () {56 vars in 1099 bytes} [Thu Oct 27 09:34:34 2022] GET /identity/v3/users/cinder => generated 84 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 27 09:34:35.113415 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938d0bfb-7402-4c5e-942a-0ff89d43002c None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:34:35.232712 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938d0bfb-7402-4c5e-942a-0ff89d43002c None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:34:35.271099 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de186ccd-2827-47de-8198-53a3b2b1fe23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:34:35.271753 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de186ccd-2827-47de-8198-53a3b2b1fe23 None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:34:35.272032 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de186ccd-2827-47de-8198-53a3b2b1fe23 None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:34:35.272302 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de186ccd-2827-47de-8198-53a3b2b1fe23 None admin] PATH_INFO: `/v3/users` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:34:35.273070 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de186ccd-2827-47de-8198-53a3b2b1fe23 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 09:34:35.273993 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de186ccd-2827-47de-8198-53a3b2b1fe23 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:34:35.275510 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de186ccd-2827-47de-8198-53a3b2b1fe23 None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:34:35.312428 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 394/772] 10.222.0.65 () {56 vars in 1101 bytes} [Thu Oct 27 09:34:35 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 09:34:35.536759 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c606bcbf-874c-456b-a374-54db7a761941 None None] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:34:35.537257 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c606bcbf-874c-456b-a374-54db7a761941 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:34:35.537611 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c606bcbf-874c-456b-a374-54db7a761941 None None] PATH_INFO: `/` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:34:35.542959 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 379/773] 10.222.0.65 () {54 vars in 927 bytes} [Thu Oct 27 09:34:35 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 09:34:35.550372 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b03a2c-92cc-45fb-9ee8-75752496dc6b None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:34:35.550703 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b03a2c-92cc-45fb-9ee8-75752496dc6b None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:34:35.550988 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b03a2c-92cc-45fb-9ee8-75752496dc6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:34:35.571760 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-f1b03a2c-92cc-45fb-9ee8-75752496dc6b None None] MFA Rules not processed for user `b5065084bf664b99bdeac46067cb0f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:34:35.572884 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-f1b03a2c-92cc-45fb-9ee8-75752496dc6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:34:35.575094 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:34:35.649312 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 395/774] 10.222.0.65 () {58 vars in 1024 bytes} [Thu Oct 27 09:34:35 2022] POST /identity/v3/auth/tokens => generated 1813 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 27 09:34:35.919325 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c606bcbf-874c-456b-a374-54db7a761941 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:34:36.031698 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c606bcbf-874c-456b-a374-54db7a761941 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:34:36.067537 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea771400-c104-4c2a-b859-2d7bb36bc368 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:34:36.068167 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea771400-c104-4c2a-b859-2d7bb36bc368 None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:34:36.068454 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea771400-c104-4c2a-b859-2d7bb36bc368 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:34:36.068733 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea771400-c104-4c2a-b859-2d7bb36bc368 None admin] PATH_INFO: `/v3/services/compute` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:34:36.069319 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea771400-c104-4c2a-b859-2d7bb36bc368 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:34:36.071942 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea771400-c104-4c2a-b859-2d7bb36bc368 None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:34:36.081822 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application [None req-ea771400-c104-4c2a-b859-2d7bb36bc368 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Oct 27 09:34:36.081822 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 09:34:36.081822 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 27 09:34:36.081822 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 27 09:34:36.081822 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 27 09:34:36.081822 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 27 09:34:36.081822 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 27 09:34:36.081822 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 27 09:34:36.081822 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 27 09:34:36.081822 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application Oct 27 09:34:36.081822 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 27 09:34:36.081822 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application Oct 27 09:34:36.081822 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 09:34:36.081822 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 09:34:36.081822 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 09:34:36.081822 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 09:34:36.081822 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 09:34:36.082863 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 09:34:36.082863 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 09:34:36.082863 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 09:34:36.082863 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 09:34:36.082863 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 09:34:36.082863 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 09:34:36.082863 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 27 09:34:36.082863 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 27 09:34:36.082863 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 27 09:34:36.082863 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 27 09:34:36.082863 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 09:34:36.082863 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 09:34:36.082863 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 09:34:36.082863 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 09:34:36.082863 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 09:34:36.082863 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 09:34:36.083729 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 09:34:36.083729 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application with Lock( Oct 27 09:34:36.083729 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 09:34:36.083729 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._enter() Oct 27 09:34:36.083729 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 09:34:36.083729 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 09:34:36.083729 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 09:34:36.083729 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.creator() Oct 27 09:34:36.083729 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 09:34:36.083729 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application created_value = creator( Oct 27 09:34:36.083729 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 27 09:34:36.083729 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 27 09:34:36.083729 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 27 09:34:36.083729 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application Oct 27 09:34:36.083729 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 380/775] 10.222.0.65 () {56 vars in 1111 bytes} [Thu Oct 27 09:34:35 2022] GET /identity/v3/services/compute => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 09:34:36.090756 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b03a2c-92cc-45fb-9ee8-75752496dc6b None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:34:36.201533 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b03a2c-92cc-45fb-9ee8-75752496dc6b None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:34:36.240710 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0476b2b-a6d1-4bc0-8076-7f841b282629 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:34:36.241192 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0476b2b-a6d1-4bc0-8076-7f841b282629 None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:34:36.241528 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0476b2b-a6d1-4bc0-8076-7f841b282629 None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:34:36.241806 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0476b2b-a6d1-4bc0-8076-7f841b282629 None admin] PATH_INFO: `/v3/services` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:34:36.242468 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0476b2b-a6d1-4bc0-8076-7f841b282629 None admin] RBAC: Adding query filter params (name=compute) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 09:34:36.242810 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0476b2b-a6d1-4bc0-8076-7f841b282629 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:34:36.244186 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0476b2b-a6d1-4bc0-8076-7f841b282629 None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:34:36.254111 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 396/776] 10.222.0.65 () {56 vars in 1112 bytes} [Thu Oct 27 09:34:36 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 09:34:36.255241 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea771400-c104-4c2a-b859-2d7bb36bc368 None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:34:36.272973 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:34:36.365545 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea771400-c104-4c2a-b859-2d7bb36bc368 None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:34:36.404627 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db0b569-1d97-42e5-930a-4321f3e3d9ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:34:36.405534 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db0b569-1d97-42e5-930a-4321f3e3d9ca None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:34:36.406040 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db0b569-1d97-42e5-930a-4321f3e3d9ca None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:34:36.406512 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db0b569-1d97-42e5-930a-4321f3e3d9ca None admin] PATH_INFO: `/v3/services` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:34:36.407361 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db0b569-1d97-42e5-930a-4321f3e3d9ca None admin] RBAC: Adding query filter params (type=compute) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 09:34:36.407847 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db0b569-1d97-42e5-930a-4321f3e3d9ca None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:34:36.409422 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db0b569-1d97-42e5-930a-4321f3e3d9ca None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:34:36.415381 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 381/777] 10.222.0.65 () {56 vars in 1112 bytes} [Thu Oct 27 09:34:36 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 09:34:36.421613 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0476b2b-a6d1-4bc0-8076-7f841b282629 None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:34:36.424648 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:34:36.534260 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0476b2b-a6d1-4bc0-8076-7f841b282629 None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:34:36.544456 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863806ca-12c6-434a-b640-b39af12ddf12 None None] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:34:36.544745 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863806ca-12c6-434a-b640-b39af12ddf12 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:34:36.545021 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863806ca-12c6-434a-b640-b39af12ddf12 None None] PATH_INFO: `/` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:34:36.546371 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 382/778] 10.222.0.65 () {54 vars in 927 bytes} [Thu Oct 27 09:34:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 27 09:34:36.551314 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39722d8-d6f1-4add-bb6c-7cb583a29587 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:34:36.551589 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39722d8-d6f1-4add-bb6c-7cb583a29587 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:34:36.551867 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39722d8-d6f1-4add-bb6c-7cb583a29587 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:34:36.569802 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-f39722d8-d6f1-4add-bb6c-7cb583a29587 None None] MFA Rules not processed for user `b5065084bf664b99bdeac46067cb0f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:34:36.572134 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-f39722d8-d6f1-4add-bb6c-7cb583a29587 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:34:36.572273 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d3ce8d-01da-4b3d-9590-b3e51accb1fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:34:36.572853 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d3ce8d-01da-4b3d-9590-b3e51accb1fd None admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:34:36.573134 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d3ce8d-01da-4b3d-9590-b3e51accb1fd None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:34:36.573409 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d3ce8d-01da-4b3d-9590-b3e51accb1fd None admin] PATH_INFO: `/v3/endpoints` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:34:36.574085 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d3ce8d-01da-4b3d-9590-b3e51accb1fd None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:34:36.575489 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d3ce8d-01da-4b3d-9590-b3e51accb1fd None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:34:36.643129 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 383/779] 10.222.0.65 () {58 vars in 1024 bytes} [Thu Oct 27 09:34:36 2022] POST /identity/v3/auth/tokens => generated 1813 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 27 09:34:36.692446 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 397/780] 10.222.0.65 () {60 vars in 1144 bytes} [Thu Oct 27 09:34:36 2022] POST /identity/v3/endpoints => generated 334 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 09:34:36.914011 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39722d8-d6f1-4add-bb6c-7cb583a29587 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:34:36.924545 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:34:37.023557 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39722d8-d6f1-4add-bb6c-7cb583a29587 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:34:37.065616 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a603bef-f0e2-4572-b10a-425f9559df63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:34:37.066240 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a603bef-f0e2-4572-b10a-425f9559df63 None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:34:37.066532 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a603bef-f0e2-4572-b10a-425f9559df63 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:34:37.066809 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a603bef-f0e2-4572-b10a-425f9559df63 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:34:37.067972 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a603bef-f0e2-4572-b10a-425f9559df63 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:34:37.069397 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a603bef-f0e2-4572-b10a-425f9559df63 None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:34:37.071760 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 384/781] 10.222.0.65 () {56 vars in 1108 bytes} [Thu Oct 27 09:34:36 2022] GET /identity/v3/domains/default => generated 199 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 09:34:37.077414 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d3ce8d-01da-4b3d-9590-b3e51accb1fd None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:34:37.140303 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:34:37.188991 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d3ce8d-01da-4b3d-9590-b3e51accb1fd None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:34:37.223830 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59a085a-4958-4ade-9f1b-211946cfb7a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:34:37.224434 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59a085a-4958-4ade-9f1b-211946cfb7a1 None admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:34:37.224710 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59a085a-4958-4ade-9f1b-211946cfb7a1 None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:34:37.224974 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59a085a-4958-4ade-9f1b-211946cfb7a1 None admin] PATH_INFO: `/v3/projects` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:34:37.225626 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59a085a-4958-4ade-9f1b-211946cfb7a1 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:34:37.227748 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59a085a-4958-4ade-9f1b-211946cfb7a1 None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:34:37.245727 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002c9a80-7ead-4291-ab57-b5d999fff6e3 None None] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:34:37.246017 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002c9a80-7ead-4291-ab57-b5d999fff6e3 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:34:37.246275 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002c9a80-7ead-4291-ab57-b5d999fff6e3 None None] PATH_INFO: `/` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:34:37.247803 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 385/782] 10.222.0.65 () {54 vars in 927 bytes} [Thu Oct 27 09:34:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 27 09:34:37.252873 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5159fc17-aa59-41de-95f0-3324ee494b8a None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:34:37.253162 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5159fc17-aa59-41de-95f0-3324ee494b8a None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:34:37.253439 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5159fc17-aa59-41de-95f0-3324ee494b8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:34:37.271519 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-5159fc17-aa59-41de-95f0-3324ee494b8a None None] MFA Rules not processed for user `b5065084bf664b99bdeac46067cb0f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:34:37.272713 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-5159fc17-aa59-41de-95f0-3324ee494b8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:34:37.315700 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 398/783] 10.222.0.65 () {60 vars in 1141 bytes} [Thu Oct 27 09:34:37 2022] POST /identity/v3/projects => generated 311 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 09:34:37.358980 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 386/784] 10.222.0.65 () {58 vars in 1024 bytes} [Thu Oct 27 09:34:37 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 27 09:34:37.629878 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59a085a-4958-4ade-9f1b-211946cfb7a1 None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:34:37.736910 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59a085a-4958-4ade-9f1b-211946cfb7a1 None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:34:37.749299 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:34:37.773562 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cb9865-4d66-4c6e-9414-d0244a1807d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:34:37.774466 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cb9865-4d66-4c6e-9414-d0244a1807d9 None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:34:37.774919 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cb9865-4d66-4c6e-9414-d0244a1807d9 None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:34:37.775378 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cb9865-4d66-4c6e-9414-d0244a1807d9 None admin] PATH_INFO: `/v3/services/image` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:34:37.776136 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2cb9865-4d66-4c6e-9414-d0244a1807d9 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:34:37.778087 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2cb9865-4d66-4c6e-9414-d0244a1807d9 None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:34:37.787361 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application [None req-a2cb9865-4d66-4c6e-9414-d0244a1807d9 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Oct 27 09:34:37.787361 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 09:34:37.787361 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 27 09:34:37.787361 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 27 09:34:37.787361 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 27 09:34:37.787361 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 27 09:34:37.787361 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 27 09:34:37.787361 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 27 09:34:37.787361 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 27 09:34:37.787361 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application Oct 27 09:34:37.787361 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 27 09:34:37.787361 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application Oct 27 09:34:37.787361 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 09:34:37.787361 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 09:34:37.787361 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 09:34:37.787361 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 09:34:37.787361 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 09:34:37.788931 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 09:34:37.788931 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 09:34:37.788931 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 09:34:37.788931 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 09:34:37.788931 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 09:34:37.788931 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 09:34:37.788931 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 27 09:34:37.788931 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 27 09:34:37.788931 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 27 09:34:37.788931 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 27 09:34:37.788931 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 09:34:37.788931 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 09:34:37.788931 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 09:34:37.788931 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 09:34:37.788931 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 09:34:37.788931 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 09:34:37.789935 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 09:34:37.789935 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application with Lock( Oct 27 09:34:37.789935 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 09:34:37.789935 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._enter() Oct 27 09:34:37.789935 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 09:34:37.789935 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 09:34:37.789935 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 09:34:37.789935 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.creator() Oct 27 09:34:37.789935 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 09:34:37.789935 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application created_value = creator( Oct 27 09:34:37.789935 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 27 09:34:37.789935 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 27 09:34:37.789935 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 27 09:34:37.789935 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application Oct 27 09:34:37.796992 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 399/785] 10.222.0.65 () {56 vars in 1105 bytes} [Thu Oct 27 09:34:37 2022] GET /identity/v3/services/image => generated 86 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 09:34:37.798534 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5159fc17-aa59-41de-95f0-3324ee494b8a None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:34:37.800964 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:34:37.913522 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5159fc17-aa59-41de-95f0-3324ee494b8a None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:34:37.950681 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5311c7-fa72-4a97-a0c2-af1b5ea68726 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:34:37.951309 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5311c7-fa72-4a97-a0c2-af1b5ea68726 None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:34:37.951537 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5311c7-fa72-4a97-a0c2-af1b5ea68726 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:34:37.951807 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5311c7-fa72-4a97-a0c2-af1b5ea68726 None admin] PATH_INFO: `/v3/services` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:34:37.952423 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5311c7-fa72-4a97-a0c2-af1b5ea68726 None admin] RBAC: Adding query filter params (name=image) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 09:34:37.952720 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5311c7-fa72-4a97-a0c2-af1b5ea68726 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:34:37.954070 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5311c7-fa72-4a97-a0c2-af1b5ea68726 None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:34:37.959049 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 387/786] 10.222.0.65 () {56 vars in 1108 bytes} [Thu Oct 27 09:34:37 2022] GET /identity/v3/services?name=image => generated 122 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 09:34:37.964811 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cb9865-4d66-4c6e-9414-d0244a1807d9 None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:34:38.069095 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cb9865-4d66-4c6e-9414-d0244a1807d9 None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:34:38.105053 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f9dc85-de4e-49eb-87b6-602c5ec8378b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:34:38.105660 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f9dc85-de4e-49eb-87b6-602c5ec8378b None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:34:38.105940 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f9dc85-de4e-49eb-87b6-602c5ec8378b None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:34:38.106211 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f9dc85-de4e-49eb-87b6-602c5ec8378b None admin] PATH_INFO: `/v3/services` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:34:38.106872 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f9dc85-de4e-49eb-87b6-602c5ec8378b None admin] RBAC: Adding query filter params (type=image) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 09:34:38.107178 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f9dc85-de4e-49eb-87b6-602c5ec8378b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:34:38.108547 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f9dc85-de4e-49eb-87b6-602c5ec8378b None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:34:38.119237 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 400/787] 10.222.0.65 () {56 vars in 1108 bytes} [Thu Oct 27 09:34:37 2022] GET /identity/v3/services?type=image => generated 350 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 09:34:38.120365 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5311c7-fa72-4a97-a0c2-af1b5ea68726 None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:34:38.188700 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:34:38.224378 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5311c7-fa72-4a97-a0c2-af1b5ea68726 None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:34:38.262243 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8442354a-cef5-4a2d-a867-dbde319b6cbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:34:38.262919 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8442354a-cef5-4a2d-a867-dbde319b6cbc None admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:34:38.263203 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8442354a-cef5-4a2d-a867-dbde319b6cbc None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:34:38.263552 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8442354a-cef5-4a2d-a867-dbde319b6cbc None admin] PATH_INFO: `/v3/endpoints` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:34:38.264262 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8442354a-cef5-4a2d-a867-dbde319b6cbc None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:34:38.265824 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8442354a-cef5-4a2d-a867-dbde319b6cbc None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:34:38.354551 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 388/788] 10.222.0.65 () {60 vars in 1144 bytes} [Thu Oct 27 09:34:38 2022] POST /identity/v3/endpoints => generated 327 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 09:34:39.020230 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56357256-7868-4826-aaad-df8d7071ac0e None None] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:34:39.020773 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56357256-7868-4826-aaad-df8d7071ac0e None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:34:39.020773 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56357256-7868-4826-aaad-df8d7071ac0e None None] PATH_INFO: `/` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:34:39.022366 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 401/789] 10.222.0.65 () {54 vars in 927 bytes} [Thu Oct 27 09:34:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 09:34:39.028357 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99eccd7d-35af-408b-813f-1e5b48e74361 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:34:39.028806 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99eccd7d-35af-408b-813f-1e5b48e74361 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:34:39.028902 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99eccd7d-35af-408b-813f-1e5b48e74361 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:34:39.047793 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-99eccd7d-35af-408b-813f-1e5b48e74361 None None] MFA Rules not processed for user `b5065084bf664b99bdeac46067cb0f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:34:39.048975 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-99eccd7d-35af-408b-813f-1e5b48e74361 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:34:39.128780 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 389/790] 10.222.0.65 () {58 vars in 1024 bytes} [Thu Oct 27 09:34:39 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 27 09:34:39.396994 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56357256-7868-4826-aaad-df8d7071ac0e None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:34:39.439372 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:34:39.507905 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56357256-7868-4826-aaad-df8d7071ac0e None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:34:39.543055 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4affb192-08ba-49b3-a3f3-a6970b81257a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:34:39.543689 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4affb192-08ba-49b3-a3f3-a6970b81257a None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:34:39.543969 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4affb192-08ba-49b3-a3f3-a6970b81257a None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:34:39.544242 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4affb192-08ba-49b3-a3f3-a6970b81257a None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:34:39.555912 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4affb192-08ba-49b3-a3f3-a6970b81257a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 09:34:39.562380 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application [None req-4affb192-08ba-49b3-a3f3-a6970b81257a None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 27 09:34:39.562380 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 09:34:39.562380 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 09:34:39.562380 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 09:34:39.562380 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 09:34:39.562380 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 09:34:39.562380 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 09:34:39.562380 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 09:34:39.562380 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 09:34:39.562380 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 09:34:39.562380 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 09:34:39.562380 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 09:34:39.562380 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 27 09:34:39.562380 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 27 09:34:39.562380 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 27 09:34:39.562380 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 27 09:34:39.563544 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 27 09:34:39.563544 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 27 09:34:39.563544 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 27 09:34:39.563544 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 27 09:34:39.563544 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 09:34:39.563544 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 09:34:39.563544 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 09:34:39.563544 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 09:34:39.563544 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 09:34:39.563544 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 09:34:39.563544 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 09:34:39.563544 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application with Lock( Oct 27 09:34:39.563544 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 09:34:39.563544 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._enter() Oct 27 09:34:39.563544 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 09:34:39.563544 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 09:34:39.564372 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 09:34:39.564372 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.creator() Oct 27 09:34:39.564372 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 09:34:39.564372 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application created_value = creator( Oct 27 09:34:39.564372 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 27 09:34:39.564372 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 27 09:34:39.564372 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 27 09:34:39.564372 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 27 09:34:39.564372 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 27 09:34:39.564372 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 27 09:34:39.564372 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 27 09:34:39.564372 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application Oct 27 09:34:39.564372 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 402/791] 10.222.0.65 () {56 vars in 1120 bytes} [Thu Oct 27 09:34:39 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 09:34:39.567369 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4affb192-08ba-49b3-a3f3-a6970b81257a None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:34:39.567800 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d608d44-1639-456a-bde6-5008a79d2efd None None] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:34:39.568094 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d608d44-1639-456a-bde6-5008a79d2efd None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:34:39.568375 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d608d44-1639-456a-bde6-5008a79d2efd None None] PATH_INFO: `/` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:34:39.570603 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 390/792] 10.222.0.65 () {54 vars in 927 bytes} [Thu Oct 27 09:34:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 09:34:39.575769 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdb2d7d-581d-4ce9-9962-e533f5bd6b2c None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:34:39.576052 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdb2d7d-581d-4ce9-9962-e533f5bd6b2c None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:34:39.576323 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdb2d7d-581d-4ce9-9962-e533f5bd6b2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:34:39.595711 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-4fdb2d7d-581d-4ce9-9962-e533f5bd6b2c None None] MFA Rules not processed for user `b5065084bf664b99bdeac46067cb0f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:34:39.597006 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-4fdb2d7d-581d-4ce9-9962-e533f5bd6b2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:34:39.672965 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:34:39.677197 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:34:39.681383 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4affb192-08ba-49b3-a3f3-a6970b81257a None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:34:39.700174 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 391/793] 10.222.0.65 () {58 vars in 1024 bytes} [Thu Oct 27 09:34:39 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 27 09:34:39.721096 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89430980-d696-475d-8900-8198c982e914 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:34:39.721703 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89430980-d696-475d-8900-8198c982e914 None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:34:39.721981 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89430980-d696-475d-8900-8198c982e914 None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:34:39.722248 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89430980-d696-475d-8900-8198c982e914 None admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:34:39.722932 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89430980-d696-475d-8900-8198c982e914 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 09:34:39.723235 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89430980-d696-475d-8900-8198c982e914 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:34:39.724600 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89430980-d696-475d-8900-8198c982e914 None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:34:39.734557 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 403/794] 10.222.0.65 () {56 vars in 1115 bytes} [Thu Oct 27 09:34:39 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 09:34:39.740464 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdb2d7d-581d-4ce9-9962-e533f5bd6b2c None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:34:39.844729 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdb2d7d-581d-4ce9-9962-e533f5bd6b2c None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:34:39.883682 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1edab33-6a97-433f-88ac-66a083047ed0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:34:39.884314 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1edab33-6a97-433f-88ac-66a083047ed0 None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:34:39.884599 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1edab33-6a97-433f-88ac-66a083047ed0 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:34:39.884872 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1edab33-6a97-433f-88ac-66a083047ed0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:34:39.895651 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1edab33-6a97-433f-88ac-66a083047ed0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:34:39.897074 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1edab33-6a97-433f-88ac-66a083047ed0 None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:34:39.912400 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application [None req-a1edab33-6a97-433f-88ac-66a083047ed0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 09:34:39.912400 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 09:34:39.912400 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 09:34:39.912400 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 09:34:39.912400 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 09:34:39.912400 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 09:34:39.912400 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 09:34:39.912400 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 09:34:39.912400 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 09:34:39.912400 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 09:34:39.912400 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 09:34:39.912400 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 09:34:39.912400 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 27 09:34:39.912400 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 27 09:34:39.912400 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 27 09:34:39.912400 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 27 09:34:39.913368 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 09:34:39.913368 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 09:34:39.913368 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 09:34:39.913368 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 09:34:39.913368 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 09:34:39.913368 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 09:34:39.913368 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 09:34:39.913368 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application with Lock( Oct 27 09:34:39.913368 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 09:34:39.913368 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._enter() Oct 27 09:34:39.913368 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 09:34:39.913368 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 09:34:39.913368 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 09:34:39.913368 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.creator() Oct 27 09:34:39.913368 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 09:34:39.913368 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application created_value = creator( Oct 27 09:34:39.913368 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 27 09:34:39.919559 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 27 09:34:39.919559 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 09:34:39.919559 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application Oct 27 09:34:39.919559 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 392/795] 10.222.0.65 () {56 vars in 1108 bytes} [Thu Oct 27 09:34:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 09:34:39.921641 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89430980-d696-475d-8900-8198c982e914 None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:34:39.975769 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1edab33-6a97-433f-88ac-66a083047ed0 None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:34:40.022145 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:34:40.031162 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89430980-d696-475d-8900-8198c982e914 None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:34:40.071073 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ab652b-ef74-40f0-9f38-76ccdeba6aa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:34:40.071506 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ab652b-ef74-40f0-9f38-76ccdeba6aa6 None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:34:40.071792 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ab652b-ef74-40f0-9f38-76ccdeba6aa6 None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:34:40.072066 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ab652b-ef74-40f0-9f38-76ccdeba6aa6 None admin] PATH_INFO: `/v3/domains` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:34:40.072718 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ab652b-ef74-40f0-9f38-76ccdeba6aa6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 09:34:40.073023 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ab652b-ef74-40f0-9f38-76ccdeba6aa6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:34:40.074393 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ab652b-ef74-40f0-9f38-76ccdeba6aa6 None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:34:40.088406 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 404/796] 10.222.0.65 () {56 vars in 1109 bytes} [Thu Oct 27 09:34:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 09:34:40.093888 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ab652b-ef74-40f0-9f38-76ccdeba6aa6 None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:34:40.106671 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1edab33-6a97-433f-88ac-66a083047ed0 None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:34:40.118572 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:34:40.146788 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ab9519-57b3-46a9-933c-afb365c94c68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:34:40.148011 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ab9519-57b3-46a9-933c-afb365c94c68 None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:34:40.149280 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ab9519-57b3-46a9-933c-afb365c94c68 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:34:40.149760 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ab9519-57b3-46a9-933c-afb365c94c68 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:34:40.151106 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ab9519-57b3-46a9-933c-afb365c94c68 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:34:40.153461 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ab9519-57b3-46a9-933c-afb365c94c68 None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:34:40.156292 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 393/797] 10.222.0.65 () {56 vars in 1108 bytes} [Thu Oct 27 09:34:39 2022] GET /identity/v3/domains/default => generated 199 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 09:34:40.162033 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ab9519-57b3-46a9-933c-afb365c94c68 None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:34:40.208270 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ab652b-ef74-40f0-9f38-76ccdeba6aa6 None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:34:40.244034 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a01869-60a1-4c69-a9d5-e4da8750f14e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:34:40.244592 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a01869-60a1-4c69-a9d5-e4da8750f14e None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:34:40.244874 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a01869-60a1-4c69-a9d5-e4da8750f14e None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:34:40.245153 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a01869-60a1-4c69-a9d5-e4da8750f14e None admin] PATH_INFO: `/v3/users/nova` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:34:40.253715 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a01869-60a1-4c69-a9d5-e4da8750f14e None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:34:40.255648 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a01869-60a1-4c69-a9d5-e4da8750f14e None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:34:40.267898 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application [None req-82a01869-60a1-4c69-a9d5-e4da8750f14e None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 27 09:34:40.267898 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 09:34:40.267898 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 09:34:40.267898 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 09:34:40.267898 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 09:34:40.267898 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 09:34:40.267898 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 09:34:40.267898 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 09:34:40.267898 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 09:34:40.267898 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 09:34:40.267898 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 09:34:40.267898 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 09:34:40.267898 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 27 09:34:40.267898 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 27 09:34:40.267898 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 27 09:34:40.267898 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 27 09:34:40.268898 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 09:34:40.268898 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 09:34:40.268898 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 27 09:34:40.268898 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 27 09:34:40.268898 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 27 09:34:40.268898 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 27 09:34:40.268898 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 09:34:40.268898 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 09:34:40.268898 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 09:34:40.268898 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 09:34:40.268898 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 09:34:40.268898 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application with Lock( Oct 27 09:34:40.268898 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 09:34:40.268898 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._enter() Oct 27 09:34:40.268898 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 09:34:40.268898 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 09:34:40.268898 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 09:34:40.268898 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.creator() Oct 27 09:34:40.269833 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 09:34:40.269833 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application created_value = creator( Oct 27 09:34:40.269833 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 27 09:34:40.269833 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 27 09:34:40.269833 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 27 09:34:40.269833 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 27 09:34:40.269833 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 27 09:34:40.269833 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 27 09:34:40.269833 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 27 09:34:40.269833 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application Oct 27 09:34:40.269833 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 405/798] 10.222.0.65 () {56 vars in 1093 bytes} [Thu Oct 27 09:34:40 2022] GET /identity/v3/users/nova => generated 82 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 27 09:34:40.275251 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a01869-60a1-4c69-a9d5-e4da8750f14e None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:34:40.282603 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:34:40.287613 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ab9519-57b3-46a9-933c-afb365c94c68 None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:34:40.326438 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49e39b5-f117-4d66-a51e-e27be891eb3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:34:40.327139 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49e39b5-f117-4d66-a51e-e27be891eb3b None admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:34:40.327426 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49e39b5-f117-4d66-a51e-e27be891eb3b None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:34:40.327736 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49e39b5-f117-4d66-a51e-e27be891eb3b None admin] PATH_INFO: `/v3/users` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:34:40.328395 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49e39b5-f117-4d66-a51e-e27be891eb3b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:34:40.329985 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49e39b5-f117-4d66-a51e-e27be891eb3b None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:34:40.365659 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:34:40.384882 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a01869-60a1-4c69-a9d5-e4da8750f14e None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:34:40.420233 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8813681-6c4c-4133-a97e-db45babb8fd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:34:40.420870 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8813681-6c4c-4133-a97e-db45babb8fd1 None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:34:40.421171 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8813681-6c4c-4133-a97e-db45babb8fd1 None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:34:40.421441 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8813681-6c4c-4133-a97e-db45babb8fd1 None admin] PATH_INFO: `/v3/users` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:34:40.422169 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8813681-6c4c-4133-a97e-db45babb8fd1 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 09:34:40.422478 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8813681-6c4c-4133-a97e-db45babb8fd1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:34:40.423935 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8813681-6c4c-4133-a97e-db45babb8fd1 None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:34:40.441779 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 406/799] 10.222.0.65 () {56 vars in 1133 bytes} [Thu Oct 27 09:34:40 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 09:34:40.442208 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 394/800] 10.222.0.65 () {60 vars in 1132 bytes} [Thu Oct 27 09:34:40 2022] POST /identity/v3/users => generated 285 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 09:34:40.449327 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8813681-6c4c-4133-a97e-db45babb8fd1 None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:34:40.572302 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8813681-6c4c-4133-a97e-db45babb8fd1 None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:34:40.611539 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac652a61-cb53-4f2c-a2f5-98206c6a8f97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:34:40.612189 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac652a61-cb53-4f2c-a2f5-98206c6a8f97 None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:34:40.612468 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac652a61-cb53-4f2c-a2f5-98206c6a8f97 None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:34:40.612742 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac652a61-cb53-4f2c-a2f5-98206c6a8f97 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:34:40.620926 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:34:40.621535 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee38d77-5c19-4409-afb1-ca945ce2580c None None] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:34:40.621761 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee38d77-5c19-4409-afb1-ca945ce2580c None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:34:40.622017 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee38d77-5c19-4409-afb1-ca945ce2580c None None] PATH_INFO: `/` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:34:40.623541 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 395/801] 10.222.0.65 () {54 vars in 927 bytes} [Thu Oct 27 09:34:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 27 09:34:40.626468 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac652a61-cb53-4f2c-a2f5-98206c6a8f97 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:34:40.628230 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac652a61-cb53-4f2c-a2f5-98206c6a8f97 None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:34:40.629295 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914a5fd7-d1fd-42ee-9531-a2596f262b5f None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:34:40.629295 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914a5fd7-d1fd-42ee-9531-a2596f262b5f None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:34:40.629295 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914a5fd7-d1fd-42ee-9531-a2596f262b5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:34:40.647076 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application [None req-ac652a61-cb53-4f2c-a2f5-98206c6a8f97 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 09:34:40.647076 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 09:34:40.647076 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 09:34:40.647076 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 09:34:40.647076 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 09:34:40.647076 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 09:34:40.647076 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 09:34:40.647076 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 09:34:40.647076 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 09:34:40.647076 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 09:34:40.647076 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 09:34:40.647076 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 09:34:40.647076 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 27 09:34:40.647076 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 27 09:34:40.647076 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 27 09:34:40.647076 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 27 09:34:40.648506 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 09:34:40.648506 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 09:34:40.648506 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 09:34:40.648506 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 09:34:40.648506 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 09:34:40.648506 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 09:34:40.648506 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 09:34:40.648506 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application with Lock( Oct 27 09:34:40.648506 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 09:34:40.648506 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._enter() Oct 27 09:34:40.648506 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 09:34:40.648506 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 09:34:40.648506 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 09:34:40.648506 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.creator() Oct 27 09:34:40.648506 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 09:34:40.648506 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application created_value = creator( Oct 27 09:34:40.648506 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 27 09:34:40.649581 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 27 09:34:40.649581 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 09:34:40.649581 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application Oct 27 09:34:40.649581 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 407/802] 10.222.0.65 () {56 vars in 1108 bytes} [Thu Oct 27 09:34:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 09:34:40.650776 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-914a5fd7-d1fd-42ee-9531-a2596f262b5f None None] MFA Rules not processed for user `b5065084bf664b99bdeac46067cb0f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:34:40.651966 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-914a5fd7-d1fd-42ee-9531-a2596f262b5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:34:40.655662 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac652a61-cb53-4f2c-a2f5-98206c6a8f97 None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:34:40.732062 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 396/803] 10.222.0.65 () {58 vars in 1024 bytes} [Thu Oct 27 09:34:40 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 27 09:34:40.773932 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac652a61-cb53-4f2c-a2f5-98206c6a8f97 None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:34:40.809036 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accd6c51-207d-438f-a8b7-0a7618242ce6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:34:40.809638 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accd6c51-207d-438f-a8b7-0a7618242ce6 None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:34:40.809914 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accd6c51-207d-438f-a8b7-0a7618242ce6 None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:34:40.810185 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accd6c51-207d-438f-a8b7-0a7618242ce6 None admin] PATH_INFO: `/v3/domains` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:34:40.810866 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-accd6c51-207d-438f-a8b7-0a7618242ce6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 09:34:40.811163 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-accd6c51-207d-438f-a8b7-0a7618242ce6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:34:40.812526 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-accd6c51-207d-438f-a8b7-0a7618242ce6 None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:34:40.825140 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 408/804] 10.222.0.65 () {56 vars in 1109 bytes} [Thu Oct 27 09:34:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 09:34:40.831159 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914a5fd7-d1fd-42ee-9531-a2596f262b5f None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:34:40.923435 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:34:40.939328 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914a5fd7-d1fd-42ee-9531-a2596f262b5f None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:34:40.974853 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf3cf22-bb9a-4633-88a3-320e23c1c725 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:34:40.975489 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf3cf22-bb9a-4633-88a3-320e23c1c725 None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:34:40.975770 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf3cf22-bb9a-4633-88a3-320e23c1c725 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:34:40.976131 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf3cf22-bb9a-4633-88a3-320e23c1c725 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:34:40.983398 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf3cf22-bb9a-4633-88a3-320e23c1c725 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:34:40.984862 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf3cf22-bb9a-4633-88a3-320e23c1c725 None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:34:40.996728 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application [None req-dbf3cf22-bb9a-4633-88a3-320e23c1c725 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 27 09:34:40.996728 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 09:34:40.996728 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 09:34:40.996728 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 09:34:40.996728 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 09:34:40.996728 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 09:34:40.996728 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 09:34:40.996728 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 09:34:40.996728 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 09:34:40.996728 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 09:34:40.996728 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 09:34:40.996728 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 09:34:40.996728 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 27 09:34:40.996728 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 27 09:34:40.996728 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 27 09:34:40.997692 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 27 09:34:40.997692 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 09:34:40.997692 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 09:34:40.997692 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 09:34:40.997692 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 09:34:40.997692 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 09:34:40.997692 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 09:34:40.997692 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 09:34:40.997692 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application with Lock( Oct 27 09:34:40.997692 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 09:34:40.997692 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._enter() Oct 27 09:34:40.997692 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 09:34:40.997692 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 09:34:40.997692 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 09:34:40.997692 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.creator() Oct 27 09:34:40.997692 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 09:34:40.997692 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application created_value = creator( Oct 27 09:34:40.998597 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 27 09:34:40.998597 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 27 09:34:40.998597 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 27 09:34:40.998597 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 27 09:34:40.998597 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 27 09:34:40.998597 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 27 09:34:40.998597 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 27 09:34:40.998597 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application Oct 27 09:34:40.998597 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 397/805] 10.222.0.65 () {56 vars in 1111 bytes} [Thu Oct 27 09:34:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 09:34:41.003872 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accd6c51-207d-438f-a8b7-0a7618242ce6 None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:34:41.005528 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf3cf22-bb9a-4633-88a3-320e23c1c725 None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:34:41.059001 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:34:41.110188 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accd6c51-207d-438f-a8b7-0a7618242ce6 None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:34:41.111842 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf3cf22-bb9a-4633-88a3-320e23c1c725 None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:34:41.144950 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78632048-bd33-4f6a-a811-6f9df695fb5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:34:41.145559 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78632048-bd33-4f6a-a811-6f9df695fb5c None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:34:41.145844 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78632048-bd33-4f6a-a811-6f9df695fb5c None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:34:41.146113 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78632048-bd33-4f6a-a811-6f9df695fb5c None admin] PATH_INFO: `/v3/projects` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:34:41.146826 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78632048-bd33-4f6a-a811-6f9df695fb5c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 09:34:41.147132 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78632048-bd33-4f6a-a811-6f9df695fb5c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:34:41.148562 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf25bfe8-e5bf-4568-b2c3-a714c2e2cfd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:34:41.148724 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78632048-bd33-4f6a-a811-6f9df695fb5c None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:34:41.149586 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf25bfe8-e5bf-4568-b2c3-a714c2e2cfd6 None admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:34:41.150051 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf25bfe8-e5bf-4568-b2c3-a714c2e2cfd6 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:34:41.150502 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf25bfe8-e5bf-4568-b2c3-a714c2e2cfd6 None admin] PATH_INFO: `/v3/domains` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:34:41.151341 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf25bfe8-e5bf-4568-b2c3-a714c2e2cfd6 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:34:41.152701 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf25bfe8-e5bf-4568-b2c3-a714c2e2cfd6 None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:34:41.161158 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 409/806] 10.222.0.65 () {56 vars in 1148 bytes} [Thu Oct 27 09:34:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 09:34:41.167745 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78632048-bd33-4f6a-a811-6f9df695fb5c None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:34:41.193556 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.sql.core [None req-bf25bfe8-e5bf-4568-b2c3-a714c2e2cfd6 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Oct 27 09:34:41.193556 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 27 09:34:41.193556 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [parameters: {'id': 'add8ef6a51fa4f2a9a0704561e7729e4', 'name': 'Default', 'domain_id': '<>', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': None, 'is_domain': 1}] Oct 27 09:34:41.193556 dv-cinder-797970-7-smb devstack@keystone.service[88312]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=88312) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 27 09:34:41.201629 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application [None req-bf25bfe8-e5bf-4568-b2c3-a714c2e2cfd6 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default. Oct 27 09:34:41.201629 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 09:34:41.201629 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 27 09:34:41.201629 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 27 09:34:41.201629 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 27 09:34:41.201629 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 27 09:34:41.201629 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 27 09:34:41.201629 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application result = self._query(query) Oct 27 09:34:41.201629 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 27 09:34:41.201629 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application conn.query(q) Oct 27 09:34:41.201629 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 27 09:34:41.201629 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 27 09:34:41.201629 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 27 09:34:41.201629 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application result.read() Oct 27 09:34:41.202496 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 27 09:34:41.202496 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 27 09:34:41.202496 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 27 09:34:41.202496 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 27 09:34:41.202496 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 27 09:34:41.202496 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 27 09:34:41.202496 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 27 09:34:41.202496 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 27 09:34:41.202496 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Oct 27 09:34:41.202496 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application Oct 27 09:34:41.202496 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 27 09:34:41.202496 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application Oct 27 09:34:41.202496 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 09:34:41.202496 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 27 09:34:41.202496 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 27 09:34:41.202496 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Oct 27 09:34:41.202496 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return project_ref.to_dict() Oct 27 09:34:41.202496 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 27 09:34:41.207519 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application next(self.gen) Oct 27 09:34:41.207519 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1068, in _transaction_scope Oct 27 09:34:41.207519 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application yield resource Oct 27 09:34:41.207519 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 27 09:34:41.207519 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application next(self.gen) Oct 27 09:34:41.207519 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 670, in _session Oct 27 09:34:41.207519 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application self.session.rollback() Oct 27 09:34:41.207519 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 27 09:34:41.207519 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application self.force_reraise() Oct 27 09:34:41.207519 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 27 09:34:41.207519 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application raise self.value Oct 27 09:34:41.207519 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 667, in _session Oct 27 09:34:41.207519 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 27 09:34:41.207519 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 695, in _end_session_transaction Oct 27 09:34:41.207519 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application session.commit() Oct 27 09:34:41.207519 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 27 09:34:41.207519 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 27 09:34:41.208365 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 27 09:34:41.208365 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application self._prepare_impl() Oct 27 09:34:41.208365 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 27 09:34:41.208365 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application self.session.flush() Oct 27 09:34:41.208365 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 27 09:34:41.208365 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application self._flush(objects) Oct 27 09:34:41.208365 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 27 09:34:41.208365 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 27 09:34:41.208365 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 27 09:34:41.208365 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application compat.raise_( Oct 27 09:34:41.208365 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 27 09:34:41.208365 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application raise exception Oct 27 09:34:41.208365 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 27 09:34:41.208365 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application flush_context.execute() Oct 27 09:34:41.208365 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 27 09:34:41.208365 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application rec.execute(self) Oct 27 09:34:41.208365 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 27 09:34:41.209215 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 27 09:34:41.209215 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 27 09:34:41.209215 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 27 09:34:41.209215 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Oct 27 09:34:41.209215 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application c = connection._execute_20( Oct 27 09:34:41.209215 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 27 09:34:41.209215 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 27 09:34:41.209215 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 27 09:34:41.209215 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 27 09:34:41.209215 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 27 09:34:41.209215 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 27 09:34:41.209215 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 27 09:34:41.209215 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 27 09:34:41.209215 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 27 09:34:41.209215 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 27 09:34:41.209974 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 27 09:34:41.209974 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application raise exception Oct 27 09:34:41.209974 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 27 09:34:41.209974 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 27 09:34:41.209974 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 27 09:34:41.209974 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 27 09:34:41.209974 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 27 09:34:41.209974 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application result = self._query(query) Oct 27 09:34:41.209974 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 27 09:34:41.209974 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application conn.query(q) Oct 27 09:34:41.209974 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 27 09:34:41.209974 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 27 09:34:41.209974 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 27 09:34:41.209974 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application result.read() Oct 27 09:34:41.209974 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 27 09:34:41.209974 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 27 09:34:41.209974 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 27 09:34:41.211497 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 27 09:34:41.211497 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 27 09:34:41.211497 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 27 09:34:41.211497 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 27 09:34:41.211497 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 27 09:34:41.211497 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Oct 27 09:34:41.211497 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 27 09:34:41.211497 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application [parameters: {'id': 'add8ef6a51fa4f2a9a0704561e7729e4', 'name': 'Default', 'domain_id': '<>', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': None, 'is_domain': 1}] Oct 27 09:34:41.211497 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 27 09:34:41.211497 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application Oct 27 09:34:41.211497 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 27 09:34:41.211497 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application Oct 27 09:34:41.211497 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 09:34:41.211497 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Oct 27 09:34:41.211497 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Oct 27 09:34:41.212262 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 27 09:34:41.212262 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 27 09:34:41.212262 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name Default. Oct 27 09:34:41.212262 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application Oct 27 09:34:41.212262 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 27 09:34:41.212262 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application Oct 27 09:34:41.212262 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 09:34:41.212262 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 09:34:41.212262 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 09:34:41.212262 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 09:34:41.212262 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 09:34:41.212262 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 09:34:41.212262 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 09:34:41.212262 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 09:34:41.212262 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 09:34:41.212262 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 09:34:41.212262 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 09:34:41.213118 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 128, in post Oct 27 09:34:41.213118 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_domain( Oct 27 09:34:41.213118 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 09:34:41.213118 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 09:34:41.213118 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 765, in create_domain Oct 27 09:34:41.213118 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application is_domain_project = self.create_project( Oct 27 09:34:41.213118 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 09:34:41.213118 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 09:34:41.213118 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Oct 27 09:34:41.213118 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application raise exception.Conflict( Oct 27 09:34:41.213118 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default. Oct 27 09:34:41.213118 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application Oct 27 09:34:41.213118 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 398/807] 10.222.0.65 () {60 vars in 1137 bytes} [Thu Oct 27 09:34:41 2022] POST /identity/v3/domains => generated 190 bytes in 198 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Oct 27 09:34:41.215082 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf25bfe8-e5bf-4568-b2c3-a714c2e2cfd6 None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:34:41.226766 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:34:41.284378 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78632048-bd33-4f6a-a811-6f9df695fb5c None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:34:41.296584 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:34:41.323156 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd589a01-e5a1-4feb-a120-97e6a06eb5da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:34:41.323835 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd589a01-e5a1-4feb-a120-97e6a06eb5da None admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:34:41.324116 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd589a01-e5a1-4feb-a120-97e6a06eb5da None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:34:41.324397 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd589a01-e5a1-4feb-a120-97e6a06eb5da None admin] PATH_INFO: `/v3/projects/dc2e3a7a1bcc480891c0b433291c00b1/users/fd0d23ef039d4f1591a589d302ef165f/roles/ed04e37a302d4d4c9d940d9dc8d11599` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:34:41.326654 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd589a01-e5a1-4feb-a120-97e6a06eb5da None admin] RBAC: Authorizing `identity:create_grant(project_id=dc2e3a7a1bcc480891c0b433291c00b1, user_id=fd0d23ef039d4f1591a589d302ef165f, role_id=ed04e37a302d4d4c9d940d9dc8d11599)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:34:41.327429 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf25bfe8-e5bf-4568-b2c3-a714c2e2cfd6 None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:34:41.328093 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd589a01-e5a1-4feb-a120-97e6a06eb5da None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:34:41.362963 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a030356-1fb2-4756-8492-0827810bbfd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:34:41.363495 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a030356-1fb2-4756-8492-0827810bbfd2 None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:34:41.363784 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a030356-1fb2-4756-8492-0827810bbfd2 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:34:41.364056 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a030356-1fb2-4756-8492-0827810bbfd2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:34:41.375847 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a030356-1fb2-4756-8492-0827810bbfd2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:34:41.377303 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a030356-1fb2-4756-8492-0827810bbfd2 None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:34:41.393718 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application [None req-5a030356-1fb2-4756-8492-0827810bbfd2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 09:34:41.393718 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 09:34:41.393718 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 09:34:41.393718 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 09:34:41.393718 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 09:34:41.393718 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 09:34:41.393718 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 09:34:41.393718 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 09:34:41.393718 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 09:34:41.393718 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 09:34:41.393718 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 09:34:41.393718 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 09:34:41.393718 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 27 09:34:41.393718 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 27 09:34:41.393718 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 27 09:34:41.393718 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 27 09:34:41.394819 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 09:34:41.394819 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 09:34:41.394819 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 09:34:41.394819 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 09:34:41.394819 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 09:34:41.394819 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 09:34:41.394819 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 09:34:41.394819 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application with Lock( Oct 27 09:34:41.394819 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 09:34:41.394819 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._enter() Oct 27 09:34:41.394819 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 09:34:41.394819 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 09:34:41.394819 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 09:34:41.394819 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.creator() Oct 27 09:34:41.394819 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 09:34:41.394819 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application created_value = creator( Oct 27 09:34:41.394819 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 27 09:34:41.395700 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 27 09:34:41.395700 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 09:34:41.395700 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application Oct 27 09:34:41.395700 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 399/808] 10.222.0.65 () {56 vars in 1108 bytes} [Thu Oct 27 09:34:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 09:34:41.401657 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a030356-1fb2-4756-8492-0827810bbfd2 None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:34:41.412330 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 410/809] 10.222.0.65 () {58 vars in 1439 bytes} [Thu Oct 27 09:34:41 2022] PUT /identity/v3/projects/dc2e3a7a1bcc480891c0b433291c00b1/users/fd0d23ef039d4f1591a589d302ef165f/roles/ed04e37a302d4d4c9d940d9dc8d11599 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 09:34:41.472796 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:34:41.520910 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a030356-1fb2-4756-8492-0827810bbfd2 None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:34:41.559295 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48eb1222-8c70-4729-85b4-c54382abcf65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:34:41.559923 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48eb1222-8c70-4729-85b4-c54382abcf65 None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:34:41.560208 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48eb1222-8c70-4729-85b4-c54382abcf65 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:34:41.560486 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48eb1222-8c70-4729-85b4-c54382abcf65 None admin] PATH_INFO: `/v3/domains` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:34:41.562851 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48eb1222-8c70-4729-85b4-c54382abcf65 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 09:34:41.562851 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48eb1222-8c70-4729-85b4-c54382abcf65 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:34:41.562851 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48eb1222-8c70-4729-85b4-c54382abcf65 None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:34:41.577682 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 400/810] 10.222.0.65 () {56 vars in 1109 bytes} [Thu Oct 27 09:34:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 09:34:42.691426 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51190098-9bf5-4c97-b046-90d311822e80 None None] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:34:42.692010 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51190098-9bf5-4c97-b046-90d311822e80 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:34:42.692010 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51190098-9bf5-4c97-b046-90d311822e80 None None] PATH_INFO: `/` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:34:42.693304 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 411/811] 10.222.0.65 () {54 vars in 927 bytes} [Thu Oct 27 09:34:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 09:34:42.698774 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7cdabf-5719-4daa-a441-2877b9596466 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:34:42.699230 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7cdabf-5719-4daa-a441-2877b9596466 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:34:42.699341 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7cdabf-5719-4daa-a441-2877b9596466 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:34:42.717400 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-5a7cdabf-5719-4daa-a441-2877b9596466 None None] MFA Rules not processed for user `b5065084bf664b99bdeac46067cb0f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:34:42.718623 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-5a7cdabf-5719-4daa-a441-2877b9596466 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:34:42.786854 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 401/812] 10.222.0.65 () {58 vars in 1024 bytes} [Thu Oct 27 09:34:42 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 27 09:34:43.053337 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51190098-9bf5-4c97-b046-90d311822e80 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:34:43.155982 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51190098-9bf5-4c97-b046-90d311822e80 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:34:43.191667 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ffd39d-4fe7-4f87-a64c-091cd90b11d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:34:43.192309 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ffd39d-4fe7-4f87-a64c-091cd90b11d2 None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:34:43.192582 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ffd39d-4fe7-4f87-a64c-091cd90b11d2 None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:34:43.192855 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ffd39d-4fe7-4f87-a64c-091cd90b11d2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:34:43.203806 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ffd39d-4fe7-4f87-a64c-091cd90b11d2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 09:34:43.208561 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application [None req-78ffd39d-4fe7-4f87-a64c-091cd90b11d2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 27 09:34:43.208561 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 09:34:43.208561 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 09:34:43.208561 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 09:34:43.208561 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 09:34:43.208561 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 09:34:43.208561 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 09:34:43.208561 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 09:34:43.208561 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 09:34:43.208561 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 09:34:43.208561 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 09:34:43.208561 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 09:34:43.208561 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 27 09:34:43.208561 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 27 09:34:43.208561 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 27 09:34:43.208561 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 27 09:34:43.209604 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 27 09:34:43.209604 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 27 09:34:43.209604 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 27 09:34:43.209604 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 27 09:34:43.209604 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 09:34:43.209604 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 09:34:43.209604 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 09:34:43.209604 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 09:34:43.209604 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 09:34:43.209604 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 09:34:43.209604 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 09:34:43.209604 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application with Lock( Oct 27 09:34:43.209604 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 09:34:43.209604 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._enter() Oct 27 09:34:43.209604 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 09:34:43.209604 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 09:34:43.210644 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 09:34:43.210644 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.creator() Oct 27 09:34:43.210644 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 09:34:43.210644 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application created_value = creator( Oct 27 09:34:43.210644 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 27 09:34:43.210644 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 27 09:34:43.210644 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 27 09:34:43.210644 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 27 09:34:43.210644 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 27 09:34:43.210644 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 27 09:34:43.210644 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 27 09:34:43.210644 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application Oct 27 09:34:43.210644 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 412/813] 10.222.0.65 () {56 vars in 1096 bytes} [Thu Oct 27 09:34:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 09:34:43.215687 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7cdabf-5719-4daa-a441-2877b9596466 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:34:43.265761 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:34:43.316319 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7cdabf-5719-4daa-a441-2877b9596466 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:34:43.352471 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b00b23-b122-49ac-8904-4d11887b1120 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:34:43.353070 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b00b23-b122-49ac-8904-4d11887b1120 None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:34:43.353348 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b00b23-b122-49ac-8904-4d11887b1120 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:34:43.353621 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b00b23-b122-49ac-8904-4d11887b1120 None admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:34:43.354280 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b00b23-b122-49ac-8904-4d11887b1120 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 09:34:43.354625 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b00b23-b122-49ac-8904-4d11887b1120 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:34:43.355987 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b00b23-b122-49ac-8904-4d11887b1120 None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:34:43.364798 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 402/814] 10.222.0.65 () {56 vars in 1099 bytes} [Thu Oct 27 09:34:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 09:34:43.371290 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ffd39d-4fe7-4f87-a64c-091cd90b11d2 None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:34:43.402333 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:34:43.474633 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ffd39d-4fe7-4f87-a64c-091cd90b11d2 None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:34:43.627615 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1ef193-be19-48e2-ae75-7d546b3a7b15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:34:43.627810 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b22d41-c09e-469c-9ca1-207b56198b22 None None] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:34:43.628053 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b22d41-c09e-469c-9ca1-207b56198b22 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:34:43.628147 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1ef193-be19-48e2-ae75-7d546b3a7b15 None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:34:43.628331 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b22d41-c09e-469c-9ca1-207b56198b22 None None] PATH_INFO: `/` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:34:43.628443 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1ef193-be19-48e2-ae75-7d546b3a7b15 None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:34:43.628815 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1ef193-be19-48e2-ae75-7d546b3a7b15 None admin] PATH_INFO: `/v3/users/2346f5de8b4643099d43301191b89147` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:34:43.629684 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 403/815] 10.222.0.65 () {54 vars in 927 bytes} [Thu Oct 27 09:34:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 27 09:34:43.634929 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbae3580-0022-4dda-9da2-4181d63aad73 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:34:43.635213 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbae3580-0022-4dda-9da2-4181d63aad73 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:34:43.635486 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbae3580-0022-4dda-9da2-4181d63aad73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:34:43.646687 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1ef193-be19-48e2-ae75-7d546b3a7b15 None admin] RBAC: Authorizing `identity:get_user(user_id=2346f5de8b4643099d43301191b89147)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:34:43.649667 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1ef193-be19-48e2-ae75-7d546b3a7b15 None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:34:43.651413 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 413/816] 10.222.0.65 () {56 vars in 1177 bytes} [Thu Oct 27 09:34:43 2022] GET /identity/v3/users/2346f5de8b4643099d43301191b89147 => generated 285 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 09:34:43.654627 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-fbae3580-0022-4dda-9da2-4181d63aad73 None None] MFA Rules not processed for user `b5065084bf664b99bdeac46067cb0f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:34:43.655886 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-fbae3580-0022-4dda-9da2-4181d63aad73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:34:43.657155 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1ef193-be19-48e2-ae75-7d546b3a7b15 None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:34:43.727941 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 404/817] 10.222.0.65 () {58 vars in 1024 bytes} [Thu Oct 27 09:34:43 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 27 09:34:43.747702 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:34:43.759690 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1ef193-be19-48e2-ae75-7d546b3a7b15 None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:34:43.794021 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39506bfc-f8e7-4eaa-9b36-448b944062b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:34:43.794660 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39506bfc-f8e7-4eaa-9b36-448b944062b9 None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:34:43.794936 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39506bfc-f8e7-4eaa-9b36-448b944062b9 None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:34:43.795203 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39506bfc-f8e7-4eaa-9b36-448b944062b9 None admin] PATH_INFO: `/v3/projects/8f1f04f3720d40a49f82f06a7655ff85` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:34:43.796350 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39506bfc-f8e7-4eaa-9b36-448b944062b9 None admin] RBAC: Authorizing `identity:get_project(project_id=8f1f04f3720d40a49f82f06a7655ff85)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:34:43.797760 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39506bfc-f8e7-4eaa-9b36-448b944062b9 None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:34:43.799371 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 414/818] 10.222.0.65 () {56 vars in 1186 bytes} [Thu Oct 27 09:34:43 2022] GET /identity/v3/projects/8f1f04f3720d40a49f82f06a7655ff85 => generated 311 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 09:34:43.805376 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbae3580-0022-4dda-9da2-4181d63aad73 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:34:43.852397 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:34:43.912502 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbae3580-0022-4dda-9da2-4181d63aad73 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:34:43.947706 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb5b485-bfef-43c0-b7b2-84776ff026f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:34:43.948364 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb5b485-bfef-43c0-b7b2-84776ff026f9 None admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:34:43.948647 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb5b485-bfef-43c0-b7b2-84776ff026f9 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:34:43.948926 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb5b485-bfef-43c0-b7b2-84776ff026f9 None admin] PATH_INFO: `/v3/projects/8f1f04f3720d40a49f82f06a7655ff85/users/2346f5de8b4643099d43301191b89147/roles/6ad17b9f9dea4b66ab2da3677d7e715d` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:34:43.950908 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb5b485-bfef-43c0-b7b2-84776ff026f9 None admin] RBAC: Authorizing `identity:create_grant(project_id=8f1f04f3720d40a49f82f06a7655ff85, user_id=2346f5de8b4643099d43301191b89147, role_id=6ad17b9f9dea4b66ab2da3677d7e715d)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:34:43.952341 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb5b485-bfef-43c0-b7b2-84776ff026f9 None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:34:44.005680 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39506bfc-f8e7-4eaa-9b36-448b944062b9 None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:34:44.027219 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 405/819] 10.222.0.65 () {58 vars in 1439 bytes} [Thu Oct 27 09:34:43 2022] PUT /identity/v3/projects/8f1f04f3720d40a49f82f06a7655ff85/users/2346f5de8b4643099d43301191b89147/roles/6ad17b9f9dea4b66ab2da3677d7e715d => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 09:34:44.114664 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39506bfc-f8e7-4eaa-9b36-448b944062b9 None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:34:44.152886 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af928c3-2598-47e3-bf54-a8148afcd86b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:34:44.153546 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af928c3-2598-47e3-bf54-a8148afcd86b None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:34:44.153824 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af928c3-2598-47e3-bf54-a8148afcd86b None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:34:44.154127 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af928c3-2598-47e3-bf54-a8148afcd86b None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:34:44.166973 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af928c3-2598-47e3-bf54-a8148afcd86b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 09:34:44.171773 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application [None req-0af928c3-2598-47e3-bf54-a8148afcd86b None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 27 09:34:44.171773 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 09:34:44.171773 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 09:34:44.171773 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 09:34:44.171773 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 09:34:44.171773 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 09:34:44.171773 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 09:34:44.171773 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 09:34:44.171773 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 09:34:44.171773 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 09:34:44.171773 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 09:34:44.171773 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 09:34:44.171773 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 27 09:34:44.171773 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 27 09:34:44.171773 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 27 09:34:44.171773 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 27 09:34:44.172952 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 27 09:34:44.172952 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 27 09:34:44.172952 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 27 09:34:44.172952 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 27 09:34:44.172952 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 09:34:44.172952 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 09:34:44.172952 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 09:34:44.172952 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 09:34:44.172952 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 09:34:44.172952 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 09:34:44.172952 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 09:34:44.172952 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application with Lock( Oct 27 09:34:44.172952 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 09:34:44.172952 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._enter() Oct 27 09:34:44.172952 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 09:34:44.172952 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 09:34:44.173871 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 09:34:44.173871 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.creator() Oct 27 09:34:44.173871 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 09:34:44.173871 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application created_value = creator( Oct 27 09:34:44.173871 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 27 09:34:44.173871 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 27 09:34:44.173871 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 27 09:34:44.173871 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 27 09:34:44.173871 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 27 09:34:44.173871 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 27 09:34:44.173871 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 27 09:34:44.173871 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application Oct 27 09:34:44.178046 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 415/820] 10.222.0.65 () {56 vars in 1120 bytes} [Thu Oct 27 09:34:44 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 27 09:34:44.179540 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb5b485-bfef-43c0-b7b2-84776ff026f9 None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:34:44.284634 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb5b485-bfef-43c0-b7b2-84776ff026f9 None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:34:44.286150 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:34:44.321524 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9500961d-c5e9-4899-8832-319253fafc7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:34:44.322131 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9500961d-c5e9-4899-8832-319253fafc7f None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:34:44.322408 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9500961d-c5e9-4899-8832-319253fafc7f None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:34:44.322712 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9500961d-c5e9-4899-8832-319253fafc7f None admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:34:44.323385 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9500961d-c5e9-4899-8832-319253fafc7f None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 09:34:44.323959 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9500961d-c5e9-4899-8832-319253fafc7f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:34:44.325724 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9500961d-c5e9-4899-8832-319253fafc7f None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:34:44.335190 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 406/821] 10.222.0.65 () {56 vars in 1115 bytes} [Thu Oct 27 09:34:44 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 09:34:44.341854 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af928c3-2598-47e3-bf54-a8148afcd86b None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:34:44.359651 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:34:44.443939 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af928c3-2598-47e3-bf54-a8148afcd86b None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:34:44.478729 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e55f8d-5939-47aa-800e-282121d2a054 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:34:44.479358 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e55f8d-5939-47aa-800e-282121d2a054 None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:34:44.479632 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e55f8d-5939-47aa-800e-282121d2a054 None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:34:44.479901 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e55f8d-5939-47aa-800e-282121d2a054 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:34:44.490893 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e55f8d-5939-47aa-800e-282121d2a054 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:34:44.492927 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e55f8d-5939-47aa-800e-282121d2a054 None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:34:44.508299 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application [None req-e3e55f8d-5939-47aa-800e-282121d2a054 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 09:34:44.508299 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 09:34:44.508299 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 09:34:44.508299 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 09:34:44.508299 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 09:34:44.508299 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 09:34:44.508299 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 09:34:44.508299 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 09:34:44.508299 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 09:34:44.508299 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 09:34:44.508299 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 09:34:44.508299 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 09:34:44.508299 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 27 09:34:44.508299 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 27 09:34:44.508299 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 27 09:34:44.508299 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 27 09:34:44.509410 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 09:34:44.509410 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 09:34:44.509410 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 09:34:44.509410 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 09:34:44.509410 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 09:34:44.509410 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 09:34:44.509410 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 09:34:44.509410 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application with Lock( Oct 27 09:34:44.509410 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 09:34:44.509410 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._enter() Oct 27 09:34:44.509410 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 09:34:44.509410 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 09:34:44.509410 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 09:34:44.509410 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.creator() Oct 27 09:34:44.509410 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 09:34:44.509410 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application created_value = creator( Oct 27 09:34:44.509410 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 27 09:34:44.512036 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 27 09:34:44.512036 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 09:34:44.512036 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application Oct 27 09:34:44.512036 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 416/822] 10.222.0.65 () {56 vars in 1108 bytes} [Thu Oct 27 09:34:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 09:34:44.516389 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9500961d-c5e9-4899-8832-319253fafc7f None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:34:44.656764 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9500961d-c5e9-4899-8832-319253fafc7f None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:34:44.691967 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357c8222-5357-4214-89a2-dfbaf4d14544 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:34:44.692597 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357c8222-5357-4214-89a2-dfbaf4d14544 None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:34:44.692877 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357c8222-5357-4214-89a2-dfbaf4d14544 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:34:44.693150 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357c8222-5357-4214-89a2-dfbaf4d14544 None admin] PATH_INFO: `/v3/domains` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:34:44.693788 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357c8222-5357-4214-89a2-dfbaf4d14544 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 09:34:44.694151 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357c8222-5357-4214-89a2-dfbaf4d14544 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:34:44.695489 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357c8222-5357-4214-89a2-dfbaf4d14544 None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:34:44.707506 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 407/823] 10.222.0.65 () {56 vars in 1109 bytes} [Thu Oct 27 09:34:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 09:34:44.713353 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e55f8d-5939-47aa-800e-282121d2a054 None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:34:44.784273 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:34:44.818072 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e55f8d-5939-47aa-800e-282121d2a054 None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:34:44.857152 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5e2d02-60c5-4b99-b7fa-0b98485491c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:34:44.857781 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5e2d02-60c5-4b99-b7fa-0b98485491c5 None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:34:44.858058 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5e2d02-60c5-4b99-b7fa-0b98485491c5 None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:34:44.858327 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5e2d02-60c5-4b99-b7fa-0b98485491c5 None admin] PATH_INFO: `/v3/users/nova` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:34:44.867609 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5e2d02-60c5-4b99-b7fa-0b98485491c5 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:34:44.869034 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5e2d02-60c5-4b99-b7fa-0b98485491c5 None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:34:44.879940 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application [None req-4f5e2d02-60c5-4b99-b7fa-0b98485491c5 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 27 09:34:44.879940 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 09:34:44.879940 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 09:34:44.879940 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 09:34:44.879940 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 09:34:44.879940 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 09:34:44.879940 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 09:34:44.879940 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 09:34:44.879940 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 09:34:44.879940 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 09:34:44.879940 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 09:34:44.879940 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 09:34:44.879940 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 27 09:34:44.879940 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 27 09:34:44.879940 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 27 09:34:44.879940 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 27 09:34:44.880868 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 09:34:44.880868 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 09:34:44.880868 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 27 09:34:44.880868 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 27 09:34:44.880868 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 27 09:34:44.880868 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 27 09:34:44.880868 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 09:34:44.880868 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 09:34:44.880868 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 09:34:44.880868 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 09:34:44.880868 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 09:34:44.880868 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application with Lock( Oct 27 09:34:44.880868 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 09:34:44.880868 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._enter() Oct 27 09:34:44.880868 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 09:34:44.880868 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 09:34:44.880868 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 09:34:44.880868 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.creator() Oct 27 09:34:44.881776 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 09:34:44.881776 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application created_value = creator( Oct 27 09:34:44.881776 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 27 09:34:44.881776 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 27 09:34:44.881776 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 27 09:34:44.881776 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 27 09:34:44.881776 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 27 09:34:44.881776 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 27 09:34:44.881776 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 27 09:34:44.881776 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application Oct 27 09:34:44.881776 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 417/824] 10.222.0.65 () {56 vars in 1093 bytes} [Thu Oct 27 09:34:44 2022] GET /identity/v3/users/nova => generated 82 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 09:34:44.887030 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357c8222-5357-4214-89a2-dfbaf4d14544 None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:34:44.914595 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:34:44.991051 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357c8222-5357-4214-89a2-dfbaf4d14544 None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:34:45.026438 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b879c703-9174-4674-a51f-abe83e016fb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:34:45.027067 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b879c703-9174-4674-a51f-abe83e016fb3 None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:34:45.027344 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b879c703-9174-4674-a51f-abe83e016fb3 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:34:45.027613 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b879c703-9174-4674-a51f-abe83e016fb3 None admin] PATH_INFO: `/v3/users` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:34:45.028330 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b879c703-9174-4674-a51f-abe83e016fb3 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 09:34:45.028666 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b879c703-9174-4674-a51f-abe83e016fb3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:34:45.030109 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b879c703-9174-4674-a51f-abe83e016fb3 None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:34:45.048115 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 408/825] 10.222.0.65 () {56 vars in 1133 bytes} [Thu Oct 27 09:34:44 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 09:34:45.054389 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5e2d02-60c5-4b99-b7fa-0b98485491c5 None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:34:45.155670 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5e2d02-60c5-4b99-b7fa-0b98485491c5 None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:34:45.182150 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:34:45.189841 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0309587-a705-404a-bc78-9a2b731dcc6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:34:45.191617 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0309587-a705-404a-bc78-9a2b731dcc6f None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:34:45.191617 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0309587-a705-404a-bc78-9a2b731dcc6f None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:34:45.191617 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0309587-a705-404a-bc78-9a2b731dcc6f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:34:45.260321 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0309587-a705-404a-bc78-9a2b731dcc6f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:34:45.261696 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0309587-a705-404a-bc78-9a2b731dcc6f None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:34:45.358737 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 418/826] 10.222.0.65 () {58 vars in 1282 bytes} [Thu Oct 27 09:34:45 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 27 09:34:45.364793 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b879c703-9174-4674-a51f-abe83e016fb3 None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:34:45.451338 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:34:45.468848 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b879c703-9174-4674-a51f-abe83e016fb3 None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:34:45.503111 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287a2546-34de-4100-a7c8-200210dbc018 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:34:45.503797 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287a2546-34de-4100-a7c8-200210dbc018 None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:34:45.504083 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287a2546-34de-4100-a7c8-200210dbc018 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:34:45.504354 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287a2546-34de-4100-a7c8-200210dbc018 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:34:45.514262 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287a2546-34de-4100-a7c8-200210dbc018 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:34:45.515669 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287a2546-34de-4100-a7c8-200210dbc018 None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:34:45.530056 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application [None req-287a2546-34de-4100-a7c8-200210dbc018 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 09:34:45.530056 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 09:34:45.530056 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 09:34:45.530056 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 09:34:45.530056 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 09:34:45.530056 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 09:34:45.530056 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 09:34:45.530056 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 09:34:45.530056 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 09:34:45.530056 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 09:34:45.530056 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 09:34:45.530056 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 09:34:45.530056 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 27 09:34:45.530056 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 27 09:34:45.530056 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 27 09:34:45.530056 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 27 09:34:45.531102 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 09:34:45.531102 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 09:34:45.531102 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 09:34:45.531102 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 09:34:45.531102 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 09:34:45.531102 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 09:34:45.531102 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 09:34:45.531102 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application with Lock( Oct 27 09:34:45.531102 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 09:34:45.531102 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._enter() Oct 27 09:34:45.531102 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 09:34:45.531102 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 09:34:45.531102 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 09:34:45.531102 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.creator() Oct 27 09:34:45.531102 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 09:34:45.531102 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application created_value = creator( Oct 27 09:34:45.531102 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 27 09:34:45.532539 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 27 09:34:45.532539 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 09:34:45.532539 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application Oct 27 09:34:45.532539 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 409/827] 10.222.0.65 () {56 vars in 1108 bytes} [Thu Oct 27 09:34:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 09:34:45.536823 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0309587-a705-404a-bc78-9a2b731dcc6f None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:34:45.565408 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:34:45.637259 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0309587-a705-404a-bc78-9a2b731dcc6f None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:34:45.680091 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb46515c-a3fe-4203-8e1a-a27b9c2e3bca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:34:45.680805 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb46515c-a3fe-4203-8e1a-a27b9c2e3bca None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:34:45.681081 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb46515c-a3fe-4203-8e1a-a27b9c2e3bca None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:34:45.681348 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb46515c-a3fe-4203-8e1a-a27b9c2e3bca None admin] PATH_INFO: `/v3/domains` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:34:45.681991 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb46515c-a3fe-4203-8e1a-a27b9c2e3bca None admin] RBAC: Adding query filter params (name=Default) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 09:34:45.682289 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb46515c-a3fe-4203-8e1a-a27b9c2e3bca None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:34:45.683715 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb46515c-a3fe-4203-8e1a-a27b9c2e3bca None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:34:45.695646 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 419/828] 10.222.0.65 () {56 vars in 1109 bytes} [Thu Oct 27 09:34:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 09:34:45.701264 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287a2546-34de-4100-a7c8-200210dbc018 None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:34:45.803171 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287a2546-34de-4100-a7c8-200210dbc018 None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:34:45.838327 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6b8541-7761-4832-b4fe-b72f1cddb07a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:34:45.839100 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6b8541-7761-4832-b4fe-b72f1cddb07a None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:34:45.839383 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6b8541-7761-4832-b4fe-b72f1cddb07a None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:34:45.839657 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6b8541-7761-4832-b4fe-b72f1cddb07a None admin] PATH_INFO: `/v3/projects/service` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:34:45.841704 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:34:45.848625 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6b8541-7761-4832-b4fe-b72f1cddb07a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:34:45.849992 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6b8541-7761-4832-b4fe-b72f1cddb07a None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:34:45.863523 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application [None req-ab6b8541-7761-4832-b4fe-b72f1cddb07a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 27 09:34:45.863523 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 09:34:45.863523 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 09:34:45.863523 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 09:34:45.863523 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 09:34:45.863523 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 09:34:45.863523 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 09:34:45.863523 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 09:34:45.863523 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 09:34:45.863523 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 09:34:45.863523 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 09:34:45.863523 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 09:34:45.863523 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 27 09:34:45.863523 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 27 09:34:45.863523 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 27 09:34:45.864449 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 27 09:34:45.864449 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 09:34:45.864449 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 09:34:45.864449 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 09:34:45.864449 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 09:34:45.864449 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 09:34:45.864449 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 09:34:45.864449 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 09:34:45.864449 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application with Lock( Oct 27 09:34:45.864449 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 09:34:45.864449 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._enter() Oct 27 09:34:45.864449 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 09:34:45.864449 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 09:34:45.864449 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 09:34:45.864449 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.creator() Oct 27 09:34:45.864449 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 09:34:45.864449 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application created_value = creator( Oct 27 09:34:45.865314 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 27 09:34:45.865314 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 27 09:34:45.865314 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 27 09:34:45.865314 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 27 09:34:45.865314 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 27 09:34:45.865314 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 27 09:34:45.865314 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 27 09:34:45.865314 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application Oct 27 09:34:45.865314 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 410/829] 10.222.0.65 () {56 vars in 1111 bytes} [Thu Oct 27 09:34:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 09:34:45.871149 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb46515c-a3fe-4203-8e1a-a27b9c2e3bca None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:34:45.956494 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:34:45.968549 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb46515c-a3fe-4203-8e1a-a27b9c2e3bca None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:34:46.001856 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3348ee7e-388f-4d3a-b49a-d31b1d22b698 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:34:46.002454 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3348ee7e-388f-4d3a-b49a-d31b1d22b698 None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:34:46.002758 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3348ee7e-388f-4d3a-b49a-d31b1d22b698 None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:34:46.003027 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3348ee7e-388f-4d3a-b49a-d31b1d22b698 None admin] PATH_INFO: `/v3/projects` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:34:46.003703 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3348ee7e-388f-4d3a-b49a-d31b1d22b698 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 09:34:46.004005 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3348ee7e-388f-4d3a-b49a-d31b1d22b698 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:34:46.005412 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3348ee7e-388f-4d3a-b49a-d31b1d22b698 None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:34:46.017130 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 420/830] 10.222.0.65 () {56 vars in 1148 bytes} [Thu Oct 27 09:34:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 09:34:46.023754 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6b8541-7761-4832-b4fe-b72f1cddb07a None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:34:46.128400 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6b8541-7761-4832-b4fe-b72f1cddb07a None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:34:46.164634 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c765b58-e68f-4a56-ae5a-abf91bcb4d9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:34:46.165242 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c765b58-e68f-4a56-ae5a-abf91bcb4d9c None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:34:46.165528 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c765b58-e68f-4a56-ae5a-abf91bcb4d9c None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:34:46.165805 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c765b58-e68f-4a56-ae5a-abf91bcb4d9c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:34:46.166552 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c765b58-e68f-4a56-ae5a-abf91bcb4d9c None admin] RBAC: Adding query filter params (role.id=ed04e37a302d4d4c9d940d9dc8d11599, scope.project.id=dc2e3a7a1bcc480891c0b433291c00b1, user.id=fd0d23ef039d4f1591a589d302ef165f) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 09:34:46.166869 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c765b58-e68f-4a56-ae5a-abf91bcb4d9c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:34:46.168309 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c765b58-e68f-4a56-ae5a-abf91bcb4d9c None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:34:46.174218 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 411/831] 10.222.0.65 () {56 vars in 1374 bytes} [Thu Oct 27 09:34:46 2022] GET /identity/v3/role_assignments?user.id=fd0d23ef039d4f1591a589d302ef165f&scope.project.id=dc2e3a7a1bcc480891c0b433291c00b1&role.id=ed04e37a302d4d4c9d940d9dc8d11599 => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 09:34:46.190025 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26421813-b1de-436a-b936-092e15ed6b2c None None] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:34:46.190312 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26421813-b1de-436a-b936-092e15ed6b2c None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:34:46.190629 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26421813-b1de-436a-b936-092e15ed6b2c None None] PATH_INFO: `/` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:34:46.192266 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 421/832] 10.222.0.65 () {54 vars in 927 bytes} [Thu Oct 27 09:34:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 09:34:46.198814 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a418bfe-c423-45b2-850a-928a290448f0 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:34:46.199098 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a418bfe-c423-45b2-850a-928a290448f0 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:34:46.199377 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a418bfe-c423-45b2-850a-928a290448f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:34:46.220072 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-2a418bfe-c423-45b2-850a-928a290448f0 None None] MFA Rules not processed for user `b5065084bf664b99bdeac46067cb0f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:34:46.221305 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-2a418bfe-c423-45b2-850a-928a290448f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:34:46.282394 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:34:46.296921 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 412/833] 10.222.0.65 () {58 vars in 1024 bytes} [Thu Oct 27 09:34:46 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 27 09:34:46.564313 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26421813-b1de-436a-b936-092e15ed6b2c None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:34:46.673157 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26421813-b1de-436a-b936-092e15ed6b2c None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:34:46.708224 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b302f499-3260-40c0-85db-d4fbd6f46c8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:34:46.708853 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b302f499-3260-40c0-85db-d4fbd6f46c8c None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:34:46.709135 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b302f499-3260-40c0-85db-d4fbd6f46c8c None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:34:46.709399 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b302f499-3260-40c0-85db-d4fbd6f46c8c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:34:46.721019 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b302f499-3260-40c0-85db-d4fbd6f46c8c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 09:34:46.726369 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application [None req-b302f499-3260-40c0-85db-d4fbd6f46c8c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 27 09:34:46.726369 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 09:34:46.726369 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 09:34:46.726369 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 09:34:46.726369 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 09:34:46.726369 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 09:34:46.726369 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 09:34:46.726369 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 09:34:46.726369 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 09:34:46.726369 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 09:34:46.726369 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 09:34:46.726369 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 09:34:46.726369 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 27 09:34:46.726369 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 27 09:34:46.726369 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 27 09:34:46.726369 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 27 09:34:46.727868 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 27 09:34:46.727868 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 27 09:34:46.727868 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 27 09:34:46.727868 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 27 09:34:46.727868 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 09:34:46.727868 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 09:34:46.727868 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 09:34:46.727868 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 09:34:46.727868 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 09:34:46.727868 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 09:34:46.727868 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 09:34:46.727868 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application with Lock( Oct 27 09:34:46.727868 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 09:34:46.727868 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._enter() Oct 27 09:34:46.727868 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 09:34:46.727868 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 09:34:46.728945 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 09:34:46.728945 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.creator() Oct 27 09:34:46.728945 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 09:34:46.728945 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application created_value = creator( Oct 27 09:34:46.728945 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 27 09:34:46.728945 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 27 09:34:46.728945 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 27 09:34:46.728945 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 27 09:34:46.728945 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 27 09:34:46.728945 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 27 09:34:46.728945 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 27 09:34:46.728945 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application Oct 27 09:34:46.728945 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 422/834] 10.222.0.65 () {56 vars in 1096 bytes} [Thu Oct 27 09:34:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 09:34:46.734313 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a418bfe-c423-45b2-850a-928a290448f0 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:34:46.841714 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a418bfe-c423-45b2-850a-928a290448f0 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:34:46.881273 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e902d477-22aa-42e5-a558-e45bf5ffa933 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:34:46.882783 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e902d477-22aa-42e5-a558-e45bf5ffa933 None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:34:46.883072 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e902d477-22aa-42e5-a558-e45bf5ffa933 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:34:46.883398 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e902d477-22aa-42e5-a558-e45bf5ffa933 None admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:34:46.884070 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e902d477-22aa-42e5-a558-e45bf5ffa933 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 09:34:46.884377 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e902d477-22aa-42e5-a558-e45bf5ffa933 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:34:46.885767 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e902d477-22aa-42e5-a558-e45bf5ffa933 None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:34:46.894491 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 413/835] 10.222.0.65 () {56 vars in 1099 bytes} [Thu Oct 27 09:34:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 09:34:46.900428 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b302f499-3260-40c0-85db-d4fbd6f46c8c None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:34:46.912621 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:34:47.005884 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b302f499-3260-40c0-85db-d4fbd6f46c8c None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:34:47.050798 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcea018-6533-415a-a65c-eb0d5729b830 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:34:47.051449 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcea018-6533-415a-a65c-eb0d5729b830 None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:34:47.051730 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcea018-6533-415a-a65c-eb0d5729b830 None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:34:47.052003 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcea018-6533-415a-a65c-eb0d5729b830 None admin] PATH_INFO: `/v3/users/2346f5de8b4643099d43301191b89147` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:34:47.053158 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fcea018-6533-415a-a65c-eb0d5729b830 None admin] RBAC: Authorizing `identity:get_user(user_id=2346f5de8b4643099d43301191b89147)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:34:47.054794 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fcea018-6533-415a-a65c-eb0d5729b830 None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:34:47.056336 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 423/836] 10.222.0.65 () {56 vars in 1177 bytes} [Thu Oct 27 09:34:46 2022] GET /identity/v3/users/2346f5de8b4643099d43301191b89147 => generated 285 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 09:34:47.062544 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e902d477-22aa-42e5-a558-e45bf5ffa933 None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:34:47.232117 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:34:47.282300 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e902d477-22aa-42e5-a558-e45bf5ffa933 None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:34:47.315730 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e255d717-f4e2-41d8-933c-8c9b08537670 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:34:47.316324 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e255d717-f4e2-41d8-933c-8c9b08537670 None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:34:47.316609 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e255d717-f4e2-41d8-933c-8c9b08537670 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:34:47.316884 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e255d717-f4e2-41d8-933c-8c9b08537670 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:34:47.385594 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e255d717-f4e2-41d8-933c-8c9b08537670 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:34:47.387083 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e255d717-f4e2-41d8-933c-8c9b08537670 None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:34:47.435283 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:34:47.485491 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 414/837] 10.222.0.65 () {58 vars in 1282 bytes} [Thu Oct 27 09:34:47 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 423 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 27 09:34:47.492031 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcea018-6533-415a-a65c-eb0d5729b830 None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:34:47.567159 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:34:47.591385 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcea018-6533-415a-a65c-eb0d5729b830 None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:34:47.625543 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc1f09d-de7e-41ab-afab-a5e0d70b2580 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:34:47.626189 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc1f09d-de7e-41ab-afab-a5e0d70b2580 None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:34:47.626469 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc1f09d-de7e-41ab-afab-a5e0d70b2580 None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:34:47.626767 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc1f09d-de7e-41ab-afab-a5e0d70b2580 None admin] PATH_INFO: `/v3/projects/8f1f04f3720d40a49f82f06a7655ff85` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:34:47.627870 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc1f09d-de7e-41ab-afab-a5e0d70b2580 None admin] RBAC: Authorizing `identity:get_project(project_id=8f1f04f3720d40a49f82f06a7655ff85)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:34:47.629297 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc1f09d-de7e-41ab-afab-a5e0d70b2580 None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:34:47.630951 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 424/838] 10.222.0.65 () {56 vars in 1186 bytes} [Thu Oct 27 09:34:47 2022] GET /identity/v3/projects/8f1f04f3720d40a49f82f06a7655ff85 => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 09:34:47.637976 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e255d717-f4e2-41d8-933c-8c9b08537670 None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:34:47.742291 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e255d717-f4e2-41d8-933c-8c9b08537670 None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:34:47.775652 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f685c2-e756-4f06-8b1b-e655da8359ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:34:47.776239 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f685c2-e756-4f06-8b1b-e655da8359ae None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:34:47.776521 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f685c2-e756-4f06-8b1b-e655da8359ae None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:34:47.776795 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f685c2-e756-4f06-8b1b-e655da8359ae None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:34:47.777512 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f685c2-e756-4f06-8b1b-e655da8359ae None admin] RBAC: Adding query filter params (role.id=6ad17b9f9dea4b66ab2da3677d7e715d, scope.project.id=8f1f04f3720d40a49f82f06a7655ff85, user.id=2346f5de8b4643099d43301191b89147) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 09:34:47.777820 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f685c2-e756-4f06-8b1b-e655da8359ae None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:34:47.779274 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f685c2-e756-4f06-8b1b-e655da8359ae None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:34:47.784899 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 415/839] 10.222.0.65 () {56 vars in 1374 bytes} [Thu Oct 27 09:34:47 2022] GET /identity/v3/role_assignments?user.id=2346f5de8b4643099d43301191b89147&scope.project.id=8f1f04f3720d40a49f82f06a7655ff85&role.id=6ad17b9f9dea4b66ab2da3677d7e715d => generated 608 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 09:34:49.950632 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c565b889-9af8-41db-86ee-5f51fa382ae9 None None] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:34:49.951212 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c565b889-9af8-41db-86ee-5f51fa382ae9 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:34:49.951212 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c565b889-9af8-41db-86ee-5f51fa382ae9 None None] PATH_INFO: `/` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:34:49.952499 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 425/840] 10.222.0.65 () {54 vars in 927 bytes} [Thu Oct 27 09:34:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 09:34:49.957978 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8e7d05-8d84-4655-abbd-cf8a959b705d None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:34:49.958413 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8e7d05-8d84-4655-abbd-cf8a959b705d None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:34:49.958545 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8e7d05-8d84-4655-abbd-cf8a959b705d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:34:49.977212 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-df8e7d05-8d84-4655-abbd-cf8a959b705d None None] MFA Rules not processed for user `b5065084bf664b99bdeac46067cb0f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:34:49.978401 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-df8e7d05-8d84-4655-abbd-cf8a959b705d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:34:49.987839 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:34:50.046020 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 416/841] 10.222.0.65 () {58 vars in 1024 bytes} [Thu Oct 27 09:34:49 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 27 09:34:50.329495 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c565b889-9af8-41db-86ee-5f51fa382ae9 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:34:50.430863 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c565b889-9af8-41db-86ee-5f51fa382ae9 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:34:50.464331 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7c0725-c1cb-4791-981a-4f1a1f365ae7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:34:50.464950 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7c0725-c1cb-4791-981a-4f1a1f365ae7 None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:34:50.465231 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7c0725-c1cb-4791-981a-4f1a1f365ae7 None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:34:50.465504 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7c0725-c1cb-4791-981a-4f1a1f365ae7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:34:50.466642 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7c0725-c1cb-4791-981a-4f1a1f365ae7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:34:50.468057 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7c0725-c1cb-4791-981a-4f1a1f365ae7 None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:34:50.469602 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 426/842] 10.222.0.65 () {56 vars in 1108 bytes} [Thu Oct 27 09:34:50 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 09:34:50.476460 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8e7d05-8d84-4655-abbd-cf8a959b705d None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:34:50.571938 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8e7d05-8d84-4655-abbd-cf8a959b705d None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:34:50.607429 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f381434-c6ca-416f-9f77-faf4da624a0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:34:50.607962 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f381434-c6ca-416f-9f77-faf4da624a0a None admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:34:50.608246 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f381434-c6ca-416f-9f77-faf4da624a0a None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:34:50.608521 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f381434-c6ca-416f-9f77-faf4da624a0a None admin] PATH_INFO: `/v3/users` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:34:50.609200 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f381434-c6ca-416f-9f77-faf4da624a0a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:34:50.610913 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f381434-c6ca-416f-9f77-faf4da624a0a None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:34:50.731234 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:34:50.736385 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 417/843] 10.222.0.65 () {60 vars in 1132 bytes} [Thu Oct 27 09:34:50 2022] POST /identity/v3/users => generated 286 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 09:34:52.988838 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32395c73-fd0b-4433-9524-b0d612246e27 None None] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:34:52.989360 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32395c73-fd0b-4433-9524-b0d612246e27 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:34:52.989360 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32395c73-fd0b-4433-9524-b0d612246e27 None None] PATH_INFO: `/` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:34:52.991304 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 427/844] 10.222.0.65 () {54 vars in 927 bytes} [Thu Oct 27 09:34:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 09:34:52.997015 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c9c422-42d5-4b46-a30b-16afb3863426 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:34:52.997427 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c9c422-42d5-4b46-a30b-16afb3863426 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:34:52.997580 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c9c422-42d5-4b46-a30b-16afb3863426 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:34:53.016877 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-a2c9c422-42d5-4b46-a30b-16afb3863426 None None] MFA Rules not processed for user `b5065084bf664b99bdeac46067cb0f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:34:53.018072 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-a2c9c422-42d5-4b46-a30b-16afb3863426 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:34:53.091328 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 418/845] 10.222.0.65 () {58 vars in 1024 bytes} [Thu Oct 27 09:34:52 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 27 09:34:53.358166 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32395c73-fd0b-4433-9524-b0d612246e27 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:34:53.375861 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:34:53.466419 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32395c73-fd0b-4433-9524-b0d612246e27 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:34:53.500882 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216dc357-0cf9-4080-b7ea-bd77ac556664 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:34:53.501506 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216dc357-0cf9-4080-b7ea-bd77ac556664 None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:34:53.501787 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216dc357-0cf9-4080-b7ea-bd77ac556664 None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:34:53.502061 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216dc357-0cf9-4080-b7ea-bd77ac556664 None admin] PATH_INFO: `/v3/roles/438ff415f4f644afb2cc60293cc13741` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:34:53.503443 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216dc357-0cf9-4080-b7ea-bd77ac556664 None admin] RBAC: Authorizing `identity:get_role(role_id=438ff415f4f644afb2cc60293cc13741)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:34:53.504812 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216dc357-0cf9-4080-b7ea-bd77ac556664 None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:34:53.506133 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 428/846] 10.222.0.65 () {56 vars in 1177 bytes} [Thu Oct 27 09:34:53 2022] GET /identity/v3/roles/438ff415f4f644afb2cc60293cc13741 => generated 223 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 09:34:53.512104 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c9c422-42d5-4b46-a30b-16afb3863426 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:34:53.613389 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c9c422-42d5-4b46-a30b-16afb3863426 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:34:53.642447 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:34:53.648831 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7540e48-0862-4178-a361-dec46fc609cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:34:53.649470 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7540e48-0862-4178-a361-dec46fc609cd None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:34:53.649755 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7540e48-0862-4178-a361-dec46fc609cd None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:34:53.650033 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7540e48-0862-4178-a361-dec46fc609cd None admin] PATH_INFO: `/v3/users/660434e9d1f7441dbe9fc2503afcc63e` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:34:53.663928 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7540e48-0862-4178-a361-dec46fc609cd None admin] RBAC: Authorizing `identity:get_user(user_id=660434e9d1f7441dbe9fc2503afcc63e)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:34:53.665385 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7540e48-0862-4178-a361-dec46fc609cd None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:34:53.667089 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 419/847] 10.222.0.65 () {56 vars in 1177 bytes} [Thu Oct 27 09:34:53 2022] GET /identity/v3/users/660434e9d1f7441dbe9fc2503afcc63e => generated 286 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 09:34:53.673027 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216dc357-0cf9-4080-b7ea-bd77ac556664 None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:34:53.757753 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:34:53.778796 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216dc357-0cf9-4080-b7ea-bd77ac556664 None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:34:53.813722 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35ddd56-c067-4765-af56-f7f5cc56c22c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:34:53.814339 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35ddd56-c067-4765-af56-f7f5cc56c22c None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:34:53.814643 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35ddd56-c067-4765-af56-f7f5cc56c22c None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:34:53.814913 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35ddd56-c067-4765-af56-f7f5cc56c22c None admin] PATH_INFO: `/v3/projects/8f1f04f3720d40a49f82f06a7655ff85` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:34:53.816008 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35ddd56-c067-4765-af56-f7f5cc56c22c None admin] RBAC: Authorizing `identity:get_project(project_id=8f1f04f3720d40a49f82f06a7655ff85)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:34:53.817428 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35ddd56-c067-4765-af56-f7f5cc56c22c None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:34:53.819747 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 429/848] 10.222.0.65 () {56 vars in 1186 bytes} [Thu Oct 27 09:34:53 2022] GET /identity/v3/projects/8f1f04f3720d40a49f82f06a7655ff85 => generated 311 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 09:34:53.826000 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7540e48-0862-4178-a361-dec46fc609cd None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:34:53.925947 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7540e48-0862-4178-a361-dec46fc609cd None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:34:53.962749 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ec99ad-c03f-400f-ba71-adc1076b3af5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:34:53.963415 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ec99ad-c03f-400f-ba71-adc1076b3af5 None admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:34:53.963698 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ec99ad-c03f-400f-ba71-adc1076b3af5 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:34:53.963973 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ec99ad-c03f-400f-ba71-adc1076b3af5 None admin] PATH_INFO: `/v3/projects/8f1f04f3720d40a49f82f06a7655ff85/users/660434e9d1f7441dbe9fc2503afcc63e/roles/438ff415f4f644afb2cc60293cc13741` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:34:53.966160 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ec99ad-c03f-400f-ba71-adc1076b3af5 None admin] RBAC: Authorizing `identity:create_grant(project_id=8f1f04f3720d40a49f82f06a7655ff85, user_id=660434e9d1f7441dbe9fc2503afcc63e, role_id=438ff415f4f644afb2cc60293cc13741)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:34:53.967639 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ec99ad-c03f-400f-ba71-adc1076b3af5 None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:34:54.050375 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 420/849] 10.222.0.65 () {58 vars in 1439 bytes} [Thu Oct 27 09:34:53 2022] PUT /identity/v3/projects/8f1f04f3720d40a49f82f06a7655ff85/users/660434e9d1f7441dbe9fc2503afcc63e/roles/438ff415f4f644afb2cc60293cc13741 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 09:34:56.323048 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05308bbd-c44f-4f9d-adc8-92ea2746bc3e None None] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:34:56.323590 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05308bbd-c44f-4f9d-adc8-92ea2746bc3e None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:34:56.323590 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05308bbd-c44f-4f9d-adc8-92ea2746bc3e None None] PATH_INFO: `/` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:34:56.324923 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 430/850] 10.222.0.65 () {54 vars in 927 bytes} [Thu Oct 27 09:34:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 09:34:56.330293 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cec2b31-679c-4a65-94dd-366407e11d91 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:34:56.330728 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cec2b31-679c-4a65-94dd-366407e11d91 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:34:56.330876 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cec2b31-679c-4a65-94dd-366407e11d91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:34:56.348875 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-8cec2b31-679c-4a65-94dd-366407e11d91 None None] MFA Rules not processed for user `b5065084bf664b99bdeac46067cb0f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:34:56.350252 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-8cec2b31-679c-4a65-94dd-366407e11d91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:34:56.395813 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:34:56.419864 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 421/851] 10.222.0.65 () {58 vars in 1024 bytes} [Thu Oct 27 09:34:56 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 27 09:34:56.697592 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05308bbd-c44f-4f9d-adc8-92ea2746bc3e None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:34:56.801870 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05308bbd-c44f-4f9d-adc8-92ea2746bc3e None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:34:56.835914 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3288ee-e3ef-4562-b80d-9f9914a9dc02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:34:56.836530 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3288ee-e3ef-4562-b80d-9f9914a9dc02 None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:34:56.836805 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3288ee-e3ef-4562-b80d-9f9914a9dc02 None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:34:56.837071 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3288ee-e3ef-4562-b80d-9f9914a9dc02 None admin] PATH_INFO: `/v3/roles/438ff415f4f644afb2cc60293cc13741` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:34:56.838456 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3288ee-e3ef-4562-b80d-9f9914a9dc02 None admin] RBAC: Authorizing `identity:get_role(role_id=438ff415f4f644afb2cc60293cc13741)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:34:56.839859 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3288ee-e3ef-4562-b80d-9f9914a9dc02 None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:34:56.841186 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 431/852] 10.222.0.65 () {56 vars in 1177 bytes} [Thu Oct 27 09:34:56 2022] GET /identity/v3/roles/438ff415f4f644afb2cc60293cc13741 => generated 223 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 09:34:56.847041 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cec2b31-679c-4a65-94dd-366407e11d91 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:34:56.945986 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cec2b31-679c-4a65-94dd-366407e11d91 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:34:56.979182 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041d0891-3180-4a8a-b788-fea7a69343da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:34:56.979737 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041d0891-3180-4a8a-b788-fea7a69343da None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:34:56.980018 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041d0891-3180-4a8a-b788-fea7a69343da None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:34:56.980293 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041d0891-3180-4a8a-b788-fea7a69343da None admin] PATH_INFO: `/v3/users/660434e9d1f7441dbe9fc2503afcc63e` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:34:56.981403 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041d0891-3180-4a8a-b788-fea7a69343da None admin] RBAC: Authorizing `identity:get_user(user_id=660434e9d1f7441dbe9fc2503afcc63e)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:34:56.982852 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041d0891-3180-4a8a-b788-fea7a69343da None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:34:56.984423 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 422/853] 10.222.0.65 () {56 vars in 1177 bytes} [Thu Oct 27 09:34:56 2022] GET /identity/v3/users/660434e9d1f7441dbe9fc2503afcc63e => generated 286 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 09:34:56.991197 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3288ee-e3ef-4562-b80d-9f9914a9dc02 None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:34:57.009062 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:34:57.094391 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3288ee-e3ef-4562-b80d-9f9914a9dc02 None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:34:57.128702 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa734f2-ac73-42a5-a6e5-67e60e41545a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:34:57.129310 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa734f2-ac73-42a5-a6e5-67e60e41545a None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:34:57.129596 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa734f2-ac73-42a5-a6e5-67e60e41545a None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:34:57.129867 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa734f2-ac73-42a5-a6e5-67e60e41545a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:34:57.197009 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa734f2-ac73-42a5-a6e5-67e60e41545a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:34:57.198457 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa734f2-ac73-42a5-a6e5-67e60e41545a None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:34:57.215481 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:34:57.297248 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 432/854] 10.222.0.65 () {58 vars in 1282 bytes} [Thu Oct 27 09:34:56 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 27 09:34:57.303186 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041d0891-3180-4a8a-b788-fea7a69343da None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:34:57.349580 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:34:57.403479 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041d0891-3180-4a8a-b788-fea7a69343da None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:34:57.438230 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278c9787-ea4a-4ce7-9051-6ab979cb543a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:34:57.438868 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278c9787-ea4a-4ce7-9051-6ab979cb543a None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:34:57.439149 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278c9787-ea4a-4ce7-9051-6ab979cb543a None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:34:57.439420 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278c9787-ea4a-4ce7-9051-6ab979cb543a None admin] PATH_INFO: `/v3/projects/8f1f04f3720d40a49f82f06a7655ff85` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:34:57.440525 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278c9787-ea4a-4ce7-9051-6ab979cb543a None admin] RBAC: Authorizing `identity:get_project(project_id=8f1f04f3720d40a49f82f06a7655ff85)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:34:57.441942 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278c9787-ea4a-4ce7-9051-6ab979cb543a None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:34:57.443676 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 423/855] 10.222.0.65 () {56 vars in 1186 bytes} [Thu Oct 27 09:34:57 2022] GET /identity/v3/projects/8f1f04f3720d40a49f82f06a7655ff85 => generated 311 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 09:34:57.450223 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa734f2-ac73-42a5-a6e5-67e60e41545a None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:34:57.545562 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa734f2-ac73-42a5-a6e5-67e60e41545a None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:34:57.562141 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:34:57.579112 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480aeedb-049d-41cd-bb2e-234a741d47fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:34:57.579704 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480aeedb-049d-41cd-bb2e-234a741d47fe None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:34:57.583381 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480aeedb-049d-41cd-bb2e-234a741d47fe None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:34:57.583381 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480aeedb-049d-41cd-bb2e-234a741d47fe None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:34:57.583381 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480aeedb-049d-41cd-bb2e-234a741d47fe None admin] RBAC: Adding query filter params (role.id=438ff415f4f644afb2cc60293cc13741, scope.project.id=8f1f04f3720d40a49f82f06a7655ff85, user.id=660434e9d1f7441dbe9fc2503afcc63e) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 09:34:57.583381 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480aeedb-049d-41cd-bb2e-234a741d47fe None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:34:57.583381 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480aeedb-049d-41cd-bb2e-234a741d47fe None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:34:57.588779 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 433/856] 10.222.0.65 () {56 vars in 1374 bytes} [Thu Oct 27 09:34:57 2022] GET /identity/v3/role_assignments?user.id=660434e9d1f7441dbe9fc2503afcc63e&scope.project.id=8f1f04f3720d40a49f82f06a7655ff85&role.id=438ff415f4f644afb2cc60293cc13741 => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 09:34:59.747436 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a66589-9b5f-4612-b38e-81902771ebff None None] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:34:59.747970 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a66589-9b5f-4612-b38e-81902771ebff None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:34:59.747970 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a66589-9b5f-4612-b38e-81902771ebff None None] PATH_INFO: `/` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:34:59.749329 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 424/857] 10.222.0.65 () {54 vars in 927 bytes} [Thu Oct 27 09:34:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 09:34:59.754722 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fc5845-bb8c-449d-b424-11f9d1424fa5 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:34:59.755130 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fc5845-bb8c-449d-b424-11f9d1424fa5 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:34:59.755266 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fc5845-bb8c-449d-b424-11f9d1424fa5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:34:59.773031 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-c1fc5845-bb8c-449d-b424-11f9d1424fa5 None None] MFA Rules not processed for user `b5065084bf664b99bdeac46067cb0f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:34:59.774216 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-c1fc5845-bb8c-449d-b424-11f9d1424fa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:34:59.840410 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 434/858] 10.222.0.65 () {58 vars in 1024 bytes} [Thu Oct 27 09:34:59 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 27 09:35:00.113859 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a66589-9b5f-4612-b38e-81902771ebff None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:35:00.215668 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a66589-9b5f-4612-b38e-81902771ebff None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:35:00.229283 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:35:00.248992 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2e2af2-e3b9-418d-a0aa-95fe7075afb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:35:00.249619 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2e2af2-e3b9-418d-a0aa-95fe7075afb8 None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:35:00.249903 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2e2af2-e3b9-418d-a0aa-95fe7075afb8 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:35:00.252246 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2e2af2-e3b9-418d-a0aa-95fe7075afb8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:35:00.252246 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2e2af2-e3b9-418d-a0aa-95fe7075afb8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:35:00.252712 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2e2af2-e3b9-418d-a0aa-95fe7075afb8 None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:35:00.254258 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 425/859] 10.222.0.65 () {56 vars in 1108 bytes} [Thu Oct 27 09:35:00 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 09:35:00.261191 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fc5845-bb8c-449d-b424-11f9d1424fa5 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:35:00.357066 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fc5845-bb8c-449d-b424-11f9d1424fa5 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:35:00.369462 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:35:00.393726 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b69bf0-62ae-4c66-9457-cafcf73061e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:35:00.394322 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b69bf0-62ae-4c66-9457-cafcf73061e7 None admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:35:00.394634 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b69bf0-62ae-4c66-9457-cafcf73061e7 None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:35:00.394910 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b69bf0-62ae-4c66-9457-cafcf73061e7 None admin] PATH_INFO: `/v3/projects` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:35:00.395571 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b69bf0-62ae-4c66-9457-cafcf73061e7 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:35:00.397186 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b69bf0-62ae-4c66-9457-cafcf73061e7 None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:35:00.472874 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 435/860] 10.222.0.65 () {60 vars in 1141 bytes} [Thu Oct 27 09:35:00 2022] POST /identity/v3/projects => generated 311 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 09:35:02.703223 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb805b0-5263-488b-9016-6c435863dce9 None None] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:35:02.703827 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb805b0-5263-488b-9016-6c435863dce9 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:35:02.703827 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb805b0-5263-488b-9016-6c435863dce9 None None] PATH_INFO: `/` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:35:02.705120 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 426/861] 10.222.0.65 () {54 vars in 927 bytes} [Thu Oct 27 09:35:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 09:35:02.710955 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2776ee84-6ae6-44e1-a064-10d4ad52a03a None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:35:02.711395 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2776ee84-6ae6-44e1-a064-10d4ad52a03a None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:35:02.711494 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2776ee84-6ae6-44e1-a064-10d4ad52a03a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:35:02.729199 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-2776ee84-6ae6-44e1-a064-10d4ad52a03a None None] MFA Rules not processed for user `b5065084bf664b99bdeac46067cb0f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:35:02.730386 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-2776ee84-6ae6-44e1-a064-10d4ad52a03a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:35:02.796371 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 436/862] 10.222.0.65 () {58 vars in 1024 bytes} [Thu Oct 27 09:35:02 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 27 09:35:03.065882 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb805b0-5263-488b-9016-6c435863dce9 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:35:03.169960 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb805b0-5263-488b-9016-6c435863dce9 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:35:03.203301 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589aa21a-acfb-4bc9-8be2-9cba5bad253f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:35:03.203911 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589aa21a-acfb-4bc9-8be2-9cba5bad253f None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:35:03.204186 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589aa21a-acfb-4bc9-8be2-9cba5bad253f None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:35:03.204455 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589aa21a-acfb-4bc9-8be2-9cba5bad253f None admin] PATH_INFO: `/v3/domains/default` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:35:03.205534 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589aa21a-acfb-4bc9-8be2-9cba5bad253f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:35:03.207022 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589aa21a-acfb-4bc9-8be2-9cba5bad253f None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:35:03.208575 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 427/863] 10.222.0.65 () {56 vars in 1108 bytes} [Thu Oct 27 09:35:03 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 09:35:03.214355 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2776ee84-6ae6-44e1-a064-10d4ad52a03a None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:35:03.302005 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:35:03.310937 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2776ee84-6ae6-44e1-a064-10d4ad52a03a None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:35:03.344424 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0f3466-5d37-4bd9-bbc7-44527166d830 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:35:03.345024 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0f3466-5d37-4bd9-bbc7-44527166d830 None admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:35:03.345510 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0f3466-5d37-4bd9-bbc7-44527166d830 None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:35:03.345956 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0f3466-5d37-4bd9-bbc7-44527166d830 None admin] PATH_INFO: `/v3/users` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:35:03.346997 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0f3466-5d37-4bd9-bbc7-44527166d830 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:35:03.348471 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0f3466-5d37-4bd9-bbc7-44527166d830 None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:35:03.443951 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 437/864] 10.222.0.65 () {60 vars in 1132 bytes} [Thu Oct 27 09:35:03 2022] POST /identity/v3/users => generated 286 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 09:35:05.623204 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0babdc-a51b-48a3-a58b-04b16127e9a6 None None] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:35:05.623780 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0babdc-a51b-48a3-a58b-04b16127e9a6 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:35:05.623780 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0babdc-a51b-48a3-a58b-04b16127e9a6 None None] PATH_INFO: `/` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:35:05.625115 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 428/865] 10.222.0.65 () {54 vars in 927 bytes} [Thu Oct 27 09:35:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 09:35:05.631363 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224c6179-5d58-4184-95b4-aa9afe575bdd None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:35:05.631861 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224c6179-5d58-4184-95b4-aa9afe575bdd None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:35:05.631963 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224c6179-5d58-4184-95b4-aa9afe575bdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:35:05.650052 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-224c6179-5d58-4184-95b4-aa9afe575bdd None None] MFA Rules not processed for user `b5065084bf664b99bdeac46067cb0f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:35:05.651270 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-224c6179-5d58-4184-95b4-aa9afe575bdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:35:05.717887 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 438/866] 10.222.0.65 () {58 vars in 1024 bytes} [Thu Oct 27 09:35:05 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 27 09:35:05.991954 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0babdc-a51b-48a3-a58b-04b16127e9a6 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:35:06.043349 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:35:06.092331 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0babdc-a51b-48a3-a58b-04b16127e9a6 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:35:06.125475 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3655637-7e14-4619-af77-db6af4bcc145 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:35:06.126092 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3655637-7e14-4619-af77-db6af4bcc145 None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:35:06.126374 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3655637-7e14-4619-af77-db6af4bcc145 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:35:06.126747 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3655637-7e14-4619-af77-db6af4bcc145 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:35:06.138281 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3655637-7e14-4619-af77-db6af4bcc145 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 09:35:06.143184 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application [None req-f3655637-7e14-4619-af77-db6af4bcc145 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 27 09:35:06.143184 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 09:35:06.143184 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 09:35:06.143184 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 09:35:06.143184 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 09:35:06.143184 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 09:35:06.143184 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 09:35:06.143184 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 09:35:06.143184 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 09:35:06.143184 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 09:35:06.143184 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 09:35:06.143184 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 09:35:06.143184 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 27 09:35:06.143184 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 27 09:35:06.143184 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 27 09:35:06.143184 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 27 09:35:06.144341 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 27 09:35:06.144341 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 27 09:35:06.144341 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 27 09:35:06.144341 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 27 09:35:06.144341 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 09:35:06.144341 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 09:35:06.144341 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 09:35:06.144341 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 09:35:06.144341 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 09:35:06.144341 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 09:35:06.144341 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 09:35:06.144341 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application with Lock( Oct 27 09:35:06.144341 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 09:35:06.144341 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._enter() Oct 27 09:35:06.144341 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 09:35:06.144341 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 09:35:06.145231 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 09:35:06.145231 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.creator() Oct 27 09:35:06.145231 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 09:35:06.145231 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application created_value = creator( Oct 27 09:35:06.145231 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 27 09:35:06.145231 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 27 09:35:06.145231 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 27 09:35:06.145231 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 27 09:35:06.145231 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 27 09:35:06.145231 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 27 09:35:06.145231 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 27 09:35:06.145231 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application Oct 27 09:35:06.145231 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 429/867] 10.222.0.65 () {56 vars in 1096 bytes} [Thu Oct 27 09:35:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 09:35:06.150949 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224c6179-5d58-4184-95b4-aa9afe575bdd None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:35:06.232792 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:35:06.255022 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224c6179-5d58-4184-95b4-aa9afe575bdd None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:35:06.288364 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd768ee9-b9b2-4665-8018-cda9b3057172 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:35:06.288964 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd768ee9-b9b2-4665-8018-cda9b3057172 None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:35:06.289242 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd768ee9-b9b2-4665-8018-cda9b3057172 None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:35:06.289510 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd768ee9-b9b2-4665-8018-cda9b3057172 None admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:35:06.290158 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd768ee9-b9b2-4665-8018-cda9b3057172 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 09:35:06.290458 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd768ee9-b9b2-4665-8018-cda9b3057172 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:35:06.291849 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd768ee9-b9b2-4665-8018-cda9b3057172 None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:35:06.300232 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 439/868] 10.222.0.65 () {56 vars in 1099 bytes} [Thu Oct 27 09:35:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 09:35:06.306741 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3655637-7e14-4619-af77-db6af4bcc145 None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:35:06.409643 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3655637-7e14-4619-af77-db6af4bcc145 None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:35:06.420853 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:35:06.444001 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598d2a98-df67-4358-852e-d0553e7d11af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:35:06.444630 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598d2a98-df67-4358-852e-d0553e7d11af None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:35:06.444908 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598d2a98-df67-4358-852e-d0553e7d11af None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:35:06.445183 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598d2a98-df67-4358-852e-d0553e7d11af None admin] PATH_INFO: `/v3/users/2c43bb1302b942f69914d0da1143388e` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:35:06.459316 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598d2a98-df67-4358-852e-d0553e7d11af None admin] RBAC: Authorizing `identity:get_user(user_id=2c43bb1302b942f69914d0da1143388e)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:35:06.460937 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598d2a98-df67-4358-852e-d0553e7d11af None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:35:06.462580 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 430/869] 10.222.0.65 () {56 vars in 1177 bytes} [Thu Oct 27 09:35:06 2022] GET /identity/v3/users/2c43bb1302b942f69914d0da1143388e => generated 286 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 09:35:06.468549 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd768ee9-b9b2-4665-8018-cda9b3057172 None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:35:06.564973 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd768ee9-b9b2-4665-8018-cda9b3057172 None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:35:06.597944 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e611ef8f-c4d7-4728-88d7-1052ba5d830c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:35:06.598589 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e611ef8f-c4d7-4728-88d7-1052ba5d830c None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:35:06.599026 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e611ef8f-c4d7-4728-88d7-1052ba5d830c None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:35:06.599190 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e611ef8f-c4d7-4728-88d7-1052ba5d830c None admin] PATH_INFO: `/v3/projects/d72fa54ad67447a986c8b033d7713a4b` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:35:06.600268 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e611ef8f-c4d7-4728-88d7-1052ba5d830c None admin] RBAC: Authorizing `identity:get_project(project_id=d72fa54ad67447a986c8b033d7713a4b)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:35:06.601687 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e611ef8f-c4d7-4728-88d7-1052ba5d830c None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:35:06.603327 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 440/870] 10.222.0.65 () {56 vars in 1186 bytes} [Thu Oct 27 09:35:06 2022] GET /identity/v3/projects/d72fa54ad67447a986c8b033d7713a4b => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 09:35:06.609762 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598d2a98-df67-4358-852e-d0553e7d11af None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:35:06.710876 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598d2a98-df67-4358-852e-d0553e7d11af None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:35:06.746336 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9883389c-b73d-4a5f-9c9f-faae420f494a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:35:06.747027 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9883389c-b73d-4a5f-9c9f-faae420f494a None admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:35:06.747311 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9883389c-b73d-4a5f-9c9f-faae420f494a None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:35:06.747593 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9883389c-b73d-4a5f-9c9f-faae420f494a None admin] PATH_INFO: `/v3/projects/d72fa54ad67447a986c8b033d7713a4b/users/2c43bb1302b942f69914d0da1143388e/roles/6ad17b9f9dea4b66ab2da3677d7e715d` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:35:06.749502 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9883389c-b73d-4a5f-9c9f-faae420f494a None admin] RBAC: Authorizing `identity:create_grant(project_id=d72fa54ad67447a986c8b033d7713a4b, user_id=2c43bb1302b942f69914d0da1143388e, role_id=6ad17b9f9dea4b66ab2da3677d7e715d)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:35:06.750988 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9883389c-b73d-4a5f-9c9f-faae420f494a None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:35:06.867771 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 431/871] 10.222.0.65 () {58 vars in 1439 bytes} [Thu Oct 27 09:35:06 2022] PUT /identity/v3/projects/d72fa54ad67447a986c8b033d7713a4b/users/2c43bb1302b942f69914d0da1143388e/roles/6ad17b9f9dea4b66ab2da3677d7e715d => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 09:35:08.984558 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376abf33-41db-48d3-b3d0-c966b7182da4 None None] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:35:08.985100 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376abf33-41db-48d3-b3d0-c966b7182da4 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:35:08.985100 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376abf33-41db-48d3-b3d0-c966b7182da4 None None] PATH_INFO: `/` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:35:08.986415 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 441/872] 10.222.0.65 () {54 vars in 927 bytes} [Thu Oct 27 09:35:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 09:35:08.992496 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3154e8ec-d9b2-4456-b29d-6c592cc705f2 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:35:08.992911 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3154e8ec-d9b2-4456-b29d-6c592cc705f2 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:35:08.993047 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3154e8ec-d9b2-4456-b29d-6c592cc705f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:35:09.011478 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-3154e8ec-d9b2-4456-b29d-6c592cc705f2 None None] MFA Rules not processed for user `b5065084bf664b99bdeac46067cb0f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:35:09.012663 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-3154e8ec-d9b2-4456-b29d-6c592cc705f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:35:09.035355 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:35:09.078792 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 432/873] 10.222.0.65 () {58 vars in 1024 bytes} [Thu Oct 27 09:35:08 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 27 09:35:09.350896 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376abf33-41db-48d3-b3d0-c966b7182da4 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:35:09.362611 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:35:09.458980 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376abf33-41db-48d3-b3d0-c966b7182da4 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:35:09.491515 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f6f839-c1be-4b37-8f92-9a337b6552f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:35:09.492127 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f6f839-c1be-4b37-8f92-9a337b6552f0 None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:35:09.492403 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f6f839-c1be-4b37-8f92-9a337b6552f0 None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:35:09.492672 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f6f839-c1be-4b37-8f92-9a337b6552f0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:35:09.502813 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f6f839-c1be-4b37-8f92-9a337b6552f0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 09:35:09.508164 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application [None req-b1f6f839-c1be-4b37-8f92-9a337b6552f0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 27 09:35:09.508164 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 09:35:09.508164 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 09:35:09.508164 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 09:35:09.508164 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 09:35:09.508164 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 09:35:09.508164 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 09:35:09.508164 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 09:35:09.508164 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 09:35:09.508164 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 09:35:09.508164 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 09:35:09.508164 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 09:35:09.508164 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 27 09:35:09.508164 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 27 09:35:09.508164 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 27 09:35:09.508164 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 27 09:35:09.509204 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 27 09:35:09.509204 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 27 09:35:09.509204 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 27 09:35:09.509204 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 27 09:35:09.509204 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 09:35:09.509204 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 09:35:09.509204 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 09:35:09.509204 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 09:35:09.509204 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 09:35:09.509204 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 09:35:09.509204 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 09:35:09.509204 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application with Lock( Oct 27 09:35:09.509204 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 09:35:09.509204 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._enter() Oct 27 09:35:09.509204 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 09:35:09.509204 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 09:35:09.510128 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 09:35:09.510128 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.creator() Oct 27 09:35:09.510128 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 09:35:09.510128 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application created_value = creator( Oct 27 09:35:09.510128 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 27 09:35:09.510128 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 27 09:35:09.510128 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 27 09:35:09.510128 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 27 09:35:09.510128 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 27 09:35:09.510128 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 27 09:35:09.510128 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 27 09:35:09.510128 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application Oct 27 09:35:09.510128 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 442/874] 10.222.0.65 () {56 vars in 1096 bytes} [Thu Oct 27 09:35:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 09:35:09.515375 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3154e8ec-d9b2-4456-b29d-6c592cc705f2 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:35:09.613171 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3154e8ec-d9b2-4456-b29d-6c592cc705f2 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:35:09.646784 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329c9be2-cd63-4dfe-a06b-25d40d547efa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:35:09.647375 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329c9be2-cd63-4dfe-a06b-25d40d547efa None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:35:09.647655 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329c9be2-cd63-4dfe-a06b-25d40d547efa None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:35:09.647925 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329c9be2-cd63-4dfe-a06b-25d40d547efa None admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:35:09.648581 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329c9be2-cd63-4dfe-a06b-25d40d547efa None admin] RBAC: Adding query filter params (name=admin) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 09:35:09.648882 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329c9be2-cd63-4dfe-a06b-25d40d547efa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:35:09.650241 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329c9be2-cd63-4dfe-a06b-25d40d547efa None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:35:09.658237 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 433/875] 10.222.0.65 () {56 vars in 1099 bytes} [Thu Oct 27 09:35:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 09:35:09.664451 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f6f839-c1be-4b37-8f92-9a337b6552f0 None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:35:09.729532 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:35:09.762729 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f6f839-c1be-4b37-8f92-9a337b6552f0 None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:35:09.796127 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d01c8c4-f6f8-4b84-b16e-f91504b100a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:35:09.796742 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d01c8c4-f6f8-4b84-b16e-f91504b100a9 None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:35:09.797023 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d01c8c4-f6f8-4b84-b16e-f91504b100a9 None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:35:09.797317 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d01c8c4-f6f8-4b84-b16e-f91504b100a9 None admin] PATH_INFO: `/v3/users/2c43bb1302b942f69914d0da1143388e` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:35:09.798411 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d01c8c4-f6f8-4b84-b16e-f91504b100a9 None admin] RBAC: Authorizing `identity:get_user(user_id=2c43bb1302b942f69914d0da1143388e)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:35:09.799866 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d01c8c4-f6f8-4b84-b16e-f91504b100a9 None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:35:09.801417 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 443/876] 10.222.0.65 () {56 vars in 1177 bytes} [Thu Oct 27 09:35:09 2022] GET /identity/v3/users/2c43bb1302b942f69914d0da1143388e => generated 286 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 09:35:09.807849 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329c9be2-cd63-4dfe-a06b-25d40d547efa None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:35:09.830026 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:35:09.912140 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329c9be2-cd63-4dfe-a06b-25d40d547efa None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:35:09.945761 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d77912-16dc-4ddd-9bf4-6a25bc1a3424 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:35:09.946358 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d77912-16dc-4ddd-9bf4-6a25bc1a3424 None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:35:09.946671 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d77912-16dc-4ddd-9bf4-6a25bc1a3424 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:35:09.946947 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d77912-16dc-4ddd-9bf4-6a25bc1a3424 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:35:10.012847 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d77912-16dc-4ddd-9bf4-6a25bc1a3424 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:35:10.014292 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d77912-16dc-4ddd-9bf4-6a25bc1a3424 None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:35:10.034351 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:35:10.112719 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 434/877] 10.222.0.65 () {58 vars in 1282 bytes} [Thu Oct 27 09:35:09 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 27 09:35:10.119817 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d01c8c4-f6f8-4b84-b16e-f91504b100a9 None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:35:10.219538 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d01c8c4-f6f8-4b84-b16e-f91504b100a9 None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:35:10.253144 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb174cab-9e45-4c1b-9544-458ac2281894 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:35:10.253760 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb174cab-9e45-4c1b-9544-458ac2281894 None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:35:10.254039 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb174cab-9e45-4c1b-9544-458ac2281894 None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:35:10.254308 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb174cab-9e45-4c1b-9544-458ac2281894 None admin] PATH_INFO: `/v3/projects/d72fa54ad67447a986c8b033d7713a4b` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:35:10.255466 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb174cab-9e45-4c1b-9544-458ac2281894 None admin] RBAC: Authorizing `identity:get_project(project_id=d72fa54ad67447a986c8b033d7713a4b)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:35:10.256873 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb174cab-9e45-4c1b-9544-458ac2281894 None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:35:10.258539 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 444/878] 10.222.0.65 () {56 vars in 1186 bytes} [Thu Oct 27 09:35:10 2022] GET /identity/v3/projects/d72fa54ad67447a986c8b033d7713a4b => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 09:35:10.264686 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d77912-16dc-4ddd-9bf4-6a25bc1a3424 None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:35:10.366418 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d77912-16dc-4ddd-9bf4-6a25bc1a3424 None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:35:10.386380 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:35:10.400098 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd45ad11-51a0-4520-95b2-cca0cf1cc326 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:35:10.400702 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd45ad11-51a0-4520-95b2-cca0cf1cc326 None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:35:10.400985 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd45ad11-51a0-4520-95b2-cca0cf1cc326 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:35:10.401263 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd45ad11-51a0-4520-95b2-cca0cf1cc326 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:35:10.401984 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd45ad11-51a0-4520-95b2-cca0cf1cc326 None admin] RBAC: Adding query filter params (role.id=6ad17b9f9dea4b66ab2da3677d7e715d, scope.project.id=d72fa54ad67447a986c8b033d7713a4b, user.id=2c43bb1302b942f69914d0da1143388e) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 09:35:10.402294 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd45ad11-51a0-4520-95b2-cca0cf1cc326 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:35:10.403751 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd45ad11-51a0-4520-95b2-cca0cf1cc326 None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:35:10.409426 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 435/879] 10.222.0.65 () {56 vars in 1374 bytes} [Thu Oct 27 09:35:10 2022] GET /identity/v3/role_assignments?user.id=2c43bb1302b942f69914d0da1143388e&scope.project.id=d72fa54ad67447a986c8b033d7713a4b&role.id=6ad17b9f9dea4b66ab2da3677d7e715d => generated 608 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 09:35:12.573783 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf4668c-4bd5-4c90-8769-76336643be03 None None] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:35:12.574320 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf4668c-4bd5-4c90-8769-76336643be03 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:35:12.574320 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf4668c-4bd5-4c90-8769-76336643be03 None None] PATH_INFO: `/` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:35:12.575722 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 445/880] 10.222.0.65 () {54 vars in 927 bytes} [Thu Oct 27 09:35:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 09:35:12.581460 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743408cd-1be8-47e1-862e-a8e6a23c182c None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:35:12.581941 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743408cd-1be8-47e1-862e-a8e6a23c182c None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:35:12.582048 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743408cd-1be8-47e1-862e-a8e6a23c182c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:35:12.601407 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-743408cd-1be8-47e1-862e-a8e6a23c182c None None] MFA Rules not processed for user `b5065084bf664b99bdeac46067cb0f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:35:12.602688 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-743408cd-1be8-47e1-862e-a8e6a23c182c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:35:12.673792 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 436/881] 10.222.0.65 () {58 vars in 1024 bytes} [Thu Oct 27 09:35:12 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 27 09:35:12.940586 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf4668c-4bd5-4c90-8769-76336643be03 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:35:12.944446 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:35:13.042421 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf4668c-4bd5-4c90-8769-76336643be03 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:35:13.074636 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15874bb-3479-4586-9991-2da76c4f14cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:35:13.075236 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15874bb-3479-4586-9991-2da76c4f14cd None admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:35:13.075515 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15874bb-3479-4586-9991-2da76c4f14cd None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:35:13.075783 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15874bb-3479-4586-9991-2da76c4f14cd None admin] PATH_INFO: `/v3/domains` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:35:13.076439 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15874bb-3479-4586-9991-2da76c4f14cd None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:35:13.077797 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15874bb-3479-4586-9991-2da76c4f14cd None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:35:13.135366 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 446/882] 10.222.0.65 () {60 vars in 1138 bytes} [Thu Oct 27 09:35:12 2022] POST /identity/v3/domains => generated 267 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 09:35:15.320871 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2a853e-fe29-410e-b370-525b750a6a67 None None] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:35:15.321431 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2a853e-fe29-410e-b370-525b750a6a67 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:35:15.321431 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2a853e-fe29-410e-b370-525b750a6a67 None None] PATH_INFO: `/` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:35:15.322788 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 437/883] 10.222.0.65 () {54 vars in 927 bytes} [Thu Oct 27 09:35:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 09:35:15.328033 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2066ba54-bfb0-47fe-99ba-90ccc3aa4209 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:35:15.328434 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2066ba54-bfb0-47fe-99ba-90ccc3aa4209 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:35:15.328667 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2066ba54-bfb0-47fe-99ba-90ccc3aa4209 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:35:15.346729 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-2066ba54-bfb0-47fe-99ba-90ccc3aa4209 None None] MFA Rules not processed for user `b5065084bf664b99bdeac46067cb0f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:35:15.348080 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-2066ba54-bfb0-47fe-99ba-90ccc3aa4209 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:35:15.407900 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:35:15.416650 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 447/884] 10.222.0.65 () {58 vars in 1024 bytes} [Thu Oct 27 09:35:15 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 27 09:35:15.686108 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2a853e-fe29-410e-b370-525b750a6a67 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:35:15.786910 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2a853e-fe29-410e-b370-525b750a6a67 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:35:15.800517 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:35:15.819872 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66df6309-b7be-4dcd-8718-64ae06a44811 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:35:15.820499 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66df6309-b7be-4dcd-8718-64ae06a44811 None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:35:15.820778 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66df6309-b7be-4dcd-8718-64ae06a44811 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:35:15.821054 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66df6309-b7be-4dcd-8718-64ae06a44811 None admin] PATH_INFO: `/v3/domains/9f13a3ffbacc4463a411dca1141b32d0` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:35:15.831911 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66df6309-b7be-4dcd-8718-64ae06a44811 None admin] RBAC: Authorizing `identity:get_domain(domain_id=9f13a3ffbacc4463a411dca1141b32d0)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:35:15.833966 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66df6309-b7be-4dcd-8718-64ae06a44811 None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:35:15.835595 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 438/885] 10.222.0.65 () {56 vars in 1183 bytes} [Thu Oct 27 09:35:15 2022] GET /identity/v3/domains/9f13a3ffbacc4463a411dca1141b32d0 => generated 267 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 09:35:15.841577 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2066ba54-bfb0-47fe-99ba-90ccc3aa4209 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:35:15.943280 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2066ba54-bfb0-47fe-99ba-90ccc3aa4209 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:35:15.977066 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acbfb90-b571-4fe5-97c9-ddbf66676b7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:35:15.977663 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acbfb90-b571-4fe5-97c9-ddbf66676b7a None admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:35:15.977942 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acbfb90-b571-4fe5-97c9-ddbf66676b7a None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:35:15.978210 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acbfb90-b571-4fe5-97c9-ddbf66676b7a None admin] PATH_INFO: `/v3/projects` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:35:15.978876 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9acbfb90-b571-4fe5-97c9-ddbf66676b7a None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:35:15.980308 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9acbfb90-b571-4fe5-97c9-ddbf66676b7a None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:35:16.106853 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 448/886] 10.222.0.65 () {60 vars in 1141 bytes} [Thu Oct 27 09:35:15 2022] POST /identity/v3/projects => generated 361 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 09:35:18.359612 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43e7dc3-29bf-47cc-a2fd-8cf46bdfac62 None None] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:35:18.360153 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43e7dc3-29bf-47cc-a2fd-8cf46bdfac62 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:35:18.360153 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43e7dc3-29bf-47cc-a2fd-8cf46bdfac62 None None] PATH_INFO: `/` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:35:18.361617 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 439/887] 10.222.0.65 () {54 vars in 927 bytes} [Thu Oct 27 09:35:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 09:35:18.367684 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1876b5-f403-428e-b449-bd8fe000ed15 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:35:18.368129 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1876b5-f403-428e-b449-bd8fe000ed15 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:35:18.368222 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1876b5-f403-428e-b449-bd8fe000ed15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:35:18.387963 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-2d1876b5-f403-428e-b449-bd8fe000ed15 None None] MFA Rules not processed for user `b5065084bf664b99bdeac46067cb0f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:35:18.389166 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-2d1876b5-f403-428e-b449-bd8fe000ed15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:35:18.431331 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:35:18.455169 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 449/888] 10.222.0.65 () {58 vars in 1024 bytes} [Thu Oct 27 09:35:18 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 27 09:35:18.735521 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43e7dc3-29bf-47cc-a2fd-8cf46bdfac62 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:35:18.836612 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43e7dc3-29bf-47cc-a2fd-8cf46bdfac62 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:35:18.870844 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0b0836-cfae-4e2b-98cb-2b67ad12873f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:35:18.871471 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0b0836-cfae-4e2b-98cb-2b67ad12873f None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:35:18.871749 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0b0836-cfae-4e2b-98cb-2b67ad12873f None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:35:18.872018 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0b0836-cfae-4e2b-98cb-2b67ad12873f None admin] PATH_INFO: `/v3/domains/9f13a3ffbacc4463a411dca1141b32d0` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:35:18.873113 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0b0836-cfae-4e2b-98cb-2b67ad12873f None admin] RBAC: Authorizing `identity:get_domain(domain_id=9f13a3ffbacc4463a411dca1141b32d0)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:35:18.874546 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0b0836-cfae-4e2b-98cb-2b67ad12873f None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:35:18.876096 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 440/889] 10.222.0.65 () {56 vars in 1183 bytes} [Thu Oct 27 09:35:18 2022] GET /identity/v3/domains/9f13a3ffbacc4463a411dca1141b32d0 => generated 267 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 09:35:18.882051 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1876b5-f403-428e-b449-bd8fe000ed15 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:35:18.978667 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1876b5-f403-428e-b449-bd8fe000ed15 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:35:19.012468 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1be33a1-5822-4cb0-9aef-6a6e26a80d4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:35:19.012996 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1be33a1-5822-4cb0-9aef-6a6e26a80d4a None admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:35:19.013280 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1be33a1-5822-4cb0-9aef-6a6e26a80d4a None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:35:19.013561 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1be33a1-5822-4cb0-9aef-6a6e26a80d4a None admin] PATH_INFO: `/v3/users` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:35:19.014215 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1be33a1-5822-4cb0-9aef-6a6e26a80d4a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:35:19.015671 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1be33a1-5822-4cb0-9aef-6a6e26a80d4a None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:35:19.138634 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 450/890] 10.222.0.65 () {60 vars in 1132 bytes} [Thu Oct 27 09:35:18 2022] POST /identity/v3/users => generated 311 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 09:35:21.345835 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f29cc6-6b0f-4469-8e09-1e9805655950 None None] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:35:21.346368 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f29cc6-6b0f-4469-8e09-1e9805655950 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:35:21.346491 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f29cc6-6b0f-4469-8e09-1e9805655950 None None] PATH_INFO: `/` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:35:21.347787 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 441/891] 10.222.0.65 () {54 vars in 927 bytes} [Thu Oct 27 09:35:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 09:35:21.353353 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cd05e5-776a-44e7-81ea-26742ca44996 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:35:21.353829 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cd05e5-776a-44e7-81ea-26742ca44996 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:35:21.353921 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cd05e5-776a-44e7-81ea-26742ca44996 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:35:21.373387 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-48cd05e5-776a-44e7-81ea-26742ca44996 None None] MFA Rules not processed for user `b5065084bf664b99bdeac46067cb0f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:35:21.374632 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-48cd05e5-776a-44e7-81ea-26742ca44996 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:35:21.401371 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:35:21.443829 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 451/892] 10.222.0.65 () {58 vars in 1024 bytes} [Thu Oct 27 09:35:21 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 27 09:35:21.719849 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f29cc6-6b0f-4469-8e09-1e9805655950 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:35:21.764779 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:35:21.822876 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f29cc6-6b0f-4469-8e09-1e9805655950 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:35:21.856573 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9923c16a-2e13-4326-87af-482781814fb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:35:21.857198 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9923c16a-2e13-4326-87af-482781814fb9 None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:35:21.857476 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9923c16a-2e13-4326-87af-482781814fb9 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:35:21.858002 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9923c16a-2e13-4326-87af-482781814fb9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:35:21.869128 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9923c16a-2e13-4326-87af-482781814fb9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 09:35:21.874031 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application [None req-9923c16a-2e13-4326-87af-482781814fb9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 27 09:35:21.874031 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 09:35:21.874031 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 09:35:21.874031 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 09:35:21.874031 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 09:35:21.874031 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 09:35:21.874031 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 09:35:21.874031 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 09:35:21.874031 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 09:35:21.874031 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 09:35:21.874031 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 09:35:21.874031 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 09:35:21.874031 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 27 09:35:21.874031 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 27 09:35:21.874031 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 27 09:35:21.874031 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 27 09:35:21.875124 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 27 09:35:21.875124 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 27 09:35:21.875124 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 27 09:35:21.875124 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 27 09:35:21.875124 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 09:35:21.875124 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 09:35:21.875124 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 09:35:21.875124 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 09:35:21.875124 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 09:35:21.875124 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 09:35:21.875124 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 09:35:21.875124 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application with Lock( Oct 27 09:35:21.875124 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 09:35:21.875124 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._enter() Oct 27 09:35:21.875124 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 09:35:21.875124 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 09:35:21.876257 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 09:35:21.876257 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.creator() Oct 27 09:35:21.876257 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 09:35:21.876257 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application created_value = creator( Oct 27 09:35:21.876257 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 27 09:35:21.876257 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 27 09:35:21.876257 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 27 09:35:21.876257 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 27 09:35:21.876257 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 27 09:35:21.876257 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 27 09:35:21.876257 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 27 09:35:21.876257 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application Oct 27 09:35:21.876257 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 442/893] 10.222.0.65 () {56 vars in 1096 bytes} [Thu Oct 27 09:35:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 09:35:21.881569 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cd05e5-776a-44e7-81ea-26742ca44996 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:35:21.983367 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cd05e5-776a-44e7-81ea-26742ca44996 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:35:22.017108 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8263ca9-25f0-4c94-bd22-1d8952e49eaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:35:22.017705 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8263ca9-25f0-4c94-bd22-1d8952e49eaf None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:35:22.017987 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8263ca9-25f0-4c94-bd22-1d8952e49eaf None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:35:22.018262 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8263ca9-25f0-4c94-bd22-1d8952e49eaf None admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:35:22.018949 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8263ca9-25f0-4c94-bd22-1d8952e49eaf None admin] RBAC: Adding query filter params (name=admin) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 09:35:22.019256 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8263ca9-25f0-4c94-bd22-1d8952e49eaf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:35:22.021672 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8263ca9-25f0-4c94-bd22-1d8952e49eaf None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:35:22.029555 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 452/894] 10.222.0.65 () {56 vars in 1099 bytes} [Thu Oct 27 09:35:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 09:35:22.036079 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9923c16a-2e13-4326-87af-482781814fb9 None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:35:22.135297 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9923c16a-2e13-4326-87af-482781814fb9 None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:35:22.136826 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:35:22.168302 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97e7cfe-4675-4d8e-8349-64b06972e027 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:35:22.168918 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97e7cfe-4675-4d8e-8349-64b06972e027 None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:35:22.169197 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97e7cfe-4675-4d8e-8349-64b06972e027 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:35:22.169469 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97e7cfe-4675-4d8e-8349-64b06972e027 None admin] PATH_INFO: `/v3/users/4e84de4bcf5f4826a3ce0f0953231ea0` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:35:22.182164 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97e7cfe-4675-4d8e-8349-64b06972e027 None admin] RBAC: Authorizing `identity:get_user(user_id=4e84de4bcf5f4826a3ce0f0953231ea0)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:35:22.183634 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97e7cfe-4675-4d8e-8349-64b06972e027 None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:35:22.185224 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 443/895] 10.222.0.65 () {56 vars in 1177 bytes} [Thu Oct 27 09:35:22 2022] GET /identity/v3/users/4e84de4bcf5f4826a3ce0f0953231ea0 => generated 311 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 09:35:22.191148 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8263ca9-25f0-4c94-bd22-1d8952e49eaf None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:35:22.217904 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:35:22.292342 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8263ca9-25f0-4c94-bd22-1d8952e49eaf None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:35:22.325158 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a028a80-9dce-40f4-ab83-1a2a77231d26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:35:22.325780 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a028a80-9dce-40f4-ab83-1a2a77231d26 None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:35:22.326065 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a028a80-9dce-40f4-ab83-1a2a77231d26 None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:35:22.326344 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a028a80-9dce-40f4-ab83-1a2a77231d26 None admin] PATH_INFO: `/v3/projects/08ae194f2f734000bd8a5951a789eec9` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:35:22.327474 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a028a80-9dce-40f4-ab83-1a2a77231d26 None admin] RBAC: Authorizing `identity:get_project(project_id=08ae194f2f734000bd8a5951a789eec9)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:35:22.328907 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a028a80-9dce-40f4-ab83-1a2a77231d26 None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:35:22.330548 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 453/896] 10.222.0.65 () {56 vars in 1186 bytes} [Thu Oct 27 09:35:22 2022] GET /identity/v3/projects/08ae194f2f734000bd8a5951a789eec9 => generated 361 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 09:35:22.337145 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97e7cfe-4675-4d8e-8349-64b06972e027 None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:35:22.442898 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97e7cfe-4675-4d8e-8349-64b06972e027 None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:35:22.477579 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962cdc2f-6eb1-4e8b-930b-554ee445f104 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:35:22.478236 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962cdc2f-6eb1-4e8b-930b-554ee445f104 None admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:35:22.478548 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962cdc2f-6eb1-4e8b-930b-554ee445f104 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:35:22.478831 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962cdc2f-6eb1-4e8b-930b-554ee445f104 None admin] PATH_INFO: `/v3/projects/08ae194f2f734000bd8a5951a789eec9/users/4e84de4bcf5f4826a3ce0f0953231ea0/roles/6ad17b9f9dea4b66ab2da3677d7e715d` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:35:22.480717 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962cdc2f-6eb1-4e8b-930b-554ee445f104 None admin] RBAC: Authorizing `identity:create_grant(project_id=08ae194f2f734000bd8a5951a789eec9, user_id=4e84de4bcf5f4826a3ce0f0953231ea0, role_id=6ad17b9f9dea4b66ab2da3677d7e715d)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:35:22.482153 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962cdc2f-6eb1-4e8b-930b-554ee445f104 None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:35:22.557251 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 444/897] 10.222.0.65 () {58 vars in 1439 bytes} [Thu Oct 27 09:35:22 2022] PUT /identity/v3/projects/08ae194f2f734000bd8a5951a789eec9/users/4e84de4bcf5f4826a3ce0f0953231ea0/roles/6ad17b9f9dea4b66ab2da3677d7e715d => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 09:35:24.689080 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9207e95-a2e8-4115-a8d7-f9710ada420d None None] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:35:24.689619 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9207e95-a2e8-4115-a8d7-f9710ada420d None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:35:24.689619 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9207e95-a2e8-4115-a8d7-f9710ada420d None None] PATH_INFO: `/` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:35:24.691000 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 454/898] 10.222.0.65 () {54 vars in 927 bytes} [Thu Oct 27 09:35:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 27 09:35:24.697453 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5aac4b4-0a53-46a7-a92c-6bf4cc493639 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:35:24.697930 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5aac4b4-0a53-46a7-a92c-6bf4cc493639 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:35:24.698021 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5aac4b4-0a53-46a7-a92c-6bf4cc493639 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:35:24.717421 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-b5aac4b4-0a53-46a7-a92c-6bf4cc493639 None None] MFA Rules not processed for user `b5065084bf664b99bdeac46067cb0f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:35:24.718705 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-b5aac4b4-0a53-46a7-a92c-6bf4cc493639 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:35:24.733435 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:35:24.787248 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 445/899] 10.222.0.65 () {58 vars in 1024 bytes} [Thu Oct 27 09:35:24 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 27 09:35:25.068315 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9207e95-a2e8-4115-a8d7-f9710ada420d None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:35:25.161500 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:35:25.171219 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9207e95-a2e8-4115-a8d7-f9710ada420d None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:35:25.205589 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc276a6-939d-473f-b146-b069cd938b04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:35:25.206277 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc276a6-939d-473f-b146-b069cd938b04 None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:35:25.206483 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc276a6-939d-473f-b146-b069cd938b04 None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:35:25.206789 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc276a6-939d-473f-b146-b069cd938b04 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:35:25.216991 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc276a6-939d-473f-b146-b069cd938b04 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 09:35:25.221757 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application [None req-9fc276a6-939d-473f-b146-b069cd938b04 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 27 09:35:25.221757 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 09:35:25.221757 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 09:35:25.221757 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 09:35:25.221757 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 09:35:25.221757 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 09:35:25.221757 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 09:35:25.221757 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 09:35:25.221757 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 09:35:25.221757 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 09:35:25.221757 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 09:35:25.221757 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 09:35:25.221757 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 27 09:35:25.221757 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 27 09:35:25.221757 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 27 09:35:25.221757 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 27 09:35:25.223715 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 27 09:35:25.223715 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 27 09:35:25.223715 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 27 09:35:25.223715 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 27 09:35:25.223715 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 09:35:25.223715 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 09:35:25.223715 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 09:35:25.223715 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 09:35:25.223715 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 09:35:25.223715 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 09:35:25.223715 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 09:35:25.223715 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application with Lock( Oct 27 09:35:25.223715 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 09:35:25.223715 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._enter() Oct 27 09:35:25.223715 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 09:35:25.223715 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 09:35:25.224939 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 09:35:25.224939 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.creator() Oct 27 09:35:25.224939 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 09:35:25.224939 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application created_value = creator( Oct 27 09:35:25.224939 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 27 09:35:25.224939 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 27 09:35:25.224939 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 27 09:35:25.224939 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 27 09:35:25.224939 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 27 09:35:25.224939 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 27 09:35:25.224939 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 27 09:35:25.224939 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application Oct 27 09:35:25.224939 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 455/900] 10.222.0.65 () {56 vars in 1096 bytes} [Thu Oct 27 09:35:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 09:35:25.233188 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5aac4b4-0a53-46a7-a92c-6bf4cc493639 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:35:25.332129 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5aac4b4-0a53-46a7-a92c-6bf4cc493639 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:35:25.368039 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9593710-c3da-4d99-b1f8-ffe3c7e990dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:35:25.368642 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9593710-c3da-4d99-b1f8-ffe3c7e990dc None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:35:25.368921 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9593710-c3da-4d99-b1f8-ffe3c7e990dc None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:35:25.369193 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9593710-c3da-4d99-b1f8-ffe3c7e990dc None admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:35:25.369862 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9593710-c3da-4d99-b1f8-ffe3c7e990dc None admin] RBAC: Adding query filter params (name=admin) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 09:35:25.370164 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9593710-c3da-4d99-b1f8-ffe3c7e990dc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:35:25.371576 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9593710-c3da-4d99-b1f8-ffe3c7e990dc None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:35:25.383701 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 446/901] 10.222.0.65 () {56 vars in 1099 bytes} [Thu Oct 27 09:35:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 09:35:25.390416 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc276a6-939d-473f-b146-b069cd938b04 None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:35:25.493651 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc276a6-939d-473f-b146-b069cd938b04 None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:35:25.528222 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e695849-9e2c-4132-abb1-043b840f0010 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:35:25.528845 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e695849-9e2c-4132-abb1-043b840f0010 None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:35:25.529128 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e695849-9e2c-4132-abb1-043b840f0010 None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:35:25.529403 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e695849-9e2c-4132-abb1-043b840f0010 None admin] PATH_INFO: `/v3/users/4e84de4bcf5f4826a3ce0f0953231ea0` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:35:25.530559 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e695849-9e2c-4132-abb1-043b840f0010 None admin] RBAC: Authorizing `identity:get_user(user_id=4e84de4bcf5f4826a3ce0f0953231ea0)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:35:25.531991 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e695849-9e2c-4132-abb1-043b840f0010 None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:35:25.533576 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 456/902] 10.222.0.65 () {56 vars in 1177 bytes} [Thu Oct 27 09:35:25 2022] GET /identity/v3/users/4e84de4bcf5f4826a3ce0f0953231ea0 => generated 311 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 09:35:25.540136 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9593710-c3da-4d99-b1f8-ffe3c7e990dc None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:35:25.555624 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:35:25.642386 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9593710-c3da-4d99-b1f8-ffe3c7e990dc None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:35:25.676976 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2faa7a1f-0c5a-43bb-9956-1ee79f2c86be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:35:25.677579 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2faa7a1f-0c5a-43bb-9956-1ee79f2c86be None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:35:25.677863 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2faa7a1f-0c5a-43bb-9956-1ee79f2c86be None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:35:25.678143 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2faa7a1f-0c5a-43bb-9956-1ee79f2c86be None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:35:25.745776 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2faa7a1f-0c5a-43bb-9956-1ee79f2c86be None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:35:25.747260 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2faa7a1f-0c5a-43bb-9956-1ee79f2c86be None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:35:25.761249 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:35:25.846196 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 447/903] 10.222.0.65 () {58 vars in 1282 bytes} [Thu Oct 27 09:35:25 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 27 09:35:25.853119 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e695849-9e2c-4132-abb1-043b840f0010 None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:35:25.875239 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:35:25.952513 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e695849-9e2c-4132-abb1-043b840f0010 None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:35:25.991246 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4c70f4-d2cc-4bb8-80ac-fa7e4507f390 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:35:25.991870 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4c70f4-d2cc-4bb8-80ac-fa7e4507f390 None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:35:25.992146 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4c70f4-d2cc-4bb8-80ac-fa7e4507f390 None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:35:25.992415 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4c70f4-d2cc-4bb8-80ac-fa7e4507f390 None admin] PATH_INFO: `/v3/projects/08ae194f2f734000bd8a5951a789eec9` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:35:25.993519 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4c70f4-d2cc-4bb8-80ac-fa7e4507f390 None admin] RBAC: Authorizing `identity:get_project(project_id=08ae194f2f734000bd8a5951a789eec9)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:35:25.994976 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4c70f4-d2cc-4bb8-80ac-fa7e4507f390 None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:35:25.996585 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 457/904] 10.222.0.65 () {56 vars in 1186 bytes} [Thu Oct 27 09:35:25 2022] GET /identity/v3/projects/08ae194f2f734000bd8a5951a789eec9 => generated 361 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 09:35:26.002780 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2faa7a1f-0c5a-43bb-9956-1ee79f2c86be None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:35:26.102915 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2faa7a1f-0c5a-43bb-9956-1ee79f2c86be None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:35:26.117162 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:35:26.138428 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e43e402-7562-44fa-9448-078b4ea96b6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:35:26.139062 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e43e402-7562-44fa-9448-078b4ea96b6d None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:35:26.139346 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e43e402-7562-44fa-9448-078b4ea96b6d None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:35:26.139623 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e43e402-7562-44fa-9448-078b4ea96b6d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:35:26.140349 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e43e402-7562-44fa-9448-078b4ea96b6d None admin] RBAC: Adding query filter params (role.id=6ad17b9f9dea4b66ab2da3677d7e715d, scope.project.id=08ae194f2f734000bd8a5951a789eec9, user.id=4e84de4bcf5f4826a3ce0f0953231ea0) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 09:35:26.140659 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e43e402-7562-44fa-9448-078b4ea96b6d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:35:26.142116 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e43e402-7562-44fa-9448-078b4ea96b6d None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:35:26.148358 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 448/905] 10.222.0.65 () {56 vars in 1374 bytes} [Thu Oct 27 09:35:26 2022] GET /identity/v3/role_assignments?user.id=4e84de4bcf5f4826a3ce0f0953231ea0&scope.project.id=08ae194f2f734000bd8a5951a789eec9&role.id=6ad17b9f9dea4b66ab2da3677d7e715d => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 09:35:35.986759 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=56 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:35:36.150475 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=12 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:36:39.683620 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2062f8ca-f21e-47e7-a578-6bf9a42cc90b None None] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:36:39.684207 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2062f8ca-f21e-47e7-a578-6bf9a42cc90b None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:36:39.684207 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2062f8ca-f21e-47e7-a578-6bf9a42cc90b None None] PATH_INFO: `/` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:36:39.685546 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 458/906] 10.222.0.65 () {54 vars in 927 bytes} [Thu Oct 27 09:36:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 27 09:36:39.691269 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94056c98-22f8-479d-a7cb-fba699235350 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:36:39.691674 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94056c98-22f8-479d-a7cb-fba699235350 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:36:39.691851 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94056c98-22f8-479d-a7cb-fba699235350 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:36:39.713832 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-94056c98-22f8-479d-a7cb-fba699235350 None None] MFA Rules not processed for user `b5065084bf664b99bdeac46067cb0f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:36:39.715087 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-94056c98-22f8-479d-a7cb-fba699235350 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:36:39.783775 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 449/907] 10.222.0.65 () {58 vars in 1024 bytes} [Thu Oct 27 09:36:39 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 27 09:36:40.056634 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2062f8ca-f21e-47e7-a578-6bf9a42cc90b None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:36:40.156499 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2062f8ca-f21e-47e7-a578-6bf9a42cc90b None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:36:40.192945 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa6fd38-04e6-47ff-8caa-81c15986cc66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:36:40.193684 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa6fd38-04e6-47ff-8caa-81c15986cc66 None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:36:40.193925 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa6fd38-04e6-47ff-8caa-81c15986cc66 None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:36:40.194203 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa6fd38-04e6-47ff-8caa-81c15986cc66 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:36:40.204988 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa6fd38-04e6-47ff-8caa-81c15986cc66 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:36:40.212839 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa6fd38-04e6-47ff-8caa-81c15986cc66 None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:36:40.220927 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application [None req-eaa6fd38-04e6-47ff-8caa-81c15986cc66 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 09:36:40.220927 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 09:36:40.220927 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 09:36:40.220927 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 09:36:40.220927 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 09:36:40.220927 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 09:36:40.220927 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 09:36:40.220927 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 09:36:40.220927 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 09:36:40.220927 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 09:36:40.220927 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 09:36:40.220927 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 09:36:40.220927 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 27 09:36:40.220927 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 27 09:36:40.220927 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 27 09:36:40.220927 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 27 09:36:40.222099 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 09:36:40.222099 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 09:36:40.222099 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 09:36:40.222099 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 09:36:40.222099 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 09:36:40.222099 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 09:36:40.222099 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 09:36:40.222099 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application with Lock( Oct 27 09:36:40.222099 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 09:36:40.222099 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._enter() Oct 27 09:36:40.222099 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 09:36:40.222099 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 09:36:40.222099 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 09:36:40.222099 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.creator() Oct 27 09:36:40.222099 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 09:36:40.222099 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application created_value = creator( Oct 27 09:36:40.222099 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 27 09:36:40.223350 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 27 09:36:40.223350 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 09:36:40.223350 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application Oct 27 09:36:40.223350 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 459/908] 10.222.0.65 () {56 vars in 1108 bytes} [Thu Oct 27 09:36:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 09:36:40.228711 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94056c98-22f8-479d-a7cb-fba699235350 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:36:40.326978 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94056c98-22f8-479d-a7cb-fba699235350 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:36:40.357313 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:36:40.363295 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb6e486-e9b1-41fc-aad0-0f123bba613a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:36:40.363904 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb6e486-e9b1-41fc-aad0-0f123bba613a None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:36:40.364186 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb6e486-e9b1-41fc-aad0-0f123bba613a None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:36:40.365569 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb6e486-e9b1-41fc-aad0-0f123bba613a None admin] PATH_INFO: `/v3/domains` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:36:40.366234 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb6e486-e9b1-41fc-aad0-0f123bba613a None admin] RBAC: Adding query filter params (name=Default) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 09:36:40.366599 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb6e486-e9b1-41fc-aad0-0f123bba613a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:36:40.367975 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb6e486-e9b1-41fc-aad0-0f123bba613a None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:36:40.379549 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 450/909] 10.222.0.65 () {56 vars in 1109 bytes} [Thu Oct 27 09:36:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 09:36:40.386237 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa6fd38-04e6-47ff-8caa-81c15986cc66 None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:36:40.441454 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:36:40.490023 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa6fd38-04e6-47ff-8caa-81c15986cc66 None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:36:40.523666 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d36eef2-8845-476f-bb9d-11e09077eb1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:36:40.524266 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d36eef2-8845-476f-bb9d-11e09077eb1a None admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:36:40.524545 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d36eef2-8845-476f-bb9d-11e09077eb1a None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:36:40.524978 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d36eef2-8845-476f-bb9d-11e09077eb1a None admin] PATH_INFO: `/v3/users` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:36:40.525633 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d36eef2-8845-476f-bb9d-11e09077eb1a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:36:40.527141 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d36eef2-8845-476f-bb9d-11e09077eb1a None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:36:40.613607 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 460/910] 10.222.0.65 () {60 vars in 1132 bytes} [Thu Oct 27 09:36:40 2022] POST /identity/v3/users => generated 251 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 09:36:42.801549 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a43852-c798-4d3c-890e-a772ec025b83 None None] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:36:42.802137 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a43852-c798-4d3c-890e-a772ec025b83 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:36:42.802137 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a43852-c798-4d3c-890e-a772ec025b83 None None] PATH_INFO: `/` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:36:42.803480 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 451/911] 10.222.0.65 () {54 vars in 927 bytes} [Thu Oct 27 09:36:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 27 09:36:42.808622 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efbbd1d-6e76-4553-83aa-26d1b97f2ce3 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:36:42.809011 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efbbd1d-6e76-4553-83aa-26d1b97f2ce3 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:36:42.809178 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efbbd1d-6e76-4553-83aa-26d1b97f2ce3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:36:42.827367 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-8efbbd1d-6e76-4553-83aa-26d1b97f2ce3 None None] MFA Rules not processed for user `b5065084bf664b99bdeac46067cb0f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:36:42.828581 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-8efbbd1d-6e76-4553-83aa-26d1b97f2ce3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:36:42.902356 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 461/912] 10.222.0.65 () {58 vars in 1024 bytes} [Thu Oct 27 09:36:42 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 27 09:36:43.185244 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a43852-c798-4d3c-890e-a772ec025b83 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:36:43.293827 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a43852-c798-4d3c-890e-a772ec025b83 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:36:43.327462 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4c0408-064c-4068-a780-d033e883dfe1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:36:43.328836 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4c0408-064c-4068-a780-d033e883dfe1 None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:36:43.328836 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4c0408-064c-4068-a780-d033e883dfe1 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:36:43.328836 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4c0408-064c-4068-a780-d033e883dfe1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:36:43.339722 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4c0408-064c-4068-a780-d033e883dfe1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 09:36:43.344443 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application [None req-4d4c0408-064c-4068-a780-d033e883dfe1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 27 09:36:43.344443 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 09:36:43.344443 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 09:36:43.344443 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 09:36:43.344443 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 09:36:43.344443 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 09:36:43.344443 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 09:36:43.344443 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 09:36:43.344443 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 09:36:43.344443 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 09:36:43.344443 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 09:36:43.344443 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 09:36:43.344443 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 27 09:36:43.344443 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 27 09:36:43.344443 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 27 09:36:43.344443 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 27 09:36:43.345555 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 27 09:36:43.345555 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 27 09:36:43.345555 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 27 09:36:43.345555 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 27 09:36:43.345555 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 09:36:43.345555 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 09:36:43.345555 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 09:36:43.345555 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 09:36:43.345555 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 09:36:43.345555 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 09:36:43.345555 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 09:36:43.345555 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application with Lock( Oct 27 09:36:43.345555 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 09:36:43.345555 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._enter() Oct 27 09:36:43.345555 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 09:36:43.345555 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 09:36:43.346409 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 09:36:43.346409 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.creator() Oct 27 09:36:43.346409 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 09:36:43.346409 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application created_value = creator( Oct 27 09:36:43.346409 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 27 09:36:43.346409 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 27 09:36:43.346409 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 27 09:36:43.346409 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 27 09:36:43.346409 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 27 09:36:43.346409 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 27 09:36:43.346409 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 27 09:36:43.346409 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application Oct 27 09:36:43.346409 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 452/913] 10.222.0.65 () {56 vars in 1102 bytes} [Thu Oct 27 09:36:43 2022] GET /identity/v3/roles/service => generated 85 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 09:36:43.352775 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efbbd1d-6e76-4553-83aa-26d1b97f2ce3 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:36:43.393478 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:36:43.459675 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efbbd1d-6e76-4553-83aa-26d1b97f2ce3 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:36:43.494182 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4870f4a5-414f-4b62-9524-9ae5888462d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:36:43.494814 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4870f4a5-414f-4b62-9524-9ae5888462d9 None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:36:43.495098 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4870f4a5-414f-4b62-9524-9ae5888462d9 None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:36:43.495373 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4870f4a5-414f-4b62-9524-9ae5888462d9 None admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:36:43.496181 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4870f4a5-414f-4b62-9524-9ae5888462d9 None admin] RBAC: Adding query filter params (name=service) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 09:36:43.496489 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4870f4a5-414f-4b62-9524-9ae5888462d9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:36:43.498113 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4870f4a5-414f-4b62-9524-9ae5888462d9 None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:36:43.506382 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 462/914] 10.222.0.65 () {56 vars in 1103 bytes} [Thu Oct 27 09:36:43 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 09:36:43.512497 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4c0408-064c-4068-a780-d033e883dfe1 None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:36:43.563634 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:36:43.614419 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4c0408-064c-4068-a780-d033e883dfe1 None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:36:43.649376 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67752b4f-7f02-4864-a803-24371515bfc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:36:43.649992 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67752b4f-7f02-4864-a803-24371515bfc1 None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:36:43.650270 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67752b4f-7f02-4864-a803-24371515bfc1 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:36:43.650558 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67752b4f-7f02-4864-a803-24371515bfc1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:36:43.660887 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67752b4f-7f02-4864-a803-24371515bfc1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:36:43.663053 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67752b4f-7f02-4864-a803-24371515bfc1 None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:36:43.676826 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application [None req-67752b4f-7f02-4864-a803-24371515bfc1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 09:36:43.676826 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 09:36:43.676826 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 09:36:43.676826 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 09:36:43.676826 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 09:36:43.676826 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 09:36:43.676826 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 09:36:43.676826 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 09:36:43.676826 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 09:36:43.676826 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 09:36:43.676826 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 09:36:43.676826 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 09:36:43.676826 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 27 09:36:43.676826 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 27 09:36:43.676826 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 27 09:36:43.676826 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 27 09:36:43.679276 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 09:36:43.679276 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 09:36:43.679276 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 09:36:43.679276 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 09:36:43.679276 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 09:36:43.679276 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 09:36:43.679276 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 09:36:43.679276 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application with Lock( Oct 27 09:36:43.679276 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 09:36:43.679276 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._enter() Oct 27 09:36:43.679276 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 09:36:43.679276 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 09:36:43.679276 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 09:36:43.679276 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.creator() Oct 27 09:36:43.679276 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 09:36:43.679276 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application created_value = creator( Oct 27 09:36:43.679276 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 27 09:36:43.680347 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 27 09:36:43.680347 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 09:36:43.680347 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application Oct 27 09:36:43.680347 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 453/915] 10.222.0.65 () {56 vars in 1108 bytes} [Thu Oct 27 09:36:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 09:36:43.684290 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4870f4a5-414f-4b62-9524-9ae5888462d9 None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:36:43.785554 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:36:43.788713 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4870f4a5-414f-4b62-9524-9ae5888462d9 None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:36:43.821049 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a793d2-2787-4f55-a6d8-784541d6c8a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:36:43.821708 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a793d2-2787-4f55-a6d8-784541d6c8a9 None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:36:43.821897 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a793d2-2787-4f55-a6d8-784541d6c8a9 None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:36:43.822167 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a793d2-2787-4f55-a6d8-784541d6c8a9 None admin] PATH_INFO: `/v3/domains` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:36:43.822813 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a793d2-2787-4f55-a6d8-784541d6c8a9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 09:36:43.823110 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a793d2-2787-4f55-a6d8-784541d6c8a9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:36:43.824495 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a793d2-2787-4f55-a6d8-784541d6c8a9 None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:36:43.836718 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 463/916] 10.222.0.65 () {56 vars in 1109 bytes} [Thu Oct 27 09:36:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 09:36:43.842837 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67752b4f-7f02-4864-a803-24371515bfc1 None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:36:43.944505 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67752b4f-7f02-4864-a803-24371515bfc1 None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:36:43.946031 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:36:43.978997 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacd53d1-429c-4439-88de-c403979af258 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:36:43.979629 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacd53d1-429c-4439-88de-c403979af258 None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:36:43.979909 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacd53d1-429c-4439-88de-c403979af258 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:36:43.980182 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacd53d1-429c-4439-88de-c403979af258 None admin] PATH_INFO: `/v3/users/placement` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:36:43.987610 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bacd53d1-429c-4439-88de-c403979af258 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:36:43.989047 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bacd53d1-429c-4439-88de-c403979af258 None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:36:44.000254 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application [None req-bacd53d1-429c-4439-88de-c403979af258 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 27 09:36:44.000254 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 09:36:44.000254 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 09:36:44.000254 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 09:36:44.000254 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 09:36:44.000254 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 09:36:44.000254 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 09:36:44.000254 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 09:36:44.000254 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 09:36:44.000254 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 09:36:44.000254 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 09:36:44.000254 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 09:36:44.000254 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 27 09:36:44.000254 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 27 09:36:44.000254 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 27 09:36:44.000254 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 27 09:36:44.001306 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 09:36:44.001306 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 09:36:44.001306 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 27 09:36:44.001306 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 27 09:36:44.001306 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 27 09:36:44.001306 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 27 09:36:44.001306 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 09:36:44.001306 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 09:36:44.001306 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 09:36:44.001306 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 09:36:44.001306 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 09:36:44.001306 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application with Lock( Oct 27 09:36:44.001306 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 09:36:44.001306 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._enter() Oct 27 09:36:44.001306 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 09:36:44.001306 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 09:36:44.001306 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 09:36:44.001306 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.creator() Oct 27 09:36:44.002383 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 09:36:44.002383 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application created_value = creator( Oct 27 09:36:44.002383 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 27 09:36:44.002383 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 27 09:36:44.002383 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 27 09:36:44.002383 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 27 09:36:44.002383 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 27 09:36:44.002383 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 27 09:36:44.002383 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 27 09:36:44.002383 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application Oct 27 09:36:44.002383 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 454/917] 10.222.0.65 () {56 vars in 1108 bytes} [Thu Oct 27 09:36:43 2022] GET /identity/v3/users/placement => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 09:36:44.008200 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a793d2-2787-4f55-a6d8-784541d6c8a9 None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:36:44.109871 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a793d2-2787-4f55-a6d8-784541d6c8a9 None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:36:44.145302 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7a72bf-b705-44ad-aa61-a79d45082cb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:36:44.145908 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7a72bf-b705-44ad-aa61-a79d45082cb9 None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:36:44.146190 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7a72bf-b705-44ad-aa61-a79d45082cb9 None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:36:44.146460 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7a72bf-b705-44ad-aa61-a79d45082cb9 None admin] PATH_INFO: `/v3/users` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:36:44.147326 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7a72bf-b705-44ad-aa61-a79d45082cb9 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 09:36:44.147627 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7a72bf-b705-44ad-aa61-a79d45082cb9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:36:44.149103 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7a72bf-b705-44ad-aa61-a79d45082cb9 None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:36:44.169308 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 464/918] 10.222.0.65 () {56 vars in 1143 bytes} [Thu Oct 27 09:36:44 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 09:36:44.175287 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacd53d1-429c-4439-88de-c403979af258 None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:36:44.279855 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacd53d1-429c-4439-88de-c403979af258 None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:36:44.316766 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54ef0cb-98f6-4a5e-96e3-d2bb95cbd890 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:36:44.317396 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54ef0cb-98f6-4a5e-96e3-d2bb95cbd890 None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:36:44.317680 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54ef0cb-98f6-4a5e-96e3-d2bb95cbd890 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:36:44.317956 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54ef0cb-98f6-4a5e-96e3-d2bb95cbd890 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:36:44.329874 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54ef0cb-98f6-4a5e-96e3-d2bb95cbd890 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:36:44.331360 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54ef0cb-98f6-4a5e-96e3-d2bb95cbd890 None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:36:44.347034 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application [None req-f54ef0cb-98f6-4a5e-96e3-d2bb95cbd890 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 09:36:44.347034 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 09:36:44.347034 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 09:36:44.347034 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 09:36:44.347034 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 09:36:44.347034 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 09:36:44.347034 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 09:36:44.347034 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 09:36:44.347034 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 09:36:44.347034 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 09:36:44.347034 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 09:36:44.347034 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 09:36:44.347034 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 27 09:36:44.347034 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 27 09:36:44.347034 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 27 09:36:44.347034 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 27 09:36:44.352925 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 09:36:44.352925 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 09:36:44.352925 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 09:36:44.352925 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 09:36:44.352925 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 09:36:44.352925 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 09:36:44.352925 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 09:36:44.352925 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application with Lock( Oct 27 09:36:44.352925 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 09:36:44.352925 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._enter() Oct 27 09:36:44.352925 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 09:36:44.352925 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 09:36:44.352925 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 09:36:44.352925 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.creator() Oct 27 09:36:44.352925 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 09:36:44.352925 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application created_value = creator( Oct 27 09:36:44.352925 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 27 09:36:44.353971 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 27 09:36:44.353971 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 09:36:44.353971 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application Oct 27 09:36:44.353971 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 455/919] 10.222.0.65 () {56 vars in 1108 bytes} [Thu Oct 27 09:36:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 09:36:44.354550 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7a72bf-b705-44ad-aa61-a79d45082cb9 None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:36:44.377338 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:36:44.457629 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7a72bf-b705-44ad-aa61-a79d45082cb9 None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:36:44.500990 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9ab81d-ce18-46dc-9bc0-413dcc8fa907 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:36:44.501594 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9ab81d-ce18-46dc-9bc0-413dcc8fa907 None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:36:44.501875 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9ab81d-ce18-46dc-9bc0-413dcc8fa907 None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:36:44.502152 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9ab81d-ce18-46dc-9bc0-413dcc8fa907 None admin] PATH_INFO: `/v3/domains` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:36:44.502819 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9ab81d-ce18-46dc-9bc0-413dcc8fa907 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 09:36:44.503132 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9ab81d-ce18-46dc-9bc0-413dcc8fa907 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:36:44.504580 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9ab81d-ce18-46dc-9bc0-413dcc8fa907 None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:36:44.516409 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 465/920] 10.222.0.65 () {56 vars in 1109 bytes} [Thu Oct 27 09:36:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 09:36:44.522388 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54ef0cb-98f6-4a5e-96e3-d2bb95cbd890 None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:36:44.539979 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:36:44.626840 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54ef0cb-98f6-4a5e-96e3-d2bb95cbd890 None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:36:44.662700 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485dc1e1-41cc-4e92-be64-4fd9accdf600 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:36:44.663423 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485dc1e1-41cc-4e92-be64-4fd9accdf600 None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:36:44.663709 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485dc1e1-41cc-4e92-be64-4fd9accdf600 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:36:44.663984 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485dc1e1-41cc-4e92-be64-4fd9accdf600 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:36:44.671073 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485dc1e1-41cc-4e92-be64-4fd9accdf600 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:36:44.672525 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485dc1e1-41cc-4e92-be64-4fd9accdf600 None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:36:44.684519 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application [None req-485dc1e1-41cc-4e92-be64-4fd9accdf600 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 27 09:36:44.684519 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 09:36:44.684519 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 09:36:44.684519 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 09:36:44.684519 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 09:36:44.684519 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 09:36:44.684519 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 09:36:44.684519 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 09:36:44.684519 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 09:36:44.684519 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 09:36:44.684519 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 09:36:44.684519 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 09:36:44.684519 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 27 09:36:44.684519 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 27 09:36:44.684519 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 27 09:36:44.685697 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 27 09:36:44.685697 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 09:36:44.685697 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 09:36:44.685697 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 09:36:44.685697 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 09:36:44.685697 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 09:36:44.685697 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 09:36:44.685697 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 09:36:44.685697 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application with Lock( Oct 27 09:36:44.685697 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 09:36:44.685697 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._enter() Oct 27 09:36:44.685697 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 09:36:44.685697 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 09:36:44.685697 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 09:36:44.685697 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.creator() Oct 27 09:36:44.685697 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 09:36:44.685697 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application created_value = creator( Oct 27 09:36:44.686839 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 27 09:36:44.686839 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 27 09:36:44.686839 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 27 09:36:44.686839 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 27 09:36:44.686839 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 27 09:36:44.686839 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 27 09:36:44.686839 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 27 09:36:44.686839 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application Oct 27 09:36:44.686839 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 456/921] 10.222.0.65 () {56 vars in 1111 bytes} [Thu Oct 27 09:36:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 09:36:44.691803 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9ab81d-ce18-46dc-9bc0-413dcc8fa907 None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:36:44.771443 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:36:44.793304 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9ab81d-ce18-46dc-9bc0-413dcc8fa907 None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:36:44.826966 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4461a105-9ce2-4696-9cb1-e0e49f916e0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:36:44.827618 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4461a105-9ce2-4696-9cb1-e0e49f916e0a None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:36:44.827838 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4461a105-9ce2-4696-9cb1-e0e49f916e0a None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:36:44.828113 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4461a105-9ce2-4696-9cb1-e0e49f916e0a None admin] PATH_INFO: `/v3/projects` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:36:44.828799 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4461a105-9ce2-4696-9cb1-e0e49f916e0a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 09:36:44.829106 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4461a105-9ce2-4696-9cb1-e0e49f916e0a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:36:44.830556 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4461a105-9ce2-4696-9cb1-e0e49f916e0a None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:36:44.844585 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 466/922] 10.222.0.65 () {56 vars in 1148 bytes} [Thu Oct 27 09:36:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 09:36:44.852757 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485dc1e1-41cc-4e92-be64-4fd9accdf600 None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:36:44.929990 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:36:44.954534 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485dc1e1-41cc-4e92-be64-4fd9accdf600 None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:36:44.988476 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a36a08a-60ba-40d7-81ad-a290ebd32b82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:36:44.989126 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a36a08a-60ba-40d7-81ad-a290ebd32b82 None admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:36:44.989408 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a36a08a-60ba-40d7-81ad-a290ebd32b82 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:36:44.989690 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a36a08a-60ba-40d7-81ad-a290ebd32b82 None admin] PATH_INFO: `/v3/projects/dc2e3a7a1bcc480891c0b433291c00b1/users/f8c47ff5d72943f6bab09b5df6198d64/roles/8d728ccbaa534a949df6711b47151356` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:36:45.004019 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a36a08a-60ba-40d7-81ad-a290ebd32b82 None admin] RBAC: Authorizing `identity:create_grant(project_id=dc2e3a7a1bcc480891c0b433291c00b1, user_id=f8c47ff5d72943f6bab09b5df6198d64, role_id=8d728ccbaa534a949df6711b47151356)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:36:45.005810 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a36a08a-60ba-40d7-81ad-a290ebd32b82 None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:36:45.088246 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 457/923] 10.222.0.65 () {58 vars in 1439 bytes} [Thu Oct 27 09:36:44 2022] PUT /identity/v3/projects/dc2e3a7a1bcc480891c0b433291c00b1/users/f8c47ff5d72943f6bab09b5df6198d64/roles/8d728ccbaa534a949df6711b47151356 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 09:36:47.224490 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0694699b-c763-47a5-a9bf-1c7524d48dee None None] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:36:47.225061 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0694699b-c763-47a5-a9bf-1c7524d48dee None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:36:47.225061 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0694699b-c763-47a5-a9bf-1c7524d48dee None None] PATH_INFO: `/` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:36:47.226336 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 467/924] 10.222.0.65 () {54 vars in 927 bytes} [Thu Oct 27 09:36:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 09:36:47.231957 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca91fcfa-20a7-4c23-849f-9d3a0fbe0efe None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:36:47.232369 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca91fcfa-20a7-4c23-849f-9d3a0fbe0efe None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:36:47.232534 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca91fcfa-20a7-4c23-849f-9d3a0fbe0efe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:36:47.251291 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-ca91fcfa-20a7-4c23-849f-9d3a0fbe0efe None None] MFA Rules not processed for user `b5065084bf664b99bdeac46067cb0f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:36:47.252489 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-ca91fcfa-20a7-4c23-849f-9d3a0fbe0efe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:36:47.320295 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 458/925] 10.222.0.65 () {58 vars in 1024 bytes} [Thu Oct 27 09:36:47 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 27 09:36:47.589826 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0694699b-c763-47a5-a9bf-1c7524d48dee None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:36:47.692230 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0694699b-c763-47a5-a9bf-1c7524d48dee None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:36:47.727229 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c6919d-309c-4975-afb6-79d9cc84506d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:36:47.727855 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c6919d-309c-4975-afb6-79d9cc84506d None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:36:47.728179 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c6919d-309c-4975-afb6-79d9cc84506d None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:36:47.728451 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c6919d-309c-4975-afb6-79d9cc84506d None admin] PATH_INFO: `/v3/roles/service` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:36:47.735466 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:36:47.739452 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c6919d-309c-4975-afb6-79d9cc84506d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 09:36:47.745389 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application [None req-47c6919d-309c-4975-afb6-79d9cc84506d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 27 09:36:47.745389 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 09:36:47.745389 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 09:36:47.745389 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 09:36:47.745389 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 09:36:47.745389 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 09:36:47.745389 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 09:36:47.745389 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 09:36:47.745389 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 09:36:47.745389 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 09:36:47.745389 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 09:36:47.745389 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 09:36:47.745389 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 27 09:36:47.745389 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 27 09:36:47.745389 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 27 09:36:47.745389 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 27 09:36:47.746538 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 27 09:36:47.746538 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 27 09:36:47.746538 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 27 09:36:47.746538 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 27 09:36:47.746538 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 09:36:47.746538 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 09:36:47.746538 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 09:36:47.746538 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 09:36:47.746538 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 09:36:47.746538 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 09:36:47.746538 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 09:36:47.746538 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application with Lock( Oct 27 09:36:47.746538 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 09:36:47.746538 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._enter() Oct 27 09:36:47.746538 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 09:36:47.746538 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 09:36:47.747731 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 09:36:47.747731 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.creator() Oct 27 09:36:47.747731 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 09:36:47.747731 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application created_value = creator( Oct 27 09:36:47.747731 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 27 09:36:47.747731 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 27 09:36:47.747731 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 27 09:36:47.747731 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 27 09:36:47.747731 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 27 09:36:47.747731 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 27 09:36:47.747731 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 27 09:36:47.747731 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application Oct 27 09:36:47.747731 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 468/926] 10.222.0.65 () {56 vars in 1102 bytes} [Thu Oct 27 09:36:47 2022] GET /identity/v3/roles/service => generated 85 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 09:36:47.752680 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca91fcfa-20a7-4c23-849f-9d3a0fbe0efe None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:36:47.810686 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:36:47.857140 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca91fcfa-20a7-4c23-849f-9d3a0fbe0efe None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:36:47.892416 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbc19ba-eba2-46c9-99f6-c806e6852978 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:36:47.893015 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbc19ba-eba2-46c9-99f6-c806e6852978 None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:36:47.893298 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbc19ba-eba2-46c9-99f6-c806e6852978 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:36:47.893575 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbc19ba-eba2-46c9-99f6-c806e6852978 None admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:36:47.894235 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbc19ba-eba2-46c9-99f6-c806e6852978 None admin] RBAC: Adding query filter params (name=service) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 09:36:47.894563 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbc19ba-eba2-46c9-99f6-c806e6852978 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:36:47.896516 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbc19ba-eba2-46c9-99f6-c806e6852978 None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:36:47.904615 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 459/927] 10.222.0.65 () {56 vars in 1103 bytes} [Thu Oct 27 09:36:47 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 09:36:47.910653 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c6919d-309c-4975-afb6-79d9cc84506d None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:36:48.011928 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c6919d-309c-4975-afb6-79d9cc84506d None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:36:48.046604 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba48b882-dfa4-40cf-82e5-d13936098d37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:36:48.047226 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba48b882-dfa4-40cf-82e5-d13936098d37 None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:36:48.047508 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba48b882-dfa4-40cf-82e5-d13936098d37 None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:36:48.047787 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba48b882-dfa4-40cf-82e5-d13936098d37 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:36:48.057983 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba48b882-dfa4-40cf-82e5-d13936098d37 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:36:48.059442 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba48b882-dfa4-40cf-82e5-d13936098d37 None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:36:48.074503 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application [None req-ba48b882-dfa4-40cf-82e5-d13936098d37 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 09:36:48.074503 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 09:36:48.074503 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 09:36:48.074503 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 09:36:48.074503 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 09:36:48.074503 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 09:36:48.074503 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 09:36:48.074503 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 09:36:48.074503 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 09:36:48.074503 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 09:36:48.074503 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 09:36:48.074503 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 09:36:48.074503 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 27 09:36:48.074503 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 27 09:36:48.074503 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 27 09:36:48.074503 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 27 09:36:48.081447 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 09:36:48.081447 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 09:36:48.081447 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 09:36:48.081447 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 09:36:48.081447 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 09:36:48.081447 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 09:36:48.081447 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 09:36:48.081447 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application with Lock( Oct 27 09:36:48.081447 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 09:36:48.081447 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._enter() Oct 27 09:36:48.081447 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 09:36:48.081447 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 09:36:48.081447 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 09:36:48.081447 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.creator() Oct 27 09:36:48.081447 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 09:36:48.081447 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application created_value = creator( Oct 27 09:36:48.081447 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 27 09:36:48.082545 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 27 09:36:48.082545 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 09:36:48.082545 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application Oct 27 09:36:48.082545 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 469/928] 10.222.0.65 () {56 vars in 1108 bytes} [Thu Oct 27 09:36:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 09:36:48.082776 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbc19ba-eba2-46c9-99f6-c806e6852978 None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:36:48.184395 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbc19ba-eba2-46c9-99f6-c806e6852978 None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:36:48.200571 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:36:48.219355 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f28b51-363e-4138-ad2b-e6e882c3a2eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:36:48.219958 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f28b51-363e-4138-ad2b-e6e882c3a2eb None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:36:48.220242 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f28b51-363e-4138-ad2b-e6e882c3a2eb None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:36:48.220519 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f28b51-363e-4138-ad2b-e6e882c3a2eb None admin] PATH_INFO: `/v3/domains` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:36:48.221161 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f28b51-363e-4138-ad2b-e6e882c3a2eb None admin] RBAC: Adding query filter params (name=Default) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 09:36:48.221465 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f28b51-363e-4138-ad2b-e6e882c3a2eb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:36:48.222960 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f28b51-363e-4138-ad2b-e6e882c3a2eb None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:36:48.235772 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 460/929] 10.222.0.65 () {56 vars in 1109 bytes} [Thu Oct 27 09:36:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 09:36:48.241562 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba48b882-dfa4-40cf-82e5-d13936098d37 None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:36:48.292986 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:36:48.343482 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba48b882-dfa4-40cf-82e5-d13936098d37 None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:36:48.377659 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b4d6d7-2e03-479f-bf56-48f68fb3f39c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:36:48.378289 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b4d6d7-2e03-479f-bf56-48f68fb3f39c None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:36:48.378598 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b4d6d7-2e03-479f-bf56-48f68fb3f39c None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:36:48.378877 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b4d6d7-2e03-479f-bf56-48f68fb3f39c None admin] PATH_INFO: `/v3/users/placement` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:36:48.387698 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b4d6d7-2e03-479f-bf56-48f68fb3f39c None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:36:48.389202 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b4d6d7-2e03-479f-bf56-48f68fb3f39c None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:36:48.401192 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application [None req-37b4d6d7-2e03-479f-bf56-48f68fb3f39c None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 27 09:36:48.401192 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 09:36:48.401192 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 09:36:48.401192 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 09:36:48.401192 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 09:36:48.401192 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 09:36:48.401192 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 09:36:48.401192 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 09:36:48.401192 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 09:36:48.401192 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 09:36:48.401192 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 09:36:48.401192 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 09:36:48.401192 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 27 09:36:48.401192 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 27 09:36:48.401192 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 27 09:36:48.401192 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 27 09:36:48.406162 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 09:36:48.406162 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 09:36:48.406162 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 27 09:36:48.406162 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 27 09:36:48.406162 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 27 09:36:48.406162 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 27 09:36:48.406162 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 09:36:48.406162 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 09:36:48.406162 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 09:36:48.406162 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 09:36:48.406162 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 09:36:48.406162 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application with Lock( Oct 27 09:36:48.406162 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 09:36:48.406162 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._enter() Oct 27 09:36:48.406162 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 09:36:48.406162 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 09:36:48.406162 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 09:36:48.406162 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.creator() Oct 27 09:36:48.407249 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 09:36:48.407249 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application created_value = creator( Oct 27 09:36:48.407249 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 27 09:36:48.407249 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 27 09:36:48.407249 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 27 09:36:48.407249 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 27 09:36:48.407249 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 27 09:36:48.407249 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 27 09:36:48.407249 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 27 09:36:48.407249 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application Oct 27 09:36:48.407249 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 470/930] 10.222.0.65 () {56 vars in 1108 bytes} [Thu Oct 27 09:36:48 2022] GET /identity/v3/users/placement => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 09:36:48.408470 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f28b51-363e-4138-ad2b-e6e882c3a2eb None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:36:48.510580 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f28b51-363e-4138-ad2b-e6e882c3a2eb None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:36:48.545035 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a92eaf-2d9c-41e3-9e73-64fcbe2bce63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:36:48.545638 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a92eaf-2d9c-41e3-9e73-64fcbe2bce63 None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:36:48.545920 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a92eaf-2d9c-41e3-9e73-64fcbe2bce63 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:36:48.546196 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a92eaf-2d9c-41e3-9e73-64fcbe2bce63 None admin] PATH_INFO: `/v3/users` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:36:48.546952 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a92eaf-2d9c-41e3-9e73-64fcbe2bce63 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 09:36:48.547260 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a92eaf-2d9c-41e3-9e73-64fcbe2bce63 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:36:48.548693 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a92eaf-2d9c-41e3-9e73-64fcbe2bce63 None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:36:48.566617 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 461/931] 10.222.0.65 () {56 vars in 1143 bytes} [Thu Oct 27 09:36:48 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 09:36:48.573531 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b4d6d7-2e03-479f-bf56-48f68fb3f39c None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:36:48.674382 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b4d6d7-2e03-479f-bf56-48f68fb3f39c None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:36:48.685210 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:36:48.708853 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18936beb-a78a-43e4-85d3-386e6e88e789 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:36:48.709444 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18936beb-a78a-43e4-85d3-386e6e88e789 None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:36:48.709764 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18936beb-a78a-43e4-85d3-386e6e88e789 None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:36:48.709990 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18936beb-a78a-43e4-85d3-386e6e88e789 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:36:48.776909 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18936beb-a78a-43e4-85d3-386e6e88e789 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:36:48.778286 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18936beb-a78a-43e4-85d3-386e6e88e789 None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:36:48.876109 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 471/932] 10.222.0.65 () {58 vars in 1282 bytes} [Thu Oct 27 09:36:48 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 27 09:36:48.882226 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a92eaf-2d9c-41e3-9e73-64fcbe2bce63 None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:36:48.916990 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:36:48.982085 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a92eaf-2d9c-41e3-9e73-64fcbe2bce63 None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:36:49.017436 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219f72b3-3cdd-4f9f-8a9d-a3b150247d1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:36:49.018064 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219f72b3-3cdd-4f9f-8a9d-a3b150247d1e None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:36:49.018342 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219f72b3-3cdd-4f9f-8a9d-a3b150247d1e None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:36:49.018643 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219f72b3-3cdd-4f9f-8a9d-a3b150247d1e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:36:49.029525 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219f72b3-3cdd-4f9f-8a9d-a3b150247d1e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:36:49.030934 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219f72b3-3cdd-4f9f-8a9d-a3b150247d1e None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:36:49.045152 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application [None req-219f72b3-3cdd-4f9f-8a9d-a3b150247d1e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 09:36:49.045152 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 09:36:49.045152 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 09:36:49.045152 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 09:36:49.045152 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 09:36:49.045152 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 09:36:49.045152 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 09:36:49.045152 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 09:36:49.045152 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 09:36:49.045152 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 09:36:49.045152 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 09:36:49.045152 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 09:36:49.045152 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 27 09:36:49.045152 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 27 09:36:49.045152 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 27 09:36:49.045152 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 27 09:36:49.047168 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 09:36:49.047168 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 09:36:49.047168 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 09:36:49.047168 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 09:36:49.047168 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 09:36:49.047168 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 09:36:49.047168 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 09:36:49.047168 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application with Lock( Oct 27 09:36:49.047168 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 09:36:49.047168 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._enter() Oct 27 09:36:49.047168 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 09:36:49.047168 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 09:36:49.047168 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 09:36:49.047168 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.creator() Oct 27 09:36:49.047168 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 09:36:49.047168 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application created_value = creator( Oct 27 09:36:49.047168 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 27 09:36:49.048229 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 27 09:36:49.048229 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 09:36:49.048229 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application Oct 27 09:36:49.048229 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 462/933] 10.222.0.65 () {56 vars in 1108 bytes} [Thu Oct 27 09:36:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 09:36:49.052065 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18936beb-a78a-43e4-85d3-386e6e88e789 None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:36:49.064078 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:36:49.152718 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18936beb-a78a-43e4-85d3-386e6e88e789 None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:36:49.186249 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6c5b6b-de04-4ac0-adbf-570b131dc9a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:36:49.186865 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6c5b6b-de04-4ac0-adbf-570b131dc9a6 None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:36:49.187140 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6c5b6b-de04-4ac0-adbf-570b131dc9a6 None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:36:49.187408 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6c5b6b-de04-4ac0-adbf-570b131dc9a6 None admin] PATH_INFO: `/v3/domains` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:36:49.188036 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6c5b6b-de04-4ac0-adbf-570b131dc9a6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 09:36:49.188333 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6c5b6b-de04-4ac0-adbf-570b131dc9a6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:36:49.189712 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6c5b6b-de04-4ac0-adbf-570b131dc9a6 None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:36:49.201271 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 472/934] 10.222.0.65 () {56 vars in 1109 bytes} [Thu Oct 27 09:36:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 09:36:49.207179 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219f72b3-3cdd-4f9f-8a9d-a3b150247d1e None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:36:49.294737 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:36:49.310301 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219f72b3-3cdd-4f9f-8a9d-a3b150247d1e None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:36:49.344224 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4fbe54-45cc-4617-a7a6-cbc48f2c6204 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:36:49.344857 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4fbe54-45cc-4617-a7a6-cbc48f2c6204 None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:36:49.345142 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4fbe54-45cc-4617-a7a6-cbc48f2c6204 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:36:49.345412 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4fbe54-45cc-4617-a7a6-cbc48f2c6204 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:36:49.353181 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4fbe54-45cc-4617-a7a6-cbc48f2c6204 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:36:49.354681 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4fbe54-45cc-4617-a7a6-cbc48f2c6204 None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:36:49.369094 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application [None req-5b4fbe54-45cc-4617-a7a6-cbc48f2c6204 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 27 09:36:49.369094 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 09:36:49.369094 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 09:36:49.369094 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 09:36:49.369094 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 09:36:49.369094 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 09:36:49.369094 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 09:36:49.369094 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 09:36:49.369094 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 09:36:49.369094 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 09:36:49.369094 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 09:36:49.369094 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 09:36:49.369094 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 27 09:36:49.369094 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 27 09:36:49.369094 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 27 09:36:49.370667 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 27 09:36:49.370667 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 09:36:49.370667 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 09:36:49.370667 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 09:36:49.370667 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 09:36:49.370667 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 09:36:49.370667 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 09:36:49.370667 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 09:36:49.370667 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application with Lock( Oct 27 09:36:49.370667 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 09:36:49.370667 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._enter() Oct 27 09:36:49.370667 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 09:36:49.370667 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 09:36:49.370667 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 09:36:49.370667 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.creator() Oct 27 09:36:49.370667 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 09:36:49.370667 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application created_value = creator( Oct 27 09:36:49.371726 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 27 09:36:49.371726 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 27 09:36:49.371726 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 27 09:36:49.371726 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 27 09:36:49.371726 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 27 09:36:49.371726 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 27 09:36:49.371726 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 27 09:36:49.371726 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application Oct 27 09:36:49.371726 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 463/935] 10.222.0.65 () {56 vars in 1111 bytes} [Thu Oct 27 09:36:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 09:36:49.376406 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6c5b6b-de04-4ac0-adbf-570b131dc9a6 None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:36:49.447115 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:36:49.478914 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6c5b6b-de04-4ac0-adbf-570b131dc9a6 None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:36:49.513530 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e151326-3f1e-42b7-ac68-1b4278032d07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:36:49.514262 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e151326-3f1e-42b7-ac68-1b4278032d07 None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:36:49.514580 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e151326-3f1e-42b7-ac68-1b4278032d07 None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:36:49.514863 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e151326-3f1e-42b7-ac68-1b4278032d07 None admin] PATH_INFO: `/v3/projects` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:36:49.515549 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e151326-3f1e-42b7-ac68-1b4278032d07 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 09:36:49.515857 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e151326-3f1e-42b7-ac68-1b4278032d07 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:36:49.517281 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e151326-3f1e-42b7-ac68-1b4278032d07 None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:36:49.529964 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 473/936] 10.222.0.65 () {56 vars in 1148 bytes} [Thu Oct 27 09:36:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 09:36:49.536234 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4fbe54-45cc-4617-a7a6-cbc48f2c6204 None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:36:49.639269 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4fbe54-45cc-4617-a7a6-cbc48f2c6204 None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:36:49.674680 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ea1471-fcf2-4039-95f3-78f0945e6055 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:36:49.675287 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ea1471-fcf2-4039-95f3-78f0945e6055 None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:36:49.675569 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ea1471-fcf2-4039-95f3-78f0945e6055 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:36:49.675846 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ea1471-fcf2-4039-95f3-78f0945e6055 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:36:49.676566 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ea1471-fcf2-4039-95f3-78f0945e6055 None admin] RBAC: Adding query filter params (role.id=8d728ccbaa534a949df6711b47151356, scope.project.id=dc2e3a7a1bcc480891c0b433291c00b1, user.id=f8c47ff5d72943f6bab09b5df6198d64) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 09:36:49.676879 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ea1471-fcf2-4039-95f3-78f0945e6055 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:36:49.678597 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ea1471-fcf2-4039-95f3-78f0945e6055 None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:36:49.684444 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 464/937] 10.222.0.65 () {56 vars in 1374 bytes} [Thu Oct 27 09:36:49 2022] GET /identity/v3/role_assignments?user.id=f8c47ff5d72943f6bab09b5df6198d64&scope.project.id=dc2e3a7a1bcc480891c0b433291c00b1&role.id=8d728ccbaa534a949df6711b47151356 => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 09:36:51.893886 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507b2a34-51e4-4bdc-99a2-21b12e20eb37 None None] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:36:51.894434 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507b2a34-51e4-4bdc-99a2-21b12e20eb37 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:36:51.894434 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507b2a34-51e4-4bdc-99a2-21b12e20eb37 None None] PATH_INFO: `/` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:36:51.896326 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 474/938] 10.222.0.65 () {54 vars in 927 bytes} [Thu Oct 27 09:36:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 09:36:51.901510 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6a5690-7fe7-42eb-a11b-25b9289b2f03 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:36:51.901917 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6a5690-7fe7-42eb-a11b-25b9289b2f03 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:36:51.902062 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6a5690-7fe7-42eb-a11b-25b9289b2f03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:36:51.921104 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-5a6a5690-7fe7-42eb-a11b-25b9289b2f03 None None] MFA Rules not processed for user `b5065084bf664b99bdeac46067cb0f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:36:51.922291 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-5a6a5690-7fe7-42eb-a11b-25b9289b2f03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:36:51.925074 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:36:51.989787 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 465/939] 10.222.0.65 () {58 vars in 1024 bytes} [Thu Oct 27 09:36:51 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 27 09:36:52.261578 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507b2a34-51e4-4bdc-99a2-21b12e20eb37 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:36:52.364798 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507b2a34-51e4-4bdc-99a2-21b12e20eb37 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:36:52.395572 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:36:52.401467 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab77f3f6-d126-4623-a837-da21e3819e3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:36:52.407127 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab77f3f6-d126-4623-a837-da21e3819e3c None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:36:52.407127 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab77f3f6-d126-4623-a837-da21e3819e3c None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:36:52.407127 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab77f3f6-d126-4623-a837-da21e3819e3c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:36:52.412840 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab77f3f6-d126-4623-a837-da21e3819e3c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 09:36:52.417646 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application [None req-ab77f3f6-d126-4623-a837-da21e3819e3c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 27 09:36:52.417646 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 09:36:52.417646 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 09:36:52.417646 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 09:36:52.417646 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 09:36:52.417646 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 09:36:52.417646 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 09:36:52.417646 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 09:36:52.417646 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 09:36:52.417646 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 09:36:52.417646 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 09:36:52.417646 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 09:36:52.417646 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 27 09:36:52.417646 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 27 09:36:52.417646 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 27 09:36:52.417646 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 27 09:36:52.418767 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 27 09:36:52.418767 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 27 09:36:52.418767 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 27 09:36:52.418767 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 27 09:36:52.418767 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 09:36:52.418767 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 09:36:52.418767 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 09:36:52.418767 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 09:36:52.418767 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 09:36:52.418767 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 09:36:52.418767 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 09:36:52.418767 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application with Lock( Oct 27 09:36:52.418767 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 09:36:52.418767 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._enter() Oct 27 09:36:52.418767 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 09:36:52.418767 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 09:36:52.419635 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 09:36:52.419635 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.creator() Oct 27 09:36:52.419635 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 09:36:52.419635 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application created_value = creator( Oct 27 09:36:52.419635 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 27 09:36:52.419635 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 27 09:36:52.419635 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 27 09:36:52.419635 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 27 09:36:52.419635 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 27 09:36:52.419635 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 27 09:36:52.419635 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 27 09:36:52.419635 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application Oct 27 09:36:52.419635 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 475/940] 10.222.0.65 () {56 vars in 1096 bytes} [Thu Oct 27 09:36:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 09:36:52.425177 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6a5690-7fe7-42eb-a11b-25b9289b2f03 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:36:52.528176 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6a5690-7fe7-42eb-a11b-25b9289b2f03 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:36:52.562757 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a2fb03-4d4b-4f6b-8ece-ef74ea94fdb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:36:52.563352 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a2fb03-4d4b-4f6b-8ece-ef74ea94fdb8 None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:36:52.563631 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a2fb03-4d4b-4f6b-8ece-ef74ea94fdb8 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:36:52.563903 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a2fb03-4d4b-4f6b-8ece-ef74ea94fdb8 None admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:36:52.564557 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a2fb03-4d4b-4f6b-8ece-ef74ea94fdb8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 09:36:52.564857 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a2fb03-4d4b-4f6b-8ece-ef74ea94fdb8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:36:52.566336 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a2fb03-4d4b-4f6b-8ece-ef74ea94fdb8 None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:36:52.575250 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 466/941] 10.222.0.65 () {56 vars in 1099 bytes} [Thu Oct 27 09:36:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 09:36:52.581171 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab77f3f6-d126-4623-a837-da21e3819e3c None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:36:52.682128 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab77f3f6-d126-4623-a837-da21e3819e3c None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:36:52.717738 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4760c12d-beb1-441f-af64-abb5c0e4d0d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:36:52.718355 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4760c12d-beb1-441f-af64-abb5c0e4d0d5 None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:36:52.718666 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4760c12d-beb1-441f-af64-abb5c0e4d0d5 None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:36:52.718999 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4760c12d-beb1-441f-af64-abb5c0e4d0d5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:36:52.730719 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4760c12d-beb1-441f-af64-abb5c0e4d0d5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:36:52.732325 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4760c12d-beb1-441f-af64-abb5c0e4d0d5 None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:36:52.748550 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application [None req-4760c12d-beb1-441f-af64-abb5c0e4d0d5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 09:36:52.748550 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 09:36:52.748550 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 09:36:52.748550 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 09:36:52.748550 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 09:36:52.748550 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 09:36:52.748550 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 09:36:52.748550 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 09:36:52.748550 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 09:36:52.748550 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 09:36:52.748550 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 09:36:52.748550 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 09:36:52.748550 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 27 09:36:52.748550 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 27 09:36:52.748550 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 27 09:36:52.748550 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 27 09:36:52.750155 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 09:36:52.750155 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 09:36:52.750155 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 09:36:52.750155 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 09:36:52.750155 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 09:36:52.750155 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 09:36:52.750155 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 09:36:52.750155 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application with Lock( Oct 27 09:36:52.750155 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 09:36:52.750155 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._enter() Oct 27 09:36:52.750155 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 09:36:52.750155 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 09:36:52.750155 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 09:36:52.750155 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.creator() Oct 27 09:36:52.750155 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 09:36:52.750155 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application created_value = creator( Oct 27 09:36:52.750155 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 27 09:36:52.751275 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 27 09:36:52.751275 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 09:36:52.751275 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application Oct 27 09:36:52.751275 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 476/942] 10.222.0.65 () {56 vars in 1108 bytes} [Thu Oct 27 09:36:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 09:36:52.756072 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a2fb03-4d4b-4f6b-8ece-ef74ea94fdb8 None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:36:52.758964 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:36:52.862948 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a2fb03-4d4b-4f6b-8ece-ef74ea94fdb8 None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:36:52.902273 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd1ed25-93e4-4764-b124-58afb2a608eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:36:52.902967 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd1ed25-93e4-4764-b124-58afb2a608eb None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:36:52.903227 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd1ed25-93e4-4764-b124-58afb2a608eb None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:36:52.903502 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd1ed25-93e4-4764-b124-58afb2a608eb None admin] PATH_INFO: `/v3/domains` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:36:52.904147 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd1ed25-93e4-4764-b124-58afb2a608eb None admin] RBAC: Adding query filter params (name=Default) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 09:36:52.904453 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd1ed25-93e4-4764-b124-58afb2a608eb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:36:52.905826 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd1ed25-93e4-4764-b124-58afb2a608eb None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:36:52.918788 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 467/943] 10.222.0.65 () {56 vars in 1109 bytes} [Thu Oct 27 09:36:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 09:36:52.924453 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4760c12d-beb1-441f-af64-abb5c0e4d0d5 None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:36:52.968185 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:36:53.026250 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4760c12d-beb1-441f-af64-abb5c0e4d0d5 None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:36:53.060372 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075b718e-d9f5-4b93-bbda-b03e1b5c899b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:36:53.061002 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075b718e-d9f5-4b93-bbda-b03e1b5c899b None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:36:53.061285 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075b718e-d9f5-4b93-bbda-b03e1b5c899b None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:36:53.061560 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075b718e-d9f5-4b93-bbda-b03e1b5c899b None admin] PATH_INFO: `/v3/users/placement` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:36:53.069165 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075b718e-d9f5-4b93-bbda-b03e1b5c899b None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:36:53.070624 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075b718e-d9f5-4b93-bbda-b03e1b5c899b None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:36:53.081888 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application [None req-075b718e-d9f5-4b93-bbda-b03e1b5c899b None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 27 09:36:53.081888 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 09:36:53.081888 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 09:36:53.081888 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 09:36:53.081888 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 09:36:53.081888 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 09:36:53.081888 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 09:36:53.081888 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 09:36:53.081888 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 09:36:53.081888 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 09:36:53.081888 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 09:36:53.081888 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 09:36:53.081888 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 27 09:36:53.081888 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 27 09:36:53.081888 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 27 09:36:53.081888 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 27 09:36:53.083587 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 09:36:53.083587 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 09:36:53.083587 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 27 09:36:53.083587 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 27 09:36:53.083587 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 27 09:36:53.083587 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 27 09:36:53.083587 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 09:36:53.083587 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 09:36:53.083587 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 09:36:53.083587 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 09:36:53.083587 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 09:36:53.083587 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application with Lock( Oct 27 09:36:53.083587 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 09:36:53.083587 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._enter() Oct 27 09:36:53.083587 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 09:36:53.083587 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 09:36:53.083587 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 09:36:53.083587 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.creator() Oct 27 09:36:53.084527 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 09:36:53.084527 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application created_value = creator( Oct 27 09:36:53.084527 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 27 09:36:53.084527 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 27 09:36:53.084527 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 27 09:36:53.084527 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 27 09:36:53.084527 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 27 09:36:53.084527 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 27 09:36:53.084527 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 27 09:36:53.084527 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application Oct 27 09:36:53.084527 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 477/944] 10.222.0.65 () {56 vars in 1108 bytes} [Thu Oct 27 09:36:52 2022] GET /identity/v3/users/placement => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 09:36:53.089494 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd1ed25-93e4-4764-b124-58afb2a608eb None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:36:53.155275 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:36:53.194383 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd1ed25-93e4-4764-b124-58afb2a608eb None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:36:53.236780 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931df0cc-8a43-4e50-9c50-4d7ea12c5d84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:36:53.237391 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931df0cc-8a43-4e50-9c50-4d7ea12c5d84 None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:36:53.237665 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931df0cc-8a43-4e50-9c50-4d7ea12c5d84 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:36:53.237936 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931df0cc-8a43-4e50-9c50-4d7ea12c5d84 None admin] PATH_INFO: `/v3/users` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:36:53.238711 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931df0cc-8a43-4e50-9c50-4d7ea12c5d84 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 09:36:53.239016 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931df0cc-8a43-4e50-9c50-4d7ea12c5d84 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:36:53.240524 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931df0cc-8a43-4e50-9c50-4d7ea12c5d84 None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:36:53.258304 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 468/945] 10.222.0.65 () {56 vars in 1143 bytes} [Thu Oct 27 09:36:53 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 09:36:53.263768 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075b718e-d9f5-4b93-bbda-b03e1b5c899b None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:36:53.371394 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075b718e-d9f5-4b93-bbda-b03e1b5c899b None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:36:53.373002 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:36:53.407751 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5efe59-fc84-4965-990e-17120518a734 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:36:53.408297 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5efe59-fc84-4965-990e-17120518a734 None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:36:53.408579 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5efe59-fc84-4965-990e-17120518a734 None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:36:53.408855 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5efe59-fc84-4965-990e-17120518a734 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:36:53.421294 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5efe59-fc84-4965-990e-17120518a734 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:36:53.422834 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5efe59-fc84-4965-990e-17120518a734 None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:36:53.436865 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application [None req-1b5efe59-fc84-4965-990e-17120518a734 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 09:36:53.436865 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 09:36:53.436865 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 09:36:53.436865 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 09:36:53.436865 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 09:36:53.436865 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 09:36:53.436865 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 09:36:53.436865 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 09:36:53.436865 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 09:36:53.436865 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 09:36:53.436865 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 09:36:53.436865 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 09:36:53.436865 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 27 09:36:53.436865 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 27 09:36:53.436865 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 27 09:36:53.436865 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 27 09:36:53.438009 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 09:36:53.438009 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 09:36:53.438009 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 09:36:53.438009 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 09:36:53.438009 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 09:36:53.438009 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 09:36:53.438009 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 09:36:53.438009 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application with Lock( Oct 27 09:36:53.438009 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 09:36:53.438009 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._enter() Oct 27 09:36:53.438009 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 09:36:53.438009 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 09:36:53.438009 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 09:36:53.438009 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.creator() Oct 27 09:36:53.438009 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 09:36:53.438009 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application created_value = creator( Oct 27 09:36:53.438009 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 27 09:36:53.439137 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 27 09:36:53.439137 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 09:36:53.439137 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application Oct 27 09:36:53.439137 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 478/946] 10.222.0.65 () {56 vars in 1108 bytes} [Thu Oct 27 09:36:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 09:36:53.444209 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931df0cc-8a43-4e50-9c50-4d7ea12c5d84 None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:36:53.548258 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931df0cc-8a43-4e50-9c50-4d7ea12c5d84 None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:36:53.569831 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:36:53.584467 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f9ac83-3eb6-48d0-99a0-1afbc8677fec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:36:53.585083 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f9ac83-3eb6-48d0-99a0-1afbc8677fec None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:36:53.585490 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f9ac83-3eb6-48d0-99a0-1afbc8677fec None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:36:53.585723 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f9ac83-3eb6-48d0-99a0-1afbc8677fec None admin] PATH_INFO: `/v3/domains` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:36:53.586372 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f9ac83-3eb6-48d0-99a0-1afbc8677fec None admin] RBAC: Adding query filter params (name=Default) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 09:36:53.586724 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f9ac83-3eb6-48d0-99a0-1afbc8677fec None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:36:53.588125 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f9ac83-3eb6-48d0-99a0-1afbc8677fec None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:36:53.599897 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 469/947] 10.222.0.65 () {56 vars in 1109 bytes} [Thu Oct 27 09:36:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 09:36:53.606325 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5efe59-fc84-4965-990e-17120518a734 None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:36:53.714146 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5efe59-fc84-4965-990e-17120518a734 None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:36:53.749890 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd19bce-ee7b-4e84-9b09-c067a837222a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:36:53.750580 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd19bce-ee7b-4e84-9b09-c067a837222a None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:36:53.750994 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd19bce-ee7b-4e84-9b09-c067a837222a None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:36:53.751260 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd19bce-ee7b-4e84-9b09-c067a837222a None admin] PATH_INFO: `/v3/projects/service` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:36:53.759346 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd19bce-ee7b-4e84-9b09-c067a837222a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:36:53.760837 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd19bce-ee7b-4e84-9b09-c067a837222a None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:36:53.773832 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application [None req-3dd19bce-ee7b-4e84-9b09-c067a837222a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 27 09:36:53.773832 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 09:36:53.773832 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 09:36:53.773832 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 09:36:53.773832 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 09:36:53.773832 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 09:36:53.773832 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 09:36:53.773832 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 09:36:53.773832 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 09:36:53.773832 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 09:36:53.773832 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 09:36:53.773832 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 09:36:53.773832 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 27 09:36:53.773832 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 27 09:36:53.773832 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 27 09:36:53.774992 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 27 09:36:53.774992 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 09:36:53.774992 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 09:36:53.774992 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 09:36:53.774992 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 09:36:53.774992 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 09:36:53.774992 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 09:36:53.774992 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 09:36:53.774992 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application with Lock( Oct 27 09:36:53.774992 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 09:36:53.774992 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._enter() Oct 27 09:36:53.774992 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 09:36:53.774992 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 09:36:53.774992 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 09:36:53.774992 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.creator() Oct 27 09:36:53.774992 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 09:36:53.774992 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application created_value = creator( Oct 27 09:36:53.776080 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 27 09:36:53.776080 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 27 09:36:53.776080 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 27 09:36:53.776080 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 27 09:36:53.776080 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 27 09:36:53.776080 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 27 09:36:53.776080 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 27 09:36:53.776080 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application Oct 27 09:36:53.776080 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 479/948] 10.222.0.65 () {56 vars in 1111 bytes} [Thu Oct 27 09:36:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 09:36:53.784052 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f9ac83-3eb6-48d0-99a0-1afbc8677fec None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:36:53.893836 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f9ac83-3eb6-48d0-99a0-1afbc8677fec None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:36:53.929328 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90908d61-a0ac-4659-9307-3a4601f1db78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:36:53.929982 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90908d61-a0ac-4659-9307-3a4601f1db78 None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:36:53.930197 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90908d61-a0ac-4659-9307-3a4601f1db78 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:36:53.930470 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90908d61-a0ac-4659-9307-3a4601f1db78 None admin] PATH_INFO: `/v3/projects` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:36:53.931193 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90908d61-a0ac-4659-9307-3a4601f1db78 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 09:36:53.931496 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90908d61-a0ac-4659-9307-3a4601f1db78 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:36:53.932917 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90908d61-a0ac-4659-9307-3a4601f1db78 None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:36:53.946608 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 470/949] 10.222.0.65 () {56 vars in 1148 bytes} [Thu Oct 27 09:36:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 09:36:53.952670 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd19bce-ee7b-4e84-9b09-c067a837222a None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:36:53.969235 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:36:54.061992 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd19bce-ee7b-4e84-9b09-c067a837222a None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:36:54.097083 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679d65ca-8401-4cea-b7ad-d5747e54c60d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:36:54.097731 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679d65ca-8401-4cea-b7ad-d5747e54c60d None admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:36:54.098011 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679d65ca-8401-4cea-b7ad-d5747e54c60d None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:36:54.098288 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679d65ca-8401-4cea-b7ad-d5747e54c60d None admin] PATH_INFO: `/v3/projects/dc2e3a7a1bcc480891c0b433291c00b1/users/f8c47ff5d72943f6bab09b5df6198d64/roles/6ad17b9f9dea4b66ab2da3677d7e715d` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:36:54.100719 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679d65ca-8401-4cea-b7ad-d5747e54c60d None admin] RBAC: Authorizing `identity:create_grant(project_id=dc2e3a7a1bcc480891c0b433291c00b1, user_id=f8c47ff5d72943f6bab09b5df6198d64, role_id=6ad17b9f9dea4b66ab2da3677d7e715d)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:36:54.102416 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679d65ca-8401-4cea-b7ad-d5747e54c60d None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:36:54.236333 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 480/950] 10.222.0.65 () {58 vars in 1439 bytes} [Thu Oct 27 09:36:53 2022] PUT /identity/v3/projects/dc2e3a7a1bcc480891c0b433291c00b1/users/f8c47ff5d72943f6bab09b5df6198d64/roles/6ad17b9f9dea4b66ab2da3677d7e715d => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 09:36:56.588110 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8739146d-86f9-4ce4-8787-ce89732b65c6 None None] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:36:56.588650 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8739146d-86f9-4ce4-8787-ce89732b65c6 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:36:56.588650 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8739146d-86f9-4ce4-8787-ce89732b65c6 None None] PATH_INFO: `/` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:36:56.590015 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 471/951] 10.222.0.65 () {54 vars in 927 bytes} [Thu Oct 27 09:36:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 09:36:56.595336 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881dcb6a-14b2-4867-8652-3e9ecf1c9a75 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:36:56.595772 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881dcb6a-14b2-4867-8652-3e9ecf1c9a75 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:36:56.595922 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881dcb6a-14b2-4867-8652-3e9ecf1c9a75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:36:56.614810 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-881dcb6a-14b2-4867-8652-3e9ecf1c9a75 None None] MFA Rules not processed for user `b5065084bf664b99bdeac46067cb0f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:36:56.618567 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-881dcb6a-14b2-4867-8652-3e9ecf1c9a75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:36:56.684238 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 481/952] 10.222.0.65 () {58 vars in 1024 bytes} [Thu Oct 27 09:36:56 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 27 09:36:56.952242 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8739146d-86f9-4ce4-8787-ce89732b65c6 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:36:56.996633 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:36:57.058509 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8739146d-86f9-4ce4-8787-ce89732b65c6 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:36:57.094166 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1642b3-f273-4d93-b984-6437b3155b8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:36:57.094877 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1642b3-f273-4d93-b984-6437b3155b8b None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:36:57.095106 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1642b3-f273-4d93-b984-6437b3155b8b None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:36:57.095382 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1642b3-f273-4d93-b984-6437b3155b8b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:36:57.106158 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1642b3-f273-4d93-b984-6437b3155b8b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 09:36:57.111028 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application [None req-ac1642b3-f273-4d93-b984-6437b3155b8b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 27 09:36:57.111028 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 09:36:57.111028 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 09:36:57.111028 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 09:36:57.111028 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 09:36:57.111028 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 09:36:57.111028 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 09:36:57.111028 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 09:36:57.111028 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 09:36:57.111028 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 09:36:57.111028 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 09:36:57.111028 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 09:36:57.111028 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 27 09:36:57.111028 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 27 09:36:57.111028 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 27 09:36:57.111028 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 27 09:36:57.112107 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 27 09:36:57.112107 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 27 09:36:57.112107 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 27 09:36:57.112107 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 27 09:36:57.112107 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 09:36:57.112107 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 09:36:57.112107 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 09:36:57.112107 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 09:36:57.112107 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 09:36:57.112107 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 09:36:57.112107 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 09:36:57.112107 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application with Lock( Oct 27 09:36:57.112107 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 09:36:57.112107 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._enter() Oct 27 09:36:57.112107 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 09:36:57.112107 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 09:36:57.113028 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 09:36:57.113028 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.creator() Oct 27 09:36:57.113028 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 09:36:57.113028 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application created_value = creator( Oct 27 09:36:57.113028 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 27 09:36:57.113028 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 27 09:36:57.113028 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 27 09:36:57.113028 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 27 09:36:57.113028 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 27 09:36:57.113028 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 27 09:36:57.113028 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 27 09:36:57.113028 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application Oct 27 09:36:57.113028 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 472/953] 10.222.0.65 () {56 vars in 1096 bytes} [Thu Oct 27 09:36:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 09:36:57.118801 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881dcb6a-14b2-4867-8652-3e9ecf1c9a75 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:36:57.121916 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:36:57.220308 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881dcb6a-14b2-4867-8652-3e9ecf1c9a75 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:36:57.259211 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea648d0c-7ab2-4a4f-be7c-f98561dc2517 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:36:57.259814 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea648d0c-7ab2-4a4f-be7c-f98561dc2517 None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:36:57.260094 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea648d0c-7ab2-4a4f-be7c-f98561dc2517 None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:36:57.260363 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea648d0c-7ab2-4a4f-be7c-f98561dc2517 None admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:36:57.261017 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea648d0c-7ab2-4a4f-be7c-f98561dc2517 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 09:36:57.261319 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea648d0c-7ab2-4a4f-be7c-f98561dc2517 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:36:57.262763 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea648d0c-7ab2-4a4f-be7c-f98561dc2517 None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:36:57.270931 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 482/954] 10.222.0.65 () {56 vars in 1099 bytes} [Thu Oct 27 09:36:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 09:36:57.276735 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1642b3-f273-4d93-b984-6437b3155b8b None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:36:57.376918 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:36:57.380015 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1642b3-f273-4d93-b984-6437b3155b8b None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:36:57.415101 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c12ec1-2f41-40a1-8f5e-e82510395c66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:36:57.415736 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c12ec1-2f41-40a1-8f5e-e82510395c66 None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:36:57.416019 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c12ec1-2f41-40a1-8f5e-e82510395c66 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:36:57.416296 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c12ec1-2f41-40a1-8f5e-e82510395c66 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:36:57.428606 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c12ec1-2f41-40a1-8f5e-e82510395c66 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:36:57.430049 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c12ec1-2f41-40a1-8f5e-e82510395c66 None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:36:57.445573 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application [None req-c9c12ec1-2f41-40a1-8f5e-e82510395c66 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 09:36:57.445573 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 09:36:57.445573 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 09:36:57.445573 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 09:36:57.445573 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 09:36:57.445573 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 09:36:57.445573 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 09:36:57.445573 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 09:36:57.445573 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 09:36:57.445573 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 09:36:57.445573 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 09:36:57.445573 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 09:36:57.445573 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 27 09:36:57.445573 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 27 09:36:57.445573 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 27 09:36:57.445573 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 27 09:36:57.446738 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 09:36:57.446738 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 09:36:57.446738 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 09:36:57.446738 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 09:36:57.446738 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 09:36:57.446738 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 09:36:57.446738 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 09:36:57.446738 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application with Lock( Oct 27 09:36:57.446738 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 09:36:57.446738 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._enter() Oct 27 09:36:57.446738 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 09:36:57.446738 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 09:36:57.446738 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 09:36:57.446738 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.creator() Oct 27 09:36:57.446738 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 09:36:57.446738 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application created_value = creator( Oct 27 09:36:57.446738 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 27 09:36:57.447744 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 27 09:36:57.447744 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 09:36:57.447744 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application Oct 27 09:36:57.447744 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 473/955] 10.222.0.65 () {56 vars in 1108 bytes} [Thu Oct 27 09:36:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 09:36:57.453014 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea648d0c-7ab2-4a4f-be7c-f98561dc2517 None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:36:57.518457 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:36:57.553718 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea648d0c-7ab2-4a4f-be7c-f98561dc2517 None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:36:57.587510 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35b83b1-a3c8-4383-bd04-8b6a20b3cd25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:36:57.588114 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35b83b1-a3c8-4383-bd04-8b6a20b3cd25 None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:36:57.588399 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35b83b1-a3c8-4383-bd04-8b6a20b3cd25 None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:36:57.588674 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35b83b1-a3c8-4383-bd04-8b6a20b3cd25 None admin] PATH_INFO: `/v3/domains` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:36:57.589316 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35b83b1-a3c8-4383-bd04-8b6a20b3cd25 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 09:36:57.589622 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35b83b1-a3c8-4383-bd04-8b6a20b3cd25 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:36:57.591055 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35b83b1-a3c8-4383-bd04-8b6a20b3cd25 None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:36:57.603845 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 483/956] 10.222.0.65 () {56 vars in 1109 bytes} [Thu Oct 27 09:36:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 09:36:57.609984 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c12ec1-2f41-40a1-8f5e-e82510395c66 None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:36:57.710383 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c12ec1-2f41-40a1-8f5e-e82510395c66 None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:36:57.745249 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef34a611-dcbf-4ba8-ae64-7181cbd8b029 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:36:57.745880 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef34a611-dcbf-4ba8-ae64-7181cbd8b029 None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:36:57.746163 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef34a611-dcbf-4ba8-ae64-7181cbd8b029 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:36:57.746441 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef34a611-dcbf-4ba8-ae64-7181cbd8b029 None admin] PATH_INFO: `/v3/users/placement` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:36:57.754180 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef34a611-dcbf-4ba8-ae64-7181cbd8b029 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:36:57.755694 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef34a611-dcbf-4ba8-ae64-7181cbd8b029 None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:36:57.766749 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application [None req-ef34a611-dcbf-4ba8-ae64-7181cbd8b029 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 27 09:36:57.766749 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 09:36:57.766749 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 09:36:57.766749 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 09:36:57.766749 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 09:36:57.766749 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 09:36:57.766749 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 09:36:57.766749 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 09:36:57.766749 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 09:36:57.766749 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 09:36:57.766749 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 09:36:57.766749 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 09:36:57.766749 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 27 09:36:57.766749 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 27 09:36:57.766749 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 27 09:36:57.766749 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 27 09:36:57.767878 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 09:36:57.767878 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 09:36:57.767878 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 27 09:36:57.767878 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 27 09:36:57.767878 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 27 09:36:57.767878 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 27 09:36:57.767878 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 09:36:57.767878 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 09:36:57.767878 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 09:36:57.767878 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 09:36:57.767878 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 09:36:57.767878 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application with Lock( Oct 27 09:36:57.767878 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 09:36:57.767878 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._enter() Oct 27 09:36:57.767878 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 09:36:57.767878 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 09:36:57.767878 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 09:36:57.767878 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.creator() Oct 27 09:36:57.769054 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 09:36:57.769054 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application created_value = creator( Oct 27 09:36:57.769054 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 27 09:36:57.769054 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 27 09:36:57.769054 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 27 09:36:57.769054 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 27 09:36:57.769054 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 27 09:36:57.769054 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 27 09:36:57.769054 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 27 09:36:57.769054 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application Oct 27 09:36:57.770726 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 474/957] 10.222.0.65 () {56 vars in 1108 bytes} [Thu Oct 27 09:36:57 2022] GET /identity/v3/users/placement => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 09:36:57.774957 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35b83b1-a3c8-4383-bd04-8b6a20b3cd25 None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:36:57.877761 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35b83b1-a3c8-4383-bd04-8b6a20b3cd25 None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:36:57.904032 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:36:57.913527 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657f57a2-6d3b-4ead-9582-de2ca3640f9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:36:57.914156 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657f57a2-6d3b-4ead-9582-de2ca3640f9c None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:36:57.914434 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657f57a2-6d3b-4ead-9582-de2ca3640f9c None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:36:57.914738 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657f57a2-6d3b-4ead-9582-de2ca3640f9c None admin] PATH_INFO: `/v3/users` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:36:57.915473 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657f57a2-6d3b-4ead-9582-de2ca3640f9c None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 09:36:57.915776 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657f57a2-6d3b-4ead-9582-de2ca3640f9c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:36:57.917230 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657f57a2-6d3b-4ead-9582-de2ca3640f9c None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:36:57.934928 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 484/958] 10.222.0.65 () {56 vars in 1143 bytes} [Thu Oct 27 09:36:57 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 09:36:57.940773 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef34a611-dcbf-4ba8-ae64-7181cbd8b029 None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:36:57.956396 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:36:58.041048 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef34a611-dcbf-4ba8-ae64-7181cbd8b029 None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:36:58.075424 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba54936b-c171-436f-836f-d1a972f4cc75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:36:58.076027 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba54936b-c171-436f-836f-d1a972f4cc75 None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:36:58.076311 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba54936b-c171-436f-836f-d1a972f4cc75 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:36:58.076587 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba54936b-c171-436f-836f-d1a972f4cc75 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:36:58.144330 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba54936b-c171-436f-836f-d1a972f4cc75 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:36:58.146450 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba54936b-c171-436f-836f-d1a972f4cc75 None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:36:58.160038 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:36:58.244801 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 475/959] 10.222.0.65 () {58 vars in 1282 bytes} [Thu Oct 27 09:36:57 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 27 09:36:58.250615 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657f57a2-6d3b-4ead-9582-de2ca3640f9c None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:36:58.353067 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657f57a2-6d3b-4ead-9582-de2ca3640f9c None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:36:58.390526 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bf10bd-55ad-4d0b-8f6d-cd77f12d36b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:36:58.391180 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bf10bd-55ad-4d0b-8f6d-cd77f12d36b7 None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:36:58.391461 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bf10bd-55ad-4d0b-8f6d-cd77f12d36b7 None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:36:58.391735 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bf10bd-55ad-4d0b-8f6d-cd77f12d36b7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:36:58.402975 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8bf10bd-55ad-4d0b-8f6d-cd77f12d36b7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:36:58.404469 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8bf10bd-55ad-4d0b-8f6d-cd77f12d36b7 None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:36:58.419947 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application [None req-a8bf10bd-55ad-4d0b-8f6d-cd77f12d36b7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 09:36:58.419947 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 09:36:58.419947 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 09:36:58.419947 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 09:36:58.419947 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 09:36:58.419947 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 09:36:58.419947 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 09:36:58.419947 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 09:36:58.419947 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 09:36:58.419947 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 09:36:58.419947 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 09:36:58.419947 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 09:36:58.419947 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 27 09:36:58.419947 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 27 09:36:58.419947 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 27 09:36:58.419947 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 27 09:36:58.421121 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 09:36:58.421121 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 09:36:58.421121 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 09:36:58.421121 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 09:36:58.421121 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 09:36:58.421121 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 09:36:58.421121 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 09:36:58.421121 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application with Lock( Oct 27 09:36:58.421121 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 09:36:58.421121 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._enter() Oct 27 09:36:58.421121 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 09:36:58.421121 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 09:36:58.421121 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 09:36:58.421121 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.creator() Oct 27 09:36:58.421121 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 09:36:58.421121 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application created_value = creator( Oct 27 09:36:58.421121 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 27 09:36:58.422315 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 27 09:36:58.422315 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 09:36:58.422315 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application Oct 27 09:36:58.422315 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 485/960] 10.222.0.65 () {56 vars in 1108 bytes} [Thu Oct 27 09:36:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 09:36:58.427363 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba54936b-c171-436f-836f-d1a972f4cc75 None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:36:58.526348 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba54936b-c171-436f-836f-d1a972f4cc75 None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:36:58.546196 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:36:58.567793 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec1de41-80d7-4d46-9d6f-58adb3e7bd29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:36:58.568509 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec1de41-80d7-4d46-9d6f-58adb3e7bd29 None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:36:58.568798 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec1de41-80d7-4d46-9d6f-58adb3e7bd29 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:36:58.569071 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec1de41-80d7-4d46-9d6f-58adb3e7bd29 None admin] PATH_INFO: `/v3/domains` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:36:58.569716 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec1de41-80d7-4d46-9d6f-58adb3e7bd29 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 09:36:58.570024 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec1de41-80d7-4d46-9d6f-58adb3e7bd29 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:36:58.571467 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec1de41-80d7-4d46-9d6f-58adb3e7bd29 None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:36:58.583380 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 476/961] 10.222.0.65 () {56 vars in 1109 bytes} [Thu Oct 27 09:36:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 09:36:58.589344 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bf10bd-55ad-4d0b-8f6d-cd77f12d36b7 None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:36:58.625607 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:36:58.689502 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bf10bd-55ad-4d0b-8f6d-cd77f12d36b7 None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:36:58.722919 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d867d3c-a2e1-483a-b742-2af381abf04b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:36:58.724152 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d867d3c-a2e1-483a-b742-2af381abf04b None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:36:58.724432 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d867d3c-a2e1-483a-b742-2af381abf04b None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:36:58.724703 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d867d3c-a2e1-483a-b742-2af381abf04b None admin] PATH_INFO: `/v3/projects/service` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:36:58.731417 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d867d3c-a2e1-483a-b742-2af381abf04b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:36:58.732857 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d867d3c-a2e1-483a-b742-2af381abf04b None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:36:58.743958 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application [None req-9d867d3c-a2e1-483a-b742-2af381abf04b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 27 09:36:58.743958 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 09:36:58.743958 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 09:36:58.743958 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 09:36:58.743958 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 09:36:58.743958 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 09:36:58.743958 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 09:36:58.743958 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 09:36:58.743958 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 09:36:58.743958 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 09:36:58.743958 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 09:36:58.743958 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 09:36:58.743958 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 27 09:36:58.743958 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 27 09:36:58.743958 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 27 09:36:58.744973 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 27 09:36:58.744973 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 09:36:58.744973 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 09:36:58.744973 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 09:36:58.744973 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 09:36:58.744973 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 09:36:58.744973 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 09:36:58.744973 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 09:36:58.744973 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application with Lock( Oct 27 09:36:58.744973 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 09:36:58.744973 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._enter() Oct 27 09:36:58.744973 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 09:36:58.744973 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 09:36:58.744973 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 09:36:58.744973 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.creator() Oct 27 09:36:58.744973 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 09:36:58.744973 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application created_value = creator( Oct 27 09:36:58.745967 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 27 09:36:58.745967 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 27 09:36:58.745967 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 27 09:36:58.745967 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 27 09:36:58.745967 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 27 09:36:58.745967 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 27 09:36:58.745967 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 27 09:36:58.745967 dv-cinder-797970-7-smb devstack@keystone.service[88311]: ERROR keystone.server.flask.application Oct 27 09:36:58.745967 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 486/962] 10.222.0.65 () {56 vars in 1111 bytes} [Thu Oct 27 09:36:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 09:36:58.750979 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec1de41-80d7-4d46-9d6f-58adb3e7bd29 None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:36:58.854848 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec1de41-80d7-4d46-9d6f-58adb3e7bd29 None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:36:58.888049 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ac7091-305f-4a88-abc7-f4cff63a3dcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:36:58.888577 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ac7091-305f-4a88-abc7-f4cff63a3dcb None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:36:58.888855 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ac7091-305f-4a88-abc7-f4cff63a3dcb None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:36:58.889126 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ac7091-305f-4a88-abc7-f4cff63a3dcb None admin] PATH_INFO: `/v3/projects` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:36:58.889804 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ac7091-305f-4a88-abc7-f4cff63a3dcb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 09:36:58.890105 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ac7091-305f-4a88-abc7-f4cff63a3dcb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:36:58.891559 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ac7091-305f-4a88-abc7-f4cff63a3dcb None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:36:58.903687 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 477/963] 10.222.0.65 () {56 vars in 1148 bytes} [Thu Oct 27 09:36:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 09:36:58.909965 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d867d3c-a2e1-483a-b742-2af381abf04b None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:36:59.003511 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:36:59.009971 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d867d3c-a2e1-483a-b742-2af381abf04b None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:36:59.044227 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bc7959-ed62-4af2-9a09-fd8084d325c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:36:59.044849 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bc7959-ed62-4af2-9a09-fd8084d325c3 None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:36:59.045117 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bc7959-ed62-4af2-9a09-fd8084d325c3 None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:36:59.045391 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bc7959-ed62-4af2-9a09-fd8084d325c3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:36:59.046126 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02bc7959-ed62-4af2-9a09-fd8084d325c3 None admin] RBAC: Adding query filter params (role.id=6ad17b9f9dea4b66ab2da3677d7e715d, scope.project.id=dc2e3a7a1bcc480891c0b433291c00b1, user.id=f8c47ff5d72943f6bab09b5df6198d64) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 09:36:59.046434 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02bc7959-ed62-4af2-9a09-fd8084d325c3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:36:59.047924 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02bc7959-ed62-4af2-9a09-fd8084d325c3 None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:36:59.054684 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 487/964] 10.222.0.65 () {56 vars in 1374 bytes} [Thu Oct 27 09:36:58 2022] GET /identity/v3/role_assignments?user.id=f8c47ff5d72943f6bab09b5df6198d64&scope.project.id=dc2e3a7a1bcc480891c0b433291c00b1&role.id=6ad17b9f9dea4b66ab2da3677d7e715d => generated 608 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 09:37:01.234285 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f76db09-b41f-42b6-839d-97bcb1aa8406 None None] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:37:01.234850 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f76db09-b41f-42b6-839d-97bcb1aa8406 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:37:01.234850 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f76db09-b41f-42b6-839d-97bcb1aa8406 None None] PATH_INFO: `/` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:37:01.236216 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 478/965] 10.222.0.65 () {54 vars in 927 bytes} [Thu Oct 27 09:37:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 09:37:01.241954 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da8e2c8-10eb-46a8-9b81-10d0ec65d6d3 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:37:01.242371 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da8e2c8-10eb-46a8-9b81-10d0ec65d6d3 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:37:01.242505 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da8e2c8-10eb-46a8-9b81-10d0ec65d6d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:37:01.261028 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-8da8e2c8-10eb-46a8-9b81-10d0ec65d6d3 None None] MFA Rules not processed for user `b5065084bf664b99bdeac46067cb0f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:37:01.262225 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-8da8e2c8-10eb-46a8-9b81-10d0ec65d6d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:37:01.327489 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 488/966] 10.222.0.65 () {58 vars in 1024 bytes} [Thu Oct 27 09:37:01 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 27 09:37:01.595842 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f76db09-b41f-42b6-839d-97bcb1aa8406 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:37:01.629302 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:37:01.701980 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f76db09-b41f-42b6-839d-97bcb1aa8406 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:37:01.737017 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029ba1c7-3c9d-43ae-84a0-036c22bc98ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:37:01.737635 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029ba1c7-3c9d-43ae-84a0-036c22bc98ab None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:37:01.737919 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029ba1c7-3c9d-43ae-84a0-036c22bc98ab None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:37:01.738197 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029ba1c7-3c9d-43ae-84a0-036c22bc98ab None admin] PATH_INFO: `/v3/services/placement` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:37:01.738835 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029ba1c7-3c9d-43ae-84a0-036c22bc98ab None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:37:01.740209 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029ba1c7-3c9d-43ae-84a0-036c22bc98ab None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:37:01.750056 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application [None req-029ba1c7-3c9d-43ae-84a0-036c22bc98ab None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Oct 27 09:37:01.750056 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 09:37:01.750056 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 27 09:37:01.750056 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 27 09:37:01.750056 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 27 09:37:01.750056 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 27 09:37:01.750056 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 27 09:37:01.750056 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 27 09:37:01.750056 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 27 09:37:01.750056 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application Oct 27 09:37:01.750056 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 27 09:37:01.750056 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application Oct 27 09:37:01.750056 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 09:37:01.750056 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 09:37:01.750056 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 09:37:01.750056 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 09:37:01.750056 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 09:37:01.755079 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 09:37:01.755079 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 09:37:01.755079 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 09:37:01.755079 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 09:37:01.755079 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 09:37:01.755079 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 09:37:01.755079 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 27 09:37:01.755079 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 27 09:37:01.755079 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 27 09:37:01.755079 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 27 09:37:01.755079 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 09:37:01.755079 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 09:37:01.755079 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 09:37:01.755079 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 09:37:01.755079 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 09:37:01.755079 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 09:37:01.756249 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 09:37:01.756249 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application with Lock( Oct 27 09:37:01.756249 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 09:37:01.756249 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._enter() Oct 27 09:37:01.756249 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 09:37:01.756249 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 09:37:01.756249 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 09:37:01.756249 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.creator() Oct 27 09:37:01.756249 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 09:37:01.756249 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application created_value = creator( Oct 27 09:37:01.756249 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 27 09:37:01.756249 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 27 09:37:01.756249 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 27 09:37:01.756249 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application Oct 27 09:37:01.756249 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 479/967] 10.222.0.65 () {56 vars in 1117 bytes} [Thu Oct 27 09:37:01 2022] GET /identity/v3/services/placement => generated 90 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 09:37:01.758185 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da8e2c8-10eb-46a8-9b81-10d0ec65d6d3 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:37:01.849252 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:37:01.859511 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da8e2c8-10eb-46a8-9b81-10d0ec65d6d3 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:37:01.892686 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a375d29-24ae-4691-86b9-80c591253b58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:37:01.893289 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a375d29-24ae-4691-86b9-80c591253b58 None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:37:01.893569 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a375d29-24ae-4691-86b9-80c591253b58 None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:37:01.893842 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a375d29-24ae-4691-86b9-80c591253b58 None admin] PATH_INFO: `/v3/services` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:37:01.894460 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a375d29-24ae-4691-86b9-80c591253b58 None admin] RBAC: Adding query filter params (name=placement) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 09:37:01.895410 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a375d29-24ae-4691-86b9-80c591253b58 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:37:01.897257 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a375d29-24ae-4691-86b9-80c591253b58 None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:37:01.902902 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 489/968] 10.222.0.65 () {56 vars in 1116 bytes} [Thu Oct 27 09:37:01 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 09:37:01.908991 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029ba1c7-3c9d-43ae-84a0-036c22bc98ab None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:37:02.006284 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:37:02.012392 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029ba1c7-3c9d-43ae-84a0-036c22bc98ab None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:37:02.048757 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1352267-0d73-47e8-850f-455aca79302e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:37:02.049363 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1352267-0d73-47e8-850f-455aca79302e None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:37:02.049649 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1352267-0d73-47e8-850f-455aca79302e None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:37:02.049925 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1352267-0d73-47e8-850f-455aca79302e None admin] PATH_INFO: `/v3/services` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:37:02.050629 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1352267-0d73-47e8-850f-455aca79302e None admin] RBAC: Adding query filter params (type=placement) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 09:37:02.050946 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1352267-0d73-47e8-850f-455aca79302e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:37:02.052310 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1352267-0d73-47e8-850f-455aca79302e None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:37:02.056680 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 480/969] 10.222.0.65 () {56 vars in 1116 bytes} [Thu Oct 27 09:37:01 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 09:37:04.251207 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64f0d0f-027d-4957-a010-03674392a506 None None] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:37:04.251856 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64f0d0f-027d-4957-a010-03674392a506 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:37:04.251856 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64f0d0f-027d-4957-a010-03674392a506 None None] PATH_INFO: `/` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:37:04.253091 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 490/970] 10.222.0.65 () {54 vars in 927 bytes} [Thu Oct 27 09:37:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 09:37:04.259211 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7187e211-9b1e-4063-8004-c56ea9250c4f None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:37:04.259732 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7187e211-9b1e-4063-8004-c56ea9250c4f None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:37:04.259831 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7187e211-9b1e-4063-8004-c56ea9250c4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:37:04.278845 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-7187e211-9b1e-4063-8004-c56ea9250c4f None None] MFA Rules not processed for user `b5065084bf664b99bdeac46067cb0f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:37:04.280068 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-7187e211-9b1e-4063-8004-c56ea9250c4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:37:04.349100 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 481/971] 10.222.0.65 () {58 vars in 1024 bytes} [Thu Oct 27 09:37:04 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 27 09:37:04.626459 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64f0d0f-027d-4957-a010-03674392a506 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:37:04.732837 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64f0d0f-027d-4957-a010-03674392a506 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:37:04.768539 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c115b9-7216-4b75-a109-fe0189b8bdf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:37:04.769128 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c115b9-7216-4b75-a109-fe0189b8bdf9 None admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:37:04.769402 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c115b9-7216-4b75-a109-fe0189b8bdf9 None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:37:04.769711 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c115b9-7216-4b75-a109-fe0189b8bdf9 None admin] PATH_INFO: `/v3/services` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:37:04.770350 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c115b9-7216-4b75-a109-fe0189b8bdf9 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:37:04.771834 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c115b9-7216-4b75-a109-fe0189b8bdf9 None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:37:04.944713 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 491/972] 10.222.0.65 () {60 vars in 1141 bytes} [Thu Oct 27 09:37:04 2022] POST /identity/v3/services => generated 246 bytes in 319 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 09:37:07.159370 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5d04f1-156e-4546-9e2e-44f22701665f None None] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:37:07.159944 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5d04f1-156e-4546-9e2e-44f22701665f None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:37:07.159944 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5d04f1-156e-4546-9e2e-44f22701665f None None] PATH_INFO: `/` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:37:07.161271 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 482/973] 10.222.0.65 () {54 vars in 927 bytes} [Thu Oct 27 09:37:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 27 09:37:07.167593 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b7bb8a-b3fd-4037-87eb-d00c1aba98e9 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:37:07.167988 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b7bb8a-b3fd-4037-87eb-d00c1aba98e9 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:37:07.168148 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b7bb8a-b3fd-4037-87eb-d00c1aba98e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:37:07.186766 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-20b7bb8a-b3fd-4037-87eb-d00c1aba98e9 None None] MFA Rules not processed for user `b5065084bf664b99bdeac46067cb0f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:37:07.187969 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-20b7bb8a-b3fd-4037-87eb-d00c1aba98e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:37:07.197347 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:37:07.261179 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 492/974] 10.222.0.65 () {58 vars in 1024 bytes} [Thu Oct 27 09:37:07 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 27 09:37:07.534744 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5d04f1-156e-4546-9e2e-44f22701665f None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:37:07.631749 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:37:07.642163 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5d04f1-156e-4546-9e2e-44f22701665f None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:37:07.676568 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac449f6-ebd7-4318-a914-175314556b49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:37:07.677186 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac449f6-ebd7-4318-a914-175314556b49 None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:37:07.677462 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac449f6-ebd7-4318-a914-175314556b49 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:37:07.677732 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac449f6-ebd7-4318-a914-175314556b49 None admin] PATH_INFO: `/v3/services/placement` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:37:07.678301 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac449f6-ebd7-4318-a914-175314556b49 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:37:07.679692 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac449f6-ebd7-4318-a914-175314556b49 None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:37:07.688124 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application [None req-eac449f6-ebd7-4318-a914-175314556b49 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Oct 27 09:37:07.688124 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 09:37:07.688124 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 27 09:37:07.688124 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 27 09:37:07.688124 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 27 09:37:07.688124 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 27 09:37:07.688124 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 27 09:37:07.688124 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 27 09:37:07.688124 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 27 09:37:07.688124 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application Oct 27 09:37:07.688124 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 27 09:37:07.688124 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application Oct 27 09:37:07.688124 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 09:37:07.688124 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 09:37:07.688124 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 09:37:07.688124 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 09:37:07.688124 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 09:37:07.689373 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 09:37:07.689373 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 09:37:07.689373 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 09:37:07.689373 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 09:37:07.689373 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 09:37:07.689373 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 09:37:07.689373 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 27 09:37:07.689373 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 27 09:37:07.689373 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 27 09:37:07.689373 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 27 09:37:07.689373 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 09:37:07.689373 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 09:37:07.689373 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 09:37:07.689373 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 09:37:07.689373 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 09:37:07.689373 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 09:37:07.690723 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 09:37:07.690723 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application with Lock( Oct 27 09:37:07.690723 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 09:37:07.690723 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._enter() Oct 27 09:37:07.690723 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 09:37:07.690723 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 09:37:07.690723 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 09:37:07.690723 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.creator() Oct 27 09:37:07.690723 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 09:37:07.690723 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application created_value = creator( Oct 27 09:37:07.690723 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 27 09:37:07.690723 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 27 09:37:07.690723 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 27 09:37:07.690723 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application Oct 27 09:37:07.690723 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 483/975] 10.222.0.65 () {56 vars in 1117 bytes} [Thu Oct 27 09:37:07 2022] GET /identity/v3/services/placement => generated 90 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 09:37:07.695957 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b7bb8a-b3fd-4037-87eb-d00c1aba98e9 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:37:07.803883 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b7bb8a-b3fd-4037-87eb-d00c1aba98e9 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:37:07.842810 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b759ae6-7a64-428c-b92a-2caf747a1a2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:37:07.843424 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b759ae6-7a64-428c-b92a-2caf747a1a2b None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:37:07.843707 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b759ae6-7a64-428c-b92a-2caf747a1a2b None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:37:07.843981 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b759ae6-7a64-428c-b92a-2caf747a1a2b None admin] PATH_INFO: `/v3/services` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:37:07.844612 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b759ae6-7a64-428c-b92a-2caf747a1a2b None admin] RBAC: Adding query filter params (name=placement) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 09:37:07.844918 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b759ae6-7a64-428c-b92a-2caf747a1a2b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:37:07.846360 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b759ae6-7a64-428c-b92a-2caf747a1a2b None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:37:07.852291 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 493/976] 10.222.0.65 () {56 vars in 1116 bytes} [Thu Oct 27 09:37:07 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 09:37:07.858288 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac449f6-ebd7-4318-a914-175314556b49 None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:37:07.966135 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac449f6-ebd7-4318-a914-175314556b49 None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:37:08.001162 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0107a9f4-1857-46ab-806f-6eed0e72c0c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:37:08.001767 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0107a9f4-1857-46ab-806f-6eed0e72c0c0 None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:37:08.002052 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0107a9f4-1857-46ab-806f-6eed0e72c0c0 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:37:08.002329 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0107a9f4-1857-46ab-806f-6eed0e72c0c0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:37:08.003058 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0107a9f4-1857-46ab-806f-6eed0e72c0c0 None admin] RBAC: Adding query filter params (interface=public, service_id=21705ce8ce1641d7bace79ddf347e087, region_id=RegionOne) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 09:37:08.003371 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0107a9f4-1857-46ab-806f-6eed0e72c0c0 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:37:08.005636 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0107a9f4-1857-46ab-806f-6eed0e72c0c0 None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:37:08.014183 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 484/977] 10.222.0.65 () {56 vars in 1251 bytes} [Thu Oct 27 09:37:07 2022] GET /identity/v3/endpoints?service_id=21705ce8ce1641d7bace79ddf347e087&interface=public®ion_id=RegionOne => generated 194 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 09:37:08.020073 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b759ae6-7a64-428c-b92a-2caf747a1a2b None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:37:08.021138 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:37:08.118226 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b759ae6-7a64-428c-b92a-2caf747a1a2b None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:37:08.152840 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c181d4d9-d919-4bed-ad04-b10ce3d41274 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:37:08.153483 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c181d4d9-d919-4bed-ad04-b10ce3d41274 None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:37:08.153766 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c181d4d9-d919-4bed-ad04-b10ce3d41274 None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:37:08.154040 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c181d4d9-d919-4bed-ad04-b10ce3d41274 None admin] PATH_INFO: `/v3/services` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:37:08.154666 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c181d4d9-d919-4bed-ad04-b10ce3d41274 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:37:08.156031 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c181d4d9-d919-4bed-ad04-b10ce3d41274 None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:37:08.163170 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 494/978] 10.222.0.65 () {56 vars in 1087 bytes} [Thu Oct 27 09:37:08 2022] GET /identity/v3/services => generated 2191 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 09:37:10.426403 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0488c4-dca1-41b6-a626-8037b23f20f1 None None] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:37:10.426994 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0488c4-dca1-41b6-a626-8037b23f20f1 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:37:10.426994 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0488c4-dca1-41b6-a626-8037b23f20f1 None None] PATH_INFO: `/` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:37:10.428344 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 485/979] 10.222.0.65 () {54 vars in 927 bytes} [Thu Oct 27 09:37:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 09:37:10.433824 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a177ba9-d33a-4638-896b-0ba0a3261036 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:37:10.434234 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a177ba9-d33a-4638-896b-0ba0a3261036 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:37:10.434372 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a177ba9-d33a-4638-896b-0ba0a3261036 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:37:10.453137 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-5a177ba9-d33a-4638-896b-0ba0a3261036 None None] MFA Rules not processed for user `b5065084bf664b99bdeac46067cb0f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:37:10.457858 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-5a177ba9-d33a-4638-896b-0ba0a3261036 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:37:10.517582 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:37:10.523778 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 495/980] 10.222.0.65 () {58 vars in 1024 bytes} [Thu Oct 27 09:37:10 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 27 09:37:10.799969 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0488c4-dca1-41b6-a626-8037b23f20f1 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:37:10.820600 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:37:10.904049 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0488c4-dca1-41b6-a626-8037b23f20f1 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:37:10.936652 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507c67f6-f911-4d20-895b-a9c79c623db1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:37:10.937274 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507c67f6-f911-4d20-895b-a9c79c623db1 None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:37:10.937560 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507c67f6-f911-4d20-895b-a9c79c623db1 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:37:10.937849 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507c67f6-f911-4d20-895b-a9c79c623db1 None admin] PATH_INFO: `/v3/services/placement` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:37:10.938409 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507c67f6-f911-4d20-895b-a9c79c623db1 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:37:10.939804 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507c67f6-f911-4d20-895b-a9c79c623db1 None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:37:10.950305 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application [None req-507c67f6-f911-4d20-895b-a9c79c623db1 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Oct 27 09:37:10.950305 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 09:37:10.950305 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 27 09:37:10.950305 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 27 09:37:10.950305 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 27 09:37:10.950305 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 27 09:37:10.950305 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 27 09:37:10.950305 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 27 09:37:10.950305 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 27 09:37:10.950305 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application Oct 27 09:37:10.950305 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 27 09:37:10.950305 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application Oct 27 09:37:10.950305 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 27 09:37:10.950305 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 27 09:37:10.950305 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 27 09:37:10.950305 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 27 09:37:10.950305 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 27 09:37:10.951580 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 27 09:37:10.951580 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 27 09:37:10.951580 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 27 09:37:10.951580 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 27 09:37:10.951580 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 27 09:37:10.951580 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 27 09:37:10.951580 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 27 09:37:10.951580 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 27 09:37:10.951580 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 27 09:37:10.951580 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 27 09:37:10.951580 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 27 09:37:10.951580 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 27 09:37:10.951580 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 27 09:37:10.951580 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 27 09:37:10.951580 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 27 09:37:10.951580 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.get_or_create( Oct 27 09:37:10.952578 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 27 09:37:10.952578 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application with Lock( Oct 27 09:37:10.952578 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 27 09:37:10.952578 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._enter() Oct 27 09:37:10.952578 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 27 09:37:10.952578 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 27 09:37:10.952578 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 27 09:37:10.952578 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.creator() Oct 27 09:37:10.952578 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 27 09:37:10.952578 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application created_value = creator( Oct 27 09:37:10.952578 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 27 09:37:10.952578 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 27 09:37:10.952578 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 27 09:37:10.952578 dv-cinder-797970-7-smb devstack@keystone.service[88312]: ERROR keystone.server.flask.application Oct 27 09:37:10.952578 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 486/981] 10.222.0.65 () {56 vars in 1117 bytes} [Thu Oct 27 09:37:10 2022] GET /identity/v3/services/placement => generated 90 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 09:37:10.958193 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a177ba9-d33a-4638-896b-0ba0a3261036 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:37:11.056318 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a177ba9-d33a-4638-896b-0ba0a3261036 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:37:11.091330 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c50d49b-d398-41be-a9f8-764f39261dce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:37:11.091940 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c50d49b-d398-41be-a9f8-764f39261dce None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:37:11.092219 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c50d49b-d398-41be-a9f8-764f39261dce None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:37:11.092493 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c50d49b-d398-41be-a9f8-764f39261dce None admin] PATH_INFO: `/v3/services` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:37:11.093123 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c50d49b-d398-41be-a9f8-764f39261dce None admin] RBAC: Adding query filter params (name=placement) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 09:37:11.093425 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c50d49b-d398-41be-a9f8-764f39261dce None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:37:11.094834 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c50d49b-d398-41be-a9f8-764f39261dce None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:37:11.100014 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 496/982] 10.222.0.65 () {56 vars in 1116 bytes} [Thu Oct 27 09:37:10 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 09:37:11.106185 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507c67f6-f911-4d20-895b-a9c79c623db1 None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:37:11.190702 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:37:11.209517 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507c67f6-f911-4d20-895b-a9c79c623db1 None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:37:11.244080 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662bd1d3-6cd7-4fdd-86a1-ee1a3d4aa3d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:37:11.244858 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662bd1d3-6cd7-4fdd-86a1-ee1a3d4aa3d7 None admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:37:11.245340 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662bd1d3-6cd7-4fdd-86a1-ee1a3d4aa3d7 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:37:11.245626 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662bd1d3-6cd7-4fdd-86a1-ee1a3d4aa3d7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:37:11.246503 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662bd1d3-6cd7-4fdd-86a1-ee1a3d4aa3d7 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:37:11.248361 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662bd1d3-6cd7-4fdd-86a1-ee1a3d4aa3d7 None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:37:11.378488 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 487/983] 10.222.0.65 () {60 vars in 1144 bytes} [Thu Oct 27 09:37:11 2022] POST /identity/v3/endpoints => generated 331 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 09:37:21.096964 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=69 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:37:21.373424 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=30,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:43:52.846094 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fa0769-480c-4674-b35f-4233decb8447 None None] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:43:52.846579 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fa0769-480c-4674-b35f-4233decb8447 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:43:52.846671 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fa0769-480c-4674-b35f-4233decb8447 None None] PATH_INFO: `/` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:43:52.848027 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 497/984] 10.222.0.65 () {54 vars in 927 bytes} [Thu Oct 27 09:43:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 09:43:52.853781 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583defd2-d63a-4082-90db-61936d220bcd None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:43:52.854293 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583defd2-d63a-4082-90db-61936d220bcd None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:43:52.854585 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583defd2-d63a-4082-90db-61936d220bcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:43:52.942807 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-583defd2-d63a-4082-90db-61936d220bcd None None] MFA Rules not processed for user `b5065084bf664b99bdeac46067cb0f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:43:52.944260 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-583defd2-d63a-4082-90db-61936d220bcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:43:53.072553 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 488/985] 10.222.0.65 () {58 vars in 1024 bytes} [Thu Oct 27 09:43:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 09:43:53.379383 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519bb53b-d947-43da-a98b-194e737b76e5 None None] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:43:53.379706 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519bb53b-d947-43da-a98b-194e737b76e5 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:43:53.379944 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519bb53b-d947-43da-a98b-194e737b76e5 None None] PATH_INFO: `/` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:43:53.381443 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 498/986] 10.222.0.65 () {54 vars in 965 bytes} [Thu Oct 27 09:43:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 09:43:53.393695 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7014d412-09dd-44b3-8475-ac13f91abf2c None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:43:53.394148 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7014d412-09dd-44b3-8475-ac13f91abf2c None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:43:53.394549 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7014d412-09dd-44b3-8475-ac13f91abf2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:43:53.488767 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-7014d412-09dd-44b3-8475-ac13f91abf2c None None] MFA Rules not processed for user `6191cc41efa74f46b49022cf387f7a4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:43:53.490024 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-7014d412-09dd-44b3-8475-ac13f91abf2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:43:53.517312 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:43:53.597616 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 489/987] 10.222.0.65 () {58 vars in 1062 bytes} [Thu Oct 27 09:43:53 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 09:43:53.608731 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519bb53b-d947-43da-a98b-194e737b76e5 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:43:53.611222 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-519bb53b-d947-43da-a98b-194e737b76e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:43:53.748257 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519bb53b-d947-43da-a98b-194e737b76e5 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:43:53.838426 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102ccae8-7b78-4f71-afad-ba39dd26c90b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6191cc41efa74f46b49022cf387f7a4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc2e3a7a1bcc480891c0b433291c00b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:43:53.839311 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102ccae8-7b78-4f71-afad-ba39dd26c90b service neutron] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:43:53.839736 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102ccae8-7b78-4f71-afad-ba39dd26c90b service neutron] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:43:53.840352 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102ccae8-7b78-4f71-afad-ba39dd26c90b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:43:53.842355 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-102ccae8-7b78-4f71-afad-ba39dd26c90b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:43:53.911519 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:43:53.974877 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102ccae8-7b78-4f71-afad-ba39dd26c90b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:43:53.976548 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102ccae8-7b78-4f71-afad-ba39dd26c90b service neutron] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:43:54.001642 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 499/988] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Oct 27 09:43:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 09:43:56.544959 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db194cc2-41e0-491e-a902-9374c92e8a31 None None] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:43:56.545403 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db194cc2-41e0-491e-a902-9374c92e8a31 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:43:56.545506 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db194cc2-41e0-491e-a902-9374c92e8a31 None None] PATH_INFO: `/` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:43:56.546924 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 490/989] 10.222.0.65 () {54 vars in 927 bytes} [Thu Oct 27 09:43:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 09:43:56.552369 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6580d686-c551-4335-9904-71cdf368a6f9 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:43:56.552788 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6580d686-c551-4335-9904-71cdf368a6f9 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:43:56.552914 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6580d686-c551-4335-9904-71cdf368a6f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:43:56.637307 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-6580d686-c551-4335-9904-71cdf368a6f9 None None] MFA Rules not processed for user `b5065084bf664b99bdeac46067cb0f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:43:56.638536 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-6580d686-c551-4335-9904-71cdf368a6f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:43:56.735160 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 500/990] 10.222.0.65 () {58 vars in 1024 bytes} [Thu Oct 27 09:43:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 09:43:57.022627 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db194cc2-41e0-491e-a902-9374c92e8a31 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:43:57.024157 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-db194cc2-41e0-491e-a902-9374c92e8a31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:43:57.140103 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db194cc2-41e0-491e-a902-9374c92e8a31 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:43:57.222420 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:43:57.224773 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724b34b9-7755-4964-8337-d1cb18bd1ddd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6191cc41efa74f46b49022cf387f7a4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc2e3a7a1bcc480891c0b433291c00b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:43:57.225388 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724b34b9-7755-4964-8337-d1cb18bd1ddd service neutron] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:43:57.225672 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724b34b9-7755-4964-8337-d1cb18bd1ddd service neutron] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:43:57.225950 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724b34b9-7755-4964-8337-d1cb18bd1ddd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:43:57.227591 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-724b34b9-7755-4964-8337-d1cb18bd1ddd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:43:57.339105 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724b34b9-7755-4964-8337-d1cb18bd1ddd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:43:57.341080 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724b34b9-7755-4964-8337-d1cb18bd1ddd service neutron] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:43:57.361092 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 491/991] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Oct 27 09:43:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 09:44:00.114062 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56b5c4c-4382-4345-9271-9ce3fa8092f9 None None] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:44:00.114598 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56b5c4c-4382-4345-9271-9ce3fa8092f9 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:44:00.114598 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56b5c4c-4382-4345-9271-9ce3fa8092f9 None None] PATH_INFO: `/` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:44:00.115938 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 501/992] 10.222.0.65 () {54 vars in 927 bytes} [Thu Oct 27 09:44:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 09:44:00.121342 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1738e7fd-d3af-4cf4-b625-fd93d838a98d None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:44:00.121745 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1738e7fd-d3af-4cf4-b625-fd93d838a98d None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:44:00.121892 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1738e7fd-d3af-4cf4-b625-fd93d838a98d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:44:00.189379 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-1738e7fd-d3af-4cf4-b625-fd93d838a98d None None] MFA Rules not processed for user `25440275d47c4aacb7bdf0ee93b382f3`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:44:00.190635 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-1738e7fd-d3af-4cf4-b625-fd93d838a98d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:44:00.244681 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:44:00.292813 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 492/993] 10.222.0.65 () {58 vars in 1024 bytes} [Thu Oct 27 09:44:00 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 09:44:00.623321 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56b5c4c-4382-4345-9271-9ce3fa8092f9 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:44:00.624907 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-e56b5c4c-4382-4345-9271-9ce3fa8092f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:44:00.638979 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:44:00.744772 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56b5c4c-4382-4345-9271-9ce3fa8092f9 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:44:00.828942 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf90275-6484-435f-a034-061a14d341c9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6191cc41efa74f46b49022cf387f7a4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc2e3a7a1bcc480891c0b433291c00b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:44:00.830192 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf90275-6484-435f-a034-061a14d341c9 service neutron] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:44:00.830192 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf90275-6484-435f-a034-061a14d341c9 service neutron] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:44:00.830192 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf90275-6484-435f-a034-061a14d341c9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:44:00.831652 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-adf90275-6484-435f-a034-061a14d341c9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:44:00.907781 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:44:00.971695 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf90275-6484-435f-a034-061a14d341c9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:44:00.973386 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf90275-6484-435f-a034-061a14d341c9 service neutron] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:44:00.995229 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 502/994] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Oct 27 09:44:00 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 09:44:03.976743 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fc3877-bcf1-489f-a73c-c81b72fd683c None None] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:44:03.977315 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fc3877-bcf1-489f-a73c-c81b72fd683c None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:44:03.977315 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fc3877-bcf1-489f-a73c-c81b72fd683c None None] PATH_INFO: `/` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:44:03.978674 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 493/995] 10.222.0.65 () {54 vars in 927 bytes} [Thu Oct 27 09:44:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 09:44:03.984185 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875bdac0-a271-4c7a-88e7-2b0c3fccbb9c None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:44:03.984602 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875bdac0-a271-4c7a-88e7-2b0c3fccbb9c None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:44:03.984743 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875bdac0-a271-4c7a-88e7-2b0c3fccbb9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:44:04.052784 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-875bdac0-a271-4c7a-88e7-2b0c3fccbb9c None None] MFA Rules not processed for user `b5065084bf664b99bdeac46067cb0f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:44:04.054149 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-875bdac0-a271-4c7a-88e7-2b0c3fccbb9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:44:04.156654 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 503/996] 10.222.0.65 () {58 vars in 1024 bytes} [Thu Oct 27 09:44:03 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 09:44:04.440341 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fc3877-bcf1-489f-a73c-c81b72fd683c None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:44:04.441876 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-e3fc3877-bcf1-489f-a73c-c81b72fd683c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:44:04.547415 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fc3877-bcf1-489f-a73c-c81b72fd683c None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:44:04.622358 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39ef817-15f9-47a8-bdf6-8c9c6a10406d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6191cc41efa74f46b49022cf387f7a4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc2e3a7a1bcc480891c0b433291c00b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:44:04.623014 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39ef817-15f9-47a8-bdf6-8c9c6a10406d service neutron] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:44:04.623294 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39ef817-15f9-47a8-bdf6-8c9c6a10406d service neutron] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:44:04.623570 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39ef817-15f9-47a8-bdf6-8c9c6a10406d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:44:04.625173 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-d39ef817-15f9-47a8-bdf6-8c9c6a10406d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:44:04.633196 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:44:04.738946 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39ef817-15f9-47a8-bdf6-8c9c6a10406d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:44:04.741137 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39ef817-15f9-47a8-bdf6-8c9c6a10406d service neutron] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:44:04.759860 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 494/997] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Oct 27 09:44:04 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 09:44:07.957370 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2c4e49-7639-47e9-ba65-5346d01d04df None None] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:44:07.957917 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2c4e49-7639-47e9-ba65-5346d01d04df None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:44:07.957917 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2c4e49-7639-47e9-ba65-5346d01d04df None None] PATH_INFO: `/` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:44:07.959408 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 504/998] 10.222.0.65 () {54 vars in 927 bytes} [Thu Oct 27 09:44:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 09:44:07.965558 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd1e502-6f7f-4940-bff8-75a48f9661d1 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:44:07.966004 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd1e502-6f7f-4940-bff8-75a48f9661d1 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:44:07.966229 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd1e502-6f7f-4940-bff8-75a48f9661d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:44:08.042438 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-3bd1e502-6f7f-4940-bff8-75a48f9661d1 None None] MFA Rules not processed for user `b5065084bf664b99bdeac46067cb0f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:44:08.043684 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-3bd1e502-6f7f-4940-bff8-75a48f9661d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:44:08.110422 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:44:08.156389 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 495/999] 10.222.0.65 () {58 vars in 1024 bytes} [Thu Oct 27 09:44:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 09:44:08.457519 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2c4e49-7639-47e9-ba65-5346d01d04df None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:44:08.459144 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-fa2c4e49-7639-47e9-ba65-5346d01d04df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:44:08.482327 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:44:08.572543 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2c4e49-7639-47e9-ba65-5346d01d04df None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:44:08.652974 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdda55cd-7d8a-463d-bd4b-4587c1c3af5b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6191cc41efa74f46b49022cf387f7a4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc2e3a7a1bcc480891c0b433291c00b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:44:08.653586 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdda55cd-7d8a-463d-bd4b-4587c1c3af5b service neutron] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:44:08.653917 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdda55cd-7d8a-463d-bd4b-4587c1c3af5b service neutron] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:44:08.654185 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdda55cd-7d8a-463d-bd4b-4587c1c3af5b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:44:08.655860 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-bdda55cd-7d8a-463d-bd4b-4587c1c3af5b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:44:08.732526 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:44:08.772367 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdda55cd-7d8a-463d-bd4b-4587c1c3af5b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:44:08.773813 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdda55cd-7d8a-463d-bd4b-4587c1c3af5b service neutron] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:44:08.791741 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 505/1000] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Oct 27 09:44:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 09:44:11.050958 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190b3daf-fef2-4883-9633-ed6d8b38199f None None] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:44:11.051486 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190b3daf-fef2-4883-9633-ed6d8b38199f None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:44:11.051486 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190b3daf-fef2-4883-9633-ed6d8b38199f None None] PATH_INFO: `/` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:44:11.052869 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 496/1001] 10.222.0.65 () {54 vars in 927 bytes} [Thu Oct 27 09:44:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 09:44:11.059027 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abc53ee-4e3d-4834-93da-d8ff4987a876 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:44:11.059467 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abc53ee-4e3d-4834-93da-d8ff4987a876 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:44:11.059558 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abc53ee-4e3d-4834-93da-d8ff4987a876 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:44:11.129043 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-6abc53ee-4e3d-4834-93da-d8ff4987a876 None None] MFA Rules not processed for user `b5065084bf664b99bdeac46067cb0f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:44:11.130172 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-6abc53ee-4e3d-4834-93da-d8ff4987a876 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:44:11.237130 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 506/1002] 10.222.0.65 () {58 vars in 1024 bytes} [Thu Oct 27 09:44:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 09:44:11.519752 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190b3daf-fef2-4883-9633-ed6d8b38199f None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:44:11.521397 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-190b3daf-fef2-4883-9633-ed6d8b38199f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:44:11.630510 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190b3daf-fef2-4883-9633-ed6d8b38199f None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:44:11.706564 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5669e75a-e6af-4fca-976a-680703322fb7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6191cc41efa74f46b49022cf387f7a4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc2e3a7a1bcc480891c0b433291c00b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:44:11.707165 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5669e75a-e6af-4fca-976a-680703322fb7 service neutron] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:44:11.707441 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5669e75a-e6af-4fca-976a-680703322fb7 service neutron] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:44:11.707713 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5669e75a-e6af-4fca-976a-680703322fb7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:44:11.709291 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-5669e75a-e6af-4fca-976a-680703322fb7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:44:11.726950 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:44:11.822274 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5669e75a-e6af-4fca-976a-680703322fb7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:44:11.824274 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5669e75a-e6af-4fca-976a-680703322fb7 service neutron] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:44:11.842866 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 497/1003] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Oct 27 09:44:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 09:44:14.087478 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20763a61-fbfe-4c17-a5cd-0e6c0c75f7f1 None None] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:44:14.088009 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20763a61-fbfe-4c17-a5cd-0e6c0c75f7f1 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:44:14.088144 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20763a61-fbfe-4c17-a5cd-0e6c0c75f7f1 None None] PATH_INFO: `/` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:44:14.089540 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 507/1004] 10.222.0.65 () {54 vars in 927 bytes} [Thu Oct 27 09:44:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 09:44:14.095219 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9b74ca-7d16-4005-9f87-c768bd5cdcd5 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:44:14.095921 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9b74ca-7d16-4005-9f87-c768bd5cdcd5 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:44:14.095921 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9b74ca-7d16-4005-9f87-c768bd5cdcd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:44:14.165073 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-8f9b74ca-7d16-4005-9f87-c768bd5cdcd5 None None] MFA Rules not processed for user `25440275d47c4aacb7bdf0ee93b382f3`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:44:14.166350 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-8f9b74ca-7d16-4005-9f87-c768bd5cdcd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:44:14.237208 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:44:14.269780 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 498/1005] 10.222.0.65 () {58 vars in 1024 bytes} [Thu Oct 27 09:44:14 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 09:44:14.563474 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20763a61-fbfe-4c17-a5cd-0e6c0c75f7f1 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:44:14.565028 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-20763a61-fbfe-4c17-a5cd-0e6c0c75f7f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:44:14.603264 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:44:14.693511 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20763a61-fbfe-4c17-a5cd-0e6c0c75f7f1 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:44:14.802018 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d95136c-631a-4c35-a722-9dbb087b5e34 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6191cc41efa74f46b49022cf387f7a4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc2e3a7a1bcc480891c0b433291c00b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:44:14.802686 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d95136c-631a-4c35-a722-9dbb087b5e34 service neutron] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:44:14.802974 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d95136c-631a-4c35-a722-9dbb087b5e34 service neutron] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:44:14.803248 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d95136c-631a-4c35-a722-9dbb087b5e34 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:44:14.804919 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-7d95136c-631a-4c35-a722-9dbb087b5e34 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:44:14.910135 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:44:14.945783 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d95136c-631a-4c35-a722-9dbb087b5e34 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:44:14.947300 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d95136c-631a-4c35-a722-9dbb087b5e34 service neutron] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:44:14.977098 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 508/1006] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Oct 27 09:44:14 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 09:44:17.610381 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1be2c8-c4f2-4a55-8b5d-9d2d6a044f9b None None] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:44:17.610977 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1be2c8-c4f2-4a55-8b5d-9d2d6a044f9b None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:44:17.610977 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1be2c8-c4f2-4a55-8b5d-9d2d6a044f9b None None] PATH_INFO: `/` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:44:17.612310 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 499/1007] 10.222.0.65 () {54 vars in 927 bytes} [Thu Oct 27 09:44:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 09:44:17.617668 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f847cbe9-15e6-489b-923e-b86c80eaae2a None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:44:17.618112 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f847cbe9-15e6-489b-923e-b86c80eaae2a None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:44:17.618263 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f847cbe9-15e6-489b-923e-b86c80eaae2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:44:17.685879 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-f847cbe9-15e6-489b-923e-b86c80eaae2a None None] MFA Rules not processed for user `b5065084bf664b99bdeac46067cb0f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:44:17.687118 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-f847cbe9-15e6-489b-923e-b86c80eaae2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:44:17.784657 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 509/1008] 10.222.0.65 () {58 vars in 1024 bytes} [Thu Oct 27 09:44:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 09:44:18.067159 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1be2c8-c4f2-4a55-8b5d-9d2d6a044f9b None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:44:18.068708 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-ec1be2c8-c4f2-4a55-8b5d-9d2d6a044f9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:44:18.173469 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1be2c8-c4f2-4a55-8b5d-9d2d6a044f9b None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:44:18.249081 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44992eb7-9375-4036-a8ed-1114346fac65 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6191cc41efa74f46b49022cf387f7a4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc2e3a7a1bcc480891c0b433291c00b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:44:18.249677 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44992eb7-9375-4036-a8ed-1114346fac65 service neutron] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:44:18.249960 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44992eb7-9375-4036-a8ed-1114346fac65 service neutron] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:44:18.250237 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44992eb7-9375-4036-a8ed-1114346fac65 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:44:18.251856 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-44992eb7-9375-4036-a8ed-1114346fac65 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:44:18.279313 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:44:18.364763 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44992eb7-9375-4036-a8ed-1114346fac65 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:44:18.366129 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44992eb7-9375-4036-a8ed-1114346fac65 service neutron] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:44:18.384450 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 500/1009] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Oct 27 09:44:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 09:44:20.672698 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe43f41-5af8-4b90-ab21-a46ad45bbdae None None] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:44:20.673247 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe43f41-5af8-4b90-ab21-a46ad45bbdae None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:44:20.673247 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe43f41-5af8-4b90-ab21-a46ad45bbdae None None] PATH_INFO: `/` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:44:20.674607 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 510/1010] 10.222.0.65 () {54 vars in 927 bytes} [Thu Oct 27 09:44:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 09:44:20.680004 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7760516-66c3-463d-95d0-852ec7601718 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:44:20.680446 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7760516-66c3-463d-95d0-852ec7601718 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:44:20.680565 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7760516-66c3-463d-95d0-852ec7601718 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:44:20.749335 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-a7760516-66c3-463d-95d0-852ec7601718 None None] MFA Rules not processed for user `b5065084bf664b99bdeac46067cb0f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:44:20.750590 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-a7760516-66c3-463d-95d0-852ec7601718 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:44:20.825807 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:44:20.848109 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 501/1011] 10.222.0.65 () {58 vars in 1024 bytes} [Thu Oct 27 09:44:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 09:44:21.159680 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452cd2b5-7f7e-434c-abc0-ce2c16c69936 None None] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:44:21.159954 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452cd2b5-7f7e-434c-abc0-ce2c16c69936 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:44:21.160219 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452cd2b5-7f7e-434c-abc0-ce2c16c69936 None None] PATH_INFO: `/` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:44:21.161550 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 511/1012] 10.222.0.65 () {54 vars in 965 bytes} [Thu Oct 27 09:44:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 09:44:21.168224 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d77b2b-031f-4056-970a-73370822f976 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:44:21.168515 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d77b2b-031f-4056-970a-73370822f976 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:44:21.168809 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d77b2b-031f-4056-970a-73370822f976 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:44:21.249672 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-73d77b2b-031f-4056-970a-73370822f976 None None] MFA Rules not processed for user `6191cc41efa74f46b49022cf387f7a4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:44:21.250943 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-73d77b2b-031f-4056-970a-73370822f976 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:44:21.329436 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 502/1013] 10.222.0.65 () {58 vars in 1062 bytes} [Thu Oct 27 09:44:21 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 09:44:21.339096 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452cd2b5-7f7e-434c-abc0-ce2c16c69936 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:44:21.340692 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-452cd2b5-7f7e-434c-abc0-ce2c16c69936 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:44:21.381305 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:44:21.446423 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452cd2b5-7f7e-434c-abc0-ce2c16c69936 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:44:21.523374 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f72b53-ebbc-4dda-9faa-d106627bbce4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6191cc41efa74f46b49022cf387f7a4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc2e3a7a1bcc480891c0b433291c00b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:44:21.523979 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f72b53-ebbc-4dda-9faa-d106627bbce4 service neutron] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:44:21.524261 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f72b53-ebbc-4dda-9faa-d106627bbce4 service neutron] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:44:21.524536 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f72b53-ebbc-4dda-9faa-d106627bbce4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:44:21.527374 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-95f72b53-ebbc-4dda-9faa-d106627bbce4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:44:21.611853 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:44:21.638095 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f72b53-ebbc-4dda-9faa-d106627bbce4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:44:21.639563 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f72b53-ebbc-4dda-9faa-d106627bbce4 service neutron] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:44:21.659591 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 512/1014] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Oct 27 09:44:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 09:44:25.044458 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0582cc-9b3b-4bfd-9290-4ad11ee8f008 None None] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:44:25.045005 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0582cc-9b3b-4bfd-9290-4ad11ee8f008 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:44:25.045005 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0582cc-9b3b-4bfd-9290-4ad11ee8f008 None None] PATH_INFO: `/` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:44:25.046336 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 503/1015] 10.222.0.65 () {54 vars in 927 bytes} [Thu Oct 27 09:44:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 09:44:25.051720 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613344bc-c9ab-4074-8520-754bcdebe1a9 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:44:25.052158 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613344bc-c9ab-4074-8520-754bcdebe1a9 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:44:25.052362 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613344bc-c9ab-4074-8520-754bcdebe1a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:44:25.122637 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-613344bc-c9ab-4074-8520-754bcdebe1a9 None None] MFA Rules not processed for user `b5065084bf664b99bdeac46067cb0f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:44:25.123791 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-613344bc-c9ab-4074-8520-754bcdebe1a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:44:25.220888 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 513/1016] 10.222.0.65 () {58 vars in 1024 bytes} [Thu Oct 27 09:44:25 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 09:44:25.522183 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0582cc-9b3b-4bfd-9290-4ad11ee8f008 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:44:25.523804 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-ca0582cc-9b3b-4bfd-9290-4ad11ee8f008 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:44:25.607862 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:44:25.637234 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0582cc-9b3b-4bfd-9290-4ad11ee8f008 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:44:25.715046 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf13ba4-91ea-4518-8d17-a030bc56fa7e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6191cc41efa74f46b49022cf387f7a4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc2e3a7a1bcc480891c0b433291c00b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:44:25.715658 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf13ba4-91ea-4518-8d17-a030bc56fa7e service neutron] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:44:25.715942 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf13ba4-91ea-4518-8d17-a030bc56fa7e service neutron] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:44:25.716220 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf13ba4-91ea-4518-8d17-a030bc56fa7e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:44:25.717858 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-7bf13ba4-91ea-4518-8d17-a030bc56fa7e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:44:25.834455 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf13ba4-91ea-4518-8d17-a030bc56fa7e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:44:25.835842 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf13ba4-91ea-4518-8d17-a030bc56fa7e service neutron] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:44:25.858728 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 504/1017] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Oct 27 09:44:25 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 09:44:30.270868 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615e2126-9fee-46c6-8fb0-6cdfdfefc3d1 None None] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:44:30.271421 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615e2126-9fee-46c6-8fb0-6cdfdfefc3d1 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:44:30.271421 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615e2126-9fee-46c6-8fb0-6cdfdfefc3d1 None None] PATH_INFO: `/` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:44:30.272804 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 514/1018] 10.222.0.65 () {54 vars in 927 bytes} [Thu Oct 27 09:44:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 09:44:30.278634 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dadae7e-1fa7-4e8f-b5f3-c8781080df54 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:44:30.279229 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dadae7e-1fa7-4e8f-b5f3-c8781080df54 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:44:30.279229 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dadae7e-1fa7-4e8f-b5f3-c8781080df54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:44:30.284911 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:44:30.355495 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-9dadae7e-1fa7-4e8f-b5f3-c8781080df54 None None] MFA Rules not processed for user `b5065084bf664b99bdeac46067cb0f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:44:30.356736 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-9dadae7e-1fa7-4e8f-b5f3-c8781080df54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:44:30.457587 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 505/1019] 10.222.0.65 () {58 vars in 1024 bytes} [Thu Oct 27 09:44:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 09:44:30.748005 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615e2126-9fee-46c6-8fb0-6cdfdfefc3d1 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:44:30.749651 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-615e2126-9fee-46c6-8fb0-6cdfdfefc3d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:44:30.801051 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:44:30.861304 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615e2126-9fee-46c6-8fb0-6cdfdfefc3d1 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:44:30.937159 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdfc0f8-c106-48d9-ad79-8591e769c80b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6191cc41efa74f46b49022cf387f7a4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc2e3a7a1bcc480891c0b433291c00b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:44:30.937761 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdfc0f8-c106-48d9-ad79-8591e769c80b service neutron] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:44:30.938037 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdfc0f8-c106-48d9-ad79-8591e769c80b service neutron] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:44:30.938307 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdfc0f8-c106-48d9-ad79-8591e769c80b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:44:30.939915 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-efdfc0f8-c106-48d9-ad79-8591e769c80b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:44:31.036222 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:44:31.052903 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efdfc0f8-c106-48d9-ad79-8591e769c80b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:44:31.054303 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efdfc0f8-c106-48d9-ad79-8591e769c80b service neutron] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:44:31.074892 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 515/1020] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Oct 27 09:44:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 09:44:34.236360 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45979d54-6aa8-479a-9ad1-8e430659e396 None None] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:44:34.236890 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45979d54-6aa8-479a-9ad1-8e430659e396 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:44:34.237008 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45979d54-6aa8-479a-9ad1-8e430659e396 None None] PATH_INFO: `/` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:44:34.239394 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 506/1021] 10.222.0.65 () {54 vars in 927 bytes} [Thu Oct 27 09:44:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 09:44:34.244303 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188733bf-705f-4410-acba-f377049f32af None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:44:34.244804 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188733bf-705f-4410-acba-f377049f32af None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:44:34.245225 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188733bf-705f-4410-acba-f377049f32af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:44:34.315202 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-188733bf-705f-4410-acba-f377049f32af None None] MFA Rules not processed for user `b5065084bf664b99bdeac46067cb0f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:44:34.316467 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-188733bf-705f-4410-acba-f377049f32af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:44:34.423620 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 516/1022] 10.222.0.65 () {58 vars in 1024 bytes} [Thu Oct 27 09:44:34 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 09:44:34.710055 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45979d54-6aa8-479a-9ad1-8e430659e396 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:44:34.711646 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-45979d54-6aa8-479a-9ad1-8e430659e396 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:44:34.812991 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:44:34.830841 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45979d54-6aa8-479a-9ad1-8e430659e396 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:44:34.910304 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83983ab2-39cc-4865-93bf-ea071a5f31e8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6191cc41efa74f46b49022cf387f7a4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc2e3a7a1bcc480891c0b433291c00b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:44:34.910951 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83983ab2-39cc-4865-93bf-ea071a5f31e8 service neutron] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:44:34.911235 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83983ab2-39cc-4865-93bf-ea071a5f31e8 service neutron] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:44:34.911510 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83983ab2-39cc-4865-93bf-ea071a5f31e8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:44:34.913124 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-83983ab2-39cc-4865-93bf-ea071a5f31e8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:44:35.031073 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83983ab2-39cc-4865-93bf-ea071a5f31e8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:44:35.032598 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83983ab2-39cc-4865-93bf-ea071a5f31e8 service neutron] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:44:35.059756 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 507/1023] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Oct 27 09:44:34 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 09:44:39.645327 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e829f1-d1f3-4f3a-98df-1e41a3407d38 None None] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:44:39.645819 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e829f1-d1f3-4f3a-98df-1e41a3407d38 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:44:39.645925 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e829f1-d1f3-4f3a-98df-1e41a3407d38 None None] PATH_INFO: `/` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:44:39.647425 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 517/1024] 10.222.0.65 () {54 vars in 927 bytes} [Thu Oct 27 09:44:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 09:44:39.653740 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a692ccf2-f143-498b-b9ab-c57c6d354733 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:44:39.654174 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a692ccf2-f143-498b-b9ab-c57c6d354733 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:44:39.654309 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a692ccf2-f143-498b-b9ab-c57c6d354733 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:44:39.671000 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:44:39.728757 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-a692ccf2-f143-498b-b9ab-c57c6d354733 None None] MFA Rules not processed for user `b5065084bf664b99bdeac46067cb0f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:44:39.729968 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-a692ccf2-f143-498b-b9ab-c57c6d354733 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:44:39.831081 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 508/1025] 10.222.0.65 () {58 vars in 1024 bytes} [Thu Oct 27 09:44:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 09:44:40.115115 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e829f1-d1f3-4f3a-98df-1e41a3407d38 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:44:40.116654 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-95e829f1-d1f3-4f3a-98df-1e41a3407d38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:44:40.177639 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:44:40.229652 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e829f1-d1f3-4f3a-98df-1e41a3407d38 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:44:40.305902 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a55029-d286-4847-8593-70323e2d2b8d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6191cc41efa74f46b49022cf387f7a4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc2e3a7a1bcc480891c0b433291c00b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:44:40.306505 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a55029-d286-4847-8593-70323e2d2b8d service neutron] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:44:40.306820 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a55029-d286-4847-8593-70323e2d2b8d service neutron] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:44:40.307091 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a55029-d286-4847-8593-70323e2d2b8d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:44:40.308683 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-66a55029-d286-4847-8593-70323e2d2b8d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:44:40.417078 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:44:40.420569 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a55029-d286-4847-8593-70323e2d2b8d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:44:40.422000 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a55029-d286-4847-8593-70323e2d2b8d service neutron] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:44:40.439956 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 518/1026] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Oct 27 09:44:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 09:44:45.443821 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3210ba75-db56-4814-b802-042efb0aebf6 None None] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:44:45.444382 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3210ba75-db56-4814-b802-042efb0aebf6 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:44:45.444382 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3210ba75-db56-4814-b802-042efb0aebf6 None None] PATH_INFO: `/` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:44:45.446722 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 509/1027] 10.222.0.65 () {54 vars in 921 bytes} [Thu Oct 27 09:44:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 09:44:45.451819 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3167a15-0790-463b-95a9-2ee107a89a89 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:44:45.452351 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3167a15-0790-463b-95a9-2ee107a89a89 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:44:45.452351 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3167a15-0790-463b-95a9-2ee107a89a89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:44:45.558698 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-a3167a15-0790-463b-95a9-2ee107a89a89 None None] MFA Rules not processed for user `f8c47ff5d72943f6bab09b5df6198d64`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:44:45.559028 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-a3167a15-0790-463b-95a9-2ee107a89a89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:44:45.697723 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 519/1028] 10.222.0.65 () {58 vars in 1018 bytes} [Thu Oct 27 09:44:45 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 09:44:49.832416 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=59 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:44:50.087845 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cebaac-77d3-45ad-9ff8-04f1bc7f2739 None None] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:44:50.088464 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cebaac-77d3-45ad-9ff8-04f1bc7f2739 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:44:50.088897 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cebaac-77d3-45ad-9ff8-04f1bc7f2739 None None] PATH_INFO: `/` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:44:50.090591 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 510/1029] 10.222.0.65 () {54 vars in 921 bytes} [Thu Oct 27 09:44:50 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 09:44:50.096045 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19926d04-be8e-4df3-b6a4-d36e8358b8aa None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:44:50.096528 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19926d04-be8e-4df3-b6a4-d36e8358b8aa None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:44:50.096646 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19926d04-be8e-4df3-b6a4-d36e8358b8aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:44:50.152839 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:44:50.175812 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-19926d04-be8e-4df3-b6a4-d36e8358b8aa None None] MFA Rules not processed for user `f8c47ff5d72943f6bab09b5df6198d64`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:44:50.177152 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-19926d04-be8e-4df3-b6a4-d36e8358b8aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:44:50.292285 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 520/1030] 10.222.0.65 () {58 vars in 1018 bytes} [Thu Oct 27 09:44:50 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 09:44:51.812472 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d88d45b-d730-4b3e-ae1d-97c5db7e8247 None None] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:44:51.812983 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d88d45b-d730-4b3e-ae1d-97c5db7e8247 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:44:51.812983 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d88d45b-d730-4b3e-ae1d-97c5db7e8247 None None] PATH_INFO: `/` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:44:51.814578 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 511/1031] 10.222.0.65 () {54 vars in 921 bytes} [Thu Oct 27 09:44:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 09:44:51.819685 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877d349f-2735-484d-89a4-1eb2f5330751 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:44:51.820186 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877d349f-2735-484d-89a4-1eb2f5330751 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:44:51.821488 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877d349f-2735-484d-89a4-1eb2f5330751 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:44:51.903716 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-877d349f-2735-484d-89a4-1eb2f5330751 None None] MFA Rules not processed for user `f8c47ff5d72943f6bab09b5df6198d64`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:44:51.905010 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-877d349f-2735-484d-89a4-1eb2f5330751 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:44:51.951323 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:44:52.028199 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 521/1032] 10.222.0.65 () {58 vars in 1018 bytes} [Thu Oct 27 09:44:51 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 09:44:55.490491 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4c46e4-38ea-4e45-ae67-034eea53bfaa None None] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:44:55.491062 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4c46e4-38ea-4e45-ae67-034eea53bfaa None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:44:55.491062 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4c46e4-38ea-4e45-ae67-034eea53bfaa None None] PATH_INFO: `/` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:44:55.498070 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 512/1033] 10.222.0.65 () {54 vars in 927 bytes} [Thu Oct 27 09:44:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 09:44:55.500154 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1cd14a-36d9-4ff3-8875-7d8388d424c1 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:44:55.500948 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1cd14a-36d9-4ff3-8875-7d8388d424c1 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:44:55.501233 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1cd14a-36d9-4ff3-8875-7d8388d424c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:44:55.588499 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-de1cd14a-36d9-4ff3-8875-7d8388d424c1 None None] MFA Rules not processed for user `b5065084bf664b99bdeac46067cb0f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:44:55.589720 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-de1cd14a-36d9-4ff3-8875-7d8388d424c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:44:55.704160 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 522/1034] 10.222.0.65 () {58 vars in 1024 bytes} [Thu Oct 27 09:44:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 09:44:56.006949 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d1b7e9-988e-434d-8afd-e07ae572f71a None None] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:44:56.007539 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d1b7e9-988e-434d-8afd-e07ae572f71a None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:44:56.008410 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d1b7e9-988e-434d-8afd-e07ae572f71a None None] PATH_INFO: `/` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:44:56.010305 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 513/1035] 10.222.0.65 () {54 vars in 961 bytes} [Thu Oct 27 09:44:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 09:44:56.021299 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b68f0e-c0d8-4ec9-b7d9-2a4c567a3f90 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:44:56.022284 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b68f0e-c0d8-4ec9-b7d9-2a4c567a3f90 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:44:56.023120 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b68f0e-c0d8-4ec9-b7d9-2a4c567a3f90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:44:56.044330 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:44:56.114406 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-86b68f0e-c0d8-4ec9-b7d9-2a4c567a3f90 None None] MFA Rules not processed for user `fd0d23ef039d4f1591a589d302ef165f`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:44:56.115807 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-86b68f0e-c0d8-4ec9-b7d9-2a4c567a3f90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:44:56.242511 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 523/1036] 10.222.0.65 () {58 vars in 1058 bytes} [Thu Oct 27 09:44:56 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 09:44:56.253473 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d1b7e9-988e-434d-8afd-e07ae572f71a None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:44:56.256471 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-a6d1b7e9-988e-434d-8afd-e07ae572f71a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:44:56.437386 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d1b7e9-988e-434d-8afd-e07ae572f71a None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:44:56.520067 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:44:56.563665 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d39cfe6-1cff-4923-883f-89707d4e95e5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd0d23ef039d4f1591a589d302ef165f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc2e3a7a1bcc480891c0b433291c00b1', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:44:56.564386 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d39cfe6-1cff-4923-883f-89707d4e95e5 service nova] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:44:56.564669 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d39cfe6-1cff-4923-883f-89707d4e95e5 service nova] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:44:56.564997 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d39cfe6-1cff-4923-883f-89707d4e95e5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:44:56.566614 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-7d39cfe6-1cff-4923-883f-89707d4e95e5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:44:56.672673 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d39cfe6-1cff-4923-883f-89707d4e95e5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:44:56.674305 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d39cfe6-1cff-4923-883f-89707d4e95e5 service nova] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:44:56.694731 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 514/1037] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Oct 27 09:44:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 442 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 09:44:59.096874 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5364ad37-b640-47a1-bbde-dcc4977e954f None None] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:44:59.097399 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5364ad37-b640-47a1-bbde-dcc4977e954f None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:44:59.097399 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5364ad37-b640-47a1-bbde-dcc4977e954f None None] PATH_INFO: `/` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:44:59.098772 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 524/1038] 10.222.0.65 () {54 vars in 927 bytes} [Thu Oct 27 09:44:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 09:44:59.104564 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c632ba7-c858-49f4-a537-d60d27c84983 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:44:59.105018 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c632ba7-c858-49f4-a537-d60d27c84983 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:44:59.105121 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c632ba7-c858-49f4-a537-d60d27c84983 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:44:59.179579 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-4c632ba7-c858-49f4-a537-d60d27c84983 None None] MFA Rules not processed for user `b5065084bf664b99bdeac46067cb0f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:44:59.180877 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-4c632ba7-c858-49f4-a537-d60d27c84983 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:44:59.222023 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:44:59.294317 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 515/1039] 10.222.0.65 () {58 vars in 1024 bytes} [Thu Oct 27 09:44:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 09:44:59.588207 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5364ad37-b640-47a1-bbde-dcc4977e954f None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:44:59.589830 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-5364ad37-b640-47a1-bbde-dcc4977e954f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:44:59.676995 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:44:59.785870 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5364ad37-b640-47a1-bbde-dcc4977e954f None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:44:59.938087 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99223639-dcd2-4770-b7d4-380580444229 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd0d23ef039d4f1591a589d302ef165f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc2e3a7a1bcc480891c0b433291c00b1', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:44:59.938723 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99223639-dcd2-4770-b7d4-380580444229 service nova] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:44:59.939007 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99223639-dcd2-4770-b7d4-380580444229 service nova] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:44:59.939275 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99223639-dcd2-4770-b7d4-380580444229 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:44:59.941052 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-99223639-dcd2-4770-b7d4-380580444229 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:44:59.966812 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:45:00.037359 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99223639-dcd2-4770-b7d4-380580444229 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:45:00.039046 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99223639-dcd2-4770-b7d4-380580444229 service nova] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:45:00.060864 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 525/1040] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Oct 27 09:44:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 473 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 09:45:02.799128 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1383be9-0acd-4fbf-b9aa-ecaf85f11f92 None None] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:45:02.799894 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1383be9-0acd-4fbf-b9aa-ecaf85f11f92 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:45:02.799894 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1383be9-0acd-4fbf-b9aa-ecaf85f11f92 None None] PATH_INFO: `/` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:45:02.801206 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 516/1041] 10.222.0.65 () {54 vars in 927 bytes} [Thu Oct 27 09:45:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 09:45:02.806895 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4f547c-912c-4dfb-b0d4-4171429aad1f None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:45:02.807339 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4f547c-912c-4dfb-b0d4-4171429aad1f None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:45:02.807421 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4f547c-912c-4dfb-b0d4-4171429aad1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:45:02.886097 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-fa4f547c-912c-4dfb-b0d4-4171429aad1f None None] MFA Rules not processed for user `b5065084bf664b99bdeac46067cb0f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:45:02.887423 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-fa4f547c-912c-4dfb-b0d4-4171429aad1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:45:02.993968 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:45:02.996905 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 526/1042] 10.222.0.65 () {58 vars in 1024 bytes} [Thu Oct 27 09:45:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 09:45:03.289180 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5180be-453b-437b-91f0-415579887323 None None] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:45:03.289861 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5180be-453b-437b-91f0-415579887323 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:45:03.290302 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5180be-453b-437b-91f0-415579887323 None None] PATH_INFO: `/` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:45:03.291903 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 517/1043] 10.222.0.65 () {54 vars in 961 bytes} [Thu Oct 27 09:45:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 09:45:03.297555 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1087d823-5127-48d0-8dfe-81f31195fc46 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:45:03.297916 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1087d823-5127-48d0-8dfe-81f31195fc46 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:45:03.298267 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1087d823-5127-48d0-8dfe-81f31195fc46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:45:03.382654 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-1087d823-5127-48d0-8dfe-81f31195fc46 None None] MFA Rules not processed for user `fd0d23ef039d4f1591a589d302ef165f`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:45:03.384167 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-1087d823-5127-48d0-8dfe-81f31195fc46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:45:03.513917 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 527/1044] 10.222.0.65 () {58 vars in 1058 bytes} [Thu Oct 27 09:45:03 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 09:45:03.523011 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5180be-453b-437b-91f0-415579887323 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:45:03.524873 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-7b5180be-453b-437b-91f0-415579887323 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:45:03.698587 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5180be-453b-437b-91f0-415579887323 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:45:03.720322 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:45:03.825985 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ece05e-0bdf-486f-9ae4-0ada7fd717cf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd0d23ef039d4f1591a589d302ef165f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc2e3a7a1bcc480891c0b433291c00b1', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:45:03.826651 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ece05e-0bdf-486f-9ae4-0ada7fd717cf service nova] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:45:03.826881 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ece05e-0bdf-486f-9ae4-0ada7fd717cf service nova] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:45:03.827083 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ece05e-0bdf-486f-9ae4-0ada7fd717cf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:45:03.828728 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-01ece05e-0bdf-486f-9ae4-0ada7fd717cf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:45:03.939131 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ece05e-0bdf-486f-9ae4-0ada7fd717cf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:45:03.940738 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ece05e-0bdf-486f-9ae4-0ada7fd717cf service nova] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:45:03.962093 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 518/1045] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Oct 27 09:45:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 440 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 09:45:03.964333 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd7e21e-be6e-4641-b84e-02ab4bbacbaf None None] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:45:03.964800 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd7e21e-be6e-4641-b84e-02ab4bbacbaf None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:45:03.964883 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd7e21e-be6e-4641-b84e-02ab4bbacbaf None None] PATH_INFO: `/` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:45:03.966558 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 528/1046] 10.222.0.65 () {54 vars in 927 bytes} [Thu Oct 27 09:45:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 09:45:03.971608 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8546df-6f9c-43b8-acfd-3793ad860f23 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:45:03.972164 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8546df-6f9c-43b8-acfd-3793ad860f23 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:45:03.972530 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8546df-6f9c-43b8-acfd-3793ad860f23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:45:04.006612 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:45:04.043075 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-ec8546df-6f9c-43b8-acfd-3793ad860f23 None None] MFA Rules not processed for user `b5065084bf664b99bdeac46067cb0f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:45:04.044379 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-ec8546df-6f9c-43b8-acfd-3793ad860f23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:45:04.157690 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 519/1047] 10.222.0.65 () {58 vars in 1024 bytes} [Thu Oct 27 09:45:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 09:45:04.502407 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827f40f7-212f-470a-ad16-b9ad6e2eada3 None None] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:45:04.502407 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827f40f7-212f-470a-ad16-b9ad6e2eada3 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:45:04.502407 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827f40f7-212f-470a-ad16-b9ad6e2eada3 None None] PATH_INFO: `/` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:45:04.505114 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 529/1048] 10.222.0.65 () {54 vars in 963 bytes} [Thu Oct 27 09:45:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 09:45:04.514576 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ded62f3-8e6b-43c9-aaf7-16c400fe93ff None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:45:04.514576 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ded62f3-8e6b-43c9-aaf7-16c400fe93ff None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:45:04.514576 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ded62f3-8e6b-43c9-aaf7-16c400fe93ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:45:04.596945 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-8ded62f3-8e6b-43c9-aaf7-16c400fe93ff None None] MFA Rules not processed for user `b8e5d5f04c4741bb86ca4a0f667d4ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:45:04.598146 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-8ded62f3-8e6b-43c9-aaf7-16c400fe93ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:45:04.653779 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:45:04.685531 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 520/1049] 10.222.0.65 () {58 vars in 1060 bytes} [Thu Oct 27 09:45:04 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 09:45:04.693296 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827f40f7-212f-470a-ad16-b9ad6e2eada3 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:45:04.694886 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-827f40f7-212f-470a-ad16-b9ad6e2eada3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:45:04.754496 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:45:04.817875 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827f40f7-212f-470a-ad16-b9ad6e2eada3 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:45:04.918115 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158b8ad4-61a1-4d1f-90f6-49e613720f26 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8e5d5f04c4741bb86ca4a0f667d4ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc2e3a7a1bcc480891c0b433291c00b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:45:04.918862 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158b8ad4-61a1-4d1f-90f6-49e613720f26 service cinder] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:45:04.924149 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158b8ad4-61a1-4d1f-90f6-49e613720f26 service cinder] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:45:04.924149 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158b8ad4-61a1-4d1f-90f6-49e613720f26 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:45:04.924149 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-158b8ad4-61a1-4d1f-90f6-49e613720f26 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:45:05.026655 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:45:05.042272 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158b8ad4-61a1-4d1f-90f6-49e613720f26 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:45:05.044043 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158b8ad4-61a1-4d1f-90f6-49e613720f26 service cinder] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:45:05.065345 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 530/1050] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Oct 27 09:45:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 09:45:06.427841 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce4eb15-aaab-49f3-a5e0-978339b3ed91 None None] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:45:06.428976 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce4eb15-aaab-49f3-a5e0-978339b3ed91 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:45:06.429105 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce4eb15-aaab-49f3-a5e0-978339b3ed91 None None] PATH_INFO: `/` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:45:06.430573 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 521/1051] 10.222.0.65 () {54 vars in 927 bytes} [Thu Oct 27 09:45:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 09:45:06.436305 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293e1806-715c-48d9-81c4-2474a5589d09 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:45:06.436731 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293e1806-715c-48d9-81c4-2474a5589d09 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:45:06.436904 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293e1806-715c-48d9-81c4-2474a5589d09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:45:06.512447 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-293e1806-715c-48d9-81c4-2474a5589d09 None None] MFA Rules not processed for user `b5065084bf664b99bdeac46067cb0f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:45:06.513689 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-293e1806-715c-48d9-81c4-2474a5589d09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:45:06.614445 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 531/1052] 10.222.0.65 () {58 vars in 1024 bytes} [Thu Oct 27 09:45:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 09:45:06.919838 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce4eb15-aaab-49f3-a5e0-978339b3ed91 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:45:06.921401 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-cce4eb15-aaab-49f3-a5e0-978339b3ed91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:45:07.087592 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce4eb15-aaab-49f3-a5e0-978339b3ed91 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:45:07.148452 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:45:07.219938 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7c45f9-34ec-466f-96d2-f0d4146c3e4a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd0d23ef039d4f1591a589d302ef165f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc2e3a7a1bcc480891c0b433291c00b1', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:45:07.220546 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7c45f9-34ec-466f-96d2-f0d4146c3e4a service nova] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:45:07.220821 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7c45f9-34ec-466f-96d2-f0d4146c3e4a service nova] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:45:07.221148 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7c45f9-34ec-466f-96d2-f0d4146c3e4a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:45:07.222712 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-7e7c45f9-34ec-466f-96d2-f0d4146c3e4a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:45:07.326573 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7c45f9-34ec-466f-96d2-f0d4146c3e4a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:45:07.328116 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7c45f9-34ec-466f-96d2-f0d4146c3e4a service nova] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:45:07.348555 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 522/1053] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Oct 27 09:45:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 429 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 09:45:09.760778 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468ab99e-466e-41a9-8529-9bed67759688 None None] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:45:09.761353 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468ab99e-466e-41a9-8529-9bed67759688 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:45:09.761353 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468ab99e-466e-41a9-8529-9bed67759688 None None] PATH_INFO: `/` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:45:09.762961 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 532/1054] 10.222.0.65 () {54 vars in 927 bytes} [Thu Oct 27 09:45:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 09:45:09.768030 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b080d1-31e9-41d7-bb38-bf3d9faf2bf7 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:45:09.768438 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b080d1-31e9-41d7-bb38-bf3d9faf2bf7 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:45:09.768604 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b080d1-31e9-41d7-bb38-bf3d9faf2bf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:45:09.839228 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-60b080d1-31e9-41d7-bb38-bf3d9faf2bf7 None None] MFA Rules not processed for user `b5065084bf664b99bdeac46067cb0f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:45:09.843693 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-60b080d1-31e9-41d7-bb38-bf3d9faf2bf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:45:09.847770 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:45:09.945782 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 523/1055] 10.222.0.65 () {58 vars in 1024 bytes} [Thu Oct 27 09:45:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 09:45:10.237133 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468ab99e-466e-41a9-8529-9bed67759688 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:45:10.239025 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-468ab99e-466e-41a9-8529-9bed67759688 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:45:10.310215 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:45:10.411472 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468ab99e-466e-41a9-8529-9bed67759688 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:45:10.549602 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b6cfb5-7773-42ab-a9a8-1b368b3c2222 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd0d23ef039d4f1591a589d302ef165f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc2e3a7a1bcc480891c0b433291c00b1', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:45:10.550210 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b6cfb5-7773-42ab-a9a8-1b368b3c2222 service nova] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:45:10.550490 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b6cfb5-7773-42ab-a9a8-1b368b3c2222 service nova] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:45:10.551068 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b6cfb5-7773-42ab-a9a8-1b368b3c2222 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:45:10.552682 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-d1b6cfb5-7773-42ab-a9a8-1b368b3c2222 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:45:10.583850 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:45:10.663484 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b6cfb5-7773-42ab-a9a8-1b368b3c2222 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:45:10.665198 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b6cfb5-7773-42ab-a9a8-1b368b3c2222 service nova] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:45:10.685445 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 533/1056] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Oct 27 09:45:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 449 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 09:45:13.152526 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aca90d7-1f11-4d3a-a332-cc5762774457 None None] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:45:13.153117 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aca90d7-1f11-4d3a-a332-cc5762774457 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:45:13.153117 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aca90d7-1f11-4d3a-a332-cc5762774457 None None] PATH_INFO: `/` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:45:13.154550 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 524/1057] 10.222.0.65 () {54 vars in 927 bytes} [Thu Oct 27 09:45:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 09:45:13.159899 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4479e9d9-f8ba-4ef5-a31b-f9845e72c391 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:45:13.160473 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4479e9d9-f8ba-4ef5-a31b-f9845e72c391 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:45:13.160473 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4479e9d9-f8ba-4ef5-a31b-f9845e72c391 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:45:13.231731 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-4479e9d9-f8ba-4ef5-a31b-f9845e72c391 None None] MFA Rules not processed for user `b5065084bf664b99bdeac46067cb0f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:45:13.232953 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-4479e9d9-f8ba-4ef5-a31b-f9845e72c391 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:45:13.342260 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:45:13.348487 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 534/1058] 10.222.0.65 () {58 vars in 1024 bytes} [Thu Oct 27 09:45:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 09:45:13.635976 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aca90d7-1f11-4d3a-a332-cc5762774457 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:45:13.638141 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-8aca90d7-1f11-4d3a-a332-cc5762774457 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:45:13.796013 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:45:13.806763 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aca90d7-1f11-4d3a-a332-cc5762774457 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:45:13.927027 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53576e6-aa21-42fe-b420-2069f0f0f39d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd0d23ef039d4f1591a589d302ef165f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc2e3a7a1bcc480891c0b433291c00b1', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:45:13.927643 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53576e6-aa21-42fe-b420-2069f0f0f39d service nova] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:45:13.927944 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53576e6-aa21-42fe-b420-2069f0f0f39d service nova] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:45:13.928225 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53576e6-aa21-42fe-b420-2069f0f0f39d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:45:13.929849 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-f53576e6-aa21-42fe-b420-2069f0f0f39d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:45:14.026952 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53576e6-aa21-42fe-b420-2069f0f0f39d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:45:14.029563 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53576e6-aa21-42fe-b420-2069f0f0f39d service nova] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:45:14.039231 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:45:14.047960 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 525/1059] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Oct 27 09:45:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 09:45:16.426275 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36f9c5e-d620-425f-8cde-0641ecd1bf22 None None] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:45:16.426928 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36f9c5e-d620-425f-8cde-0641ecd1bf22 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:45:16.426928 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36f9c5e-d620-425f-8cde-0641ecd1bf22 None None] PATH_INFO: `/` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:45:16.428654 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 535/1060] 10.222.0.65 () {54 vars in 927 bytes} [Thu Oct 27 09:45:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 09:45:16.434197 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03acad5-2624-41f5-ae66-a68a7ab020bf None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:45:16.434673 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03acad5-2624-41f5-ae66-a68a7ab020bf None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:45:16.434802 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03acad5-2624-41f5-ae66-a68a7ab020bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:45:16.503468 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-a03acad5-2624-41f5-ae66-a68a7ab020bf None None] MFA Rules not processed for user `b5065084bf664b99bdeac46067cb0f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:45:16.504677 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-a03acad5-2624-41f5-ae66-a68a7ab020bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:45:16.618418 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 526/1061] 10.222.0.65 () {58 vars in 1024 bytes} [Thu Oct 27 09:45:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 09:45:16.913464 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36f9c5e-d620-425f-8cde-0641ecd1bf22 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:45:16.915076 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-b36f9c5e-d620-425f-8cde-0641ecd1bf22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:45:17.080870 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36f9c5e-d620-425f-8cde-0641ecd1bf22 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:45:17.155937 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:45:17.208459 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128dda5c-8d2b-4350-a6c0-a069783ea792 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd0d23ef039d4f1591a589d302ef165f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc2e3a7a1bcc480891c0b433291c00b1', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:45:17.209454 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128dda5c-8d2b-4350-a6c0-a069783ea792 service nova] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:45:17.209600 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128dda5c-8d2b-4350-a6c0-a069783ea792 service nova] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:45:17.209771 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128dda5c-8d2b-4350-a6c0-a069783ea792 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:45:17.211707 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-128dda5c-8d2b-4350-a6c0-a069783ea792 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:45:17.311021 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128dda5c-8d2b-4350-a6c0-a069783ea792 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:45:17.312697 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128dda5c-8d2b-4350-a6c0-a069783ea792 service nova] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:45:17.332214 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 536/1062] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Oct 27 09:45:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 09:45:19.526190 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f1a4ac-4d15-4233-be10-a25b921a55c8 None None] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:45:19.527010 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f1a4ac-4d15-4233-be10-a25b921a55c8 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:45:19.527010 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f1a4ac-4d15-4233-be10-a25b921a55c8 None None] PATH_INFO: `/` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:45:19.528311 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 527/1063] 10.222.0.65 () {54 vars in 927 bytes} [Thu Oct 27 09:45:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 09:45:19.534039 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f52521c-4b98-48f5-bd16-c488c374ebd2 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:45:19.534962 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f52521c-4b98-48f5-bd16-c488c374ebd2 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:45:19.535277 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f52521c-4b98-48f5-bd16-c488c374ebd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:45:19.610083 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-8f52521c-4b98-48f5-bd16-c488c374ebd2 None None] MFA Rules not processed for user `b5065084bf664b99bdeac46067cb0f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:45:19.611384 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-8f52521c-4b98-48f5-bd16-c488c374ebd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:45:19.648750 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:45:19.724422 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 537/1064] 10.222.0.65 () {58 vars in 1024 bytes} [Thu Oct 27 09:45:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 09:45:20.016130 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f1a4ac-4d15-4233-be10-a25b921a55c8 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:45:20.017658 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-77f1a4ac-4d15-4233-be10-a25b921a55c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:45:20.102693 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:45:20.181136 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f1a4ac-4d15-4233-be10-a25b921a55c8 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:45:20.314401 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9015c9-d013-45f5-96c8-cb4a04cb2d39 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd0d23ef039d4f1591a589d302ef165f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc2e3a7a1bcc480891c0b433291c00b1', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:45:20.315037 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9015c9-d013-45f5-96c8-cb4a04cb2d39 service nova] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:45:20.315317 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9015c9-d013-45f5-96c8-cb4a04cb2d39 service nova] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:45:20.315851 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9015c9-d013-45f5-96c8-cb4a04cb2d39 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:45:20.317435 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-2f9015c9-d013-45f5-96c8-cb4a04cb2d39 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:45:20.360511 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:45:20.416531 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9015c9-d013-45f5-96c8-cb4a04cb2d39 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:45:20.418261 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9015c9-d013-45f5-96c8-cb4a04cb2d39 service nova] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:45:20.438614 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 528/1065] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Oct 27 09:45:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 423 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 09:45:22.902313 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8811e5ca-eb4c-44a2-8c23-6420771482d1 None None] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:45:22.903018 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8811e5ca-eb4c-44a2-8c23-6420771482d1 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:45:22.903018 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8811e5ca-eb4c-44a2-8c23-6420771482d1 None None] PATH_INFO: `/` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:45:22.904245 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 538/1066] 10.222.0.65 () {54 vars in 927 bytes} [Thu Oct 27 09:45:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 09:45:22.909779 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b760ca-6491-47a6-a235-908154303123 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:45:22.910279 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b760ca-6491-47a6-a235-908154303123 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:45:22.910478 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b760ca-6491-47a6-a235-908154303123 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:45:22.984278 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-78b760ca-6491-47a6-a235-908154303123 None None] MFA Rules not processed for user `b5065084bf664b99bdeac46067cb0f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:45:22.985515 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-78b760ca-6491-47a6-a235-908154303123 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:45:23.090475 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 529/1067] 10.222.0.65 () {58 vars in 1024 bytes} [Thu Oct 27 09:45:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 09:45:23.407504 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8811e5ca-eb4c-44a2-8c23-6420771482d1 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:45:23.409019 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-8811e5ca-eb4c-44a2-8c23-6420771482d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:45:23.591055 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8811e5ca-eb4c-44a2-8c23-6420771482d1 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:45:23.609121 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:45:23.718745 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52582100-4b7e-4790-878b-f51201a55159 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd0d23ef039d4f1591a589d302ef165f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc2e3a7a1bcc480891c0b433291c00b1', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:45:23.719384 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52582100-4b7e-4790-878b-f51201a55159 service nova] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:45:23.719658 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52582100-4b7e-4790-878b-f51201a55159 service nova] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:45:23.719930 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52582100-4b7e-4790-878b-f51201a55159 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:45:23.721514 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-52582100-4b7e-4790-878b-f51201a55159 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:45:23.827437 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52582100-4b7e-4790-878b-f51201a55159 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:45:23.829200 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52582100-4b7e-4790-878b-f51201a55159 service nova] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:45:23.852651 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 539/1068] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Oct 27 09:45:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 446 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 09:45:26.224573 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca47e3c-0b76-46e5-9a0c-1072a70f6e93 None None] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:45:26.225198 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca47e3c-0b76-46e5-9a0c-1072a70f6e93 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:45:26.225198 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca47e3c-0b76-46e5-9a0c-1072a70f6e93 None None] PATH_INFO: `/` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:45:26.226544 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 530/1069] 10.222.0.65 () {54 vars in 927 bytes} [Thu Oct 27 09:45:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 09:45:26.232335 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c816316c-a0c2-44f0-b11d-a4cc865c2d48 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:45:26.232807 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c816316c-a0c2-44f0-b11d-a4cc865c2d48 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:45:26.232921 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c816316c-a0c2-44f0-b11d-a4cc865c2d48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:45:26.261292 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:45:26.308295 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-c816316c-a0c2-44f0-b11d-a4cc865c2d48 None None] MFA Rules not processed for user `b5065084bf664b99bdeac46067cb0f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:45:26.309529 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-c816316c-a0c2-44f0-b11d-a4cc865c2d48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:45:26.416180 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 540/1070] 10.222.0.65 () {58 vars in 1024 bytes} [Thu Oct 27 09:45:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 09:45:26.551305 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20984a37-71f2-4f2a-8bde-ca667238baa4 None None] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:45:26.551622 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20984a37-71f2-4f2a-8bde-ca667238baa4 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:45:26.552189 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20984a37-71f2-4f2a-8bde-ca667238baa4 None None] PATH_INFO: `/` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:45:26.553646 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 531/1071] 10.222.0.65 () {54 vars in 927 bytes} [Thu Oct 27 09:45:26 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 09:45:26.559276 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e59ce2-0f6f-41b5-8e82-7a84043a679a None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:45:26.559565 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e59ce2-0f6f-41b5-8e82-7a84043a679a None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:45:26.559839 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e59ce2-0f6f-41b5-8e82-7a84043a679a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:45:26.635430 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-09e59ce2-0f6f-41b5-8e82-7a84043a679a None None] MFA Rules not processed for user `b5065084bf664b99bdeac46067cb0f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:45:26.636663 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-09e59ce2-0f6f-41b5-8e82-7a84043a679a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:45:26.687816 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:45:26.711293 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20984a37-71f2-4f2a-8bde-ca667238baa4 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:45:26.712864 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-20984a37-71f2-4f2a-8bde-ca667238baa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:45:26.727166 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:45:26.737918 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 541/1072] 10.222.0.65 () {58 vars in 1024 bytes} [Thu Oct 27 09:45:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 09:45:26.870247 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20984a37-71f2-4f2a-8bde-ca667238baa4 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:45:26.960563 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:45:26.987582 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5adc575-7f10-4496-9534-22bcc73486b5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd0d23ef039d4f1591a589d302ef165f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc2e3a7a1bcc480891c0b433291c00b1', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:45:26.988186 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5adc575-7f10-4496-9534-22bcc73486b5 service nova] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:45:26.988470 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5adc575-7f10-4496-9534-22bcc73486b5 service nova] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:45:26.988747 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5adc575-7f10-4496-9534-22bcc73486b5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:45:26.991107 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-c5adc575-7f10-4496-9534-22bcc73486b5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:45:27.047323 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f8e689-5ae9-4d86-8bee-5ca09c18e61e None None] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:45:27.047619 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f8e689-5ae9-4d86-8bee-5ca09c18e61e None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:45:27.047898 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f8e689-5ae9-4d86-8bee-5ca09c18e61e None None] PATH_INFO: `/` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:45:27.049454 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 542/1073] 10.222.0.65 () {54 vars in 962 bytes} [Thu Oct 27 09:45:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 27 09:45:27.057258 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8955bd76-e869-4371-ab5e-1d2c8a02b3f5 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:45:27.057536 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8955bd76-e869-4371-ab5e-1d2c8a02b3f5 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:45:27.057887 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8955bd76-e869-4371-ab5e-1d2c8a02b3f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:45:27.093708 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5adc575-7f10-4496-9534-22bcc73486b5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:45:27.095455 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5adc575-7f10-4496-9534-22bcc73486b5 service nova] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:45:27.116234 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 532/1074] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Oct 27 09:45:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 09:45:27.142558 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-8955bd76-e869-4371-ab5e-1d2c8a02b3f5 None None] MFA Rules not processed for user `c4b0886666584397be686ee02a505269`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:45:27.143917 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-8955bd76-e869-4371-ab5e-1d2c8a02b3f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:45:27.227292 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 543/1075] 10.222.0.65 () {58 vars in 1059 bytes} [Thu Oct 27 09:45:27 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 09:45:27.235097 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5adc575-7f10-4496-9534-22bcc73486b5 service nova] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:45:27.236313 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-c5adc575-7f10-4496-9534-22bcc73486b5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:45:27.319574 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5adc575-7f10-4496-9534-22bcc73486b5 service nova] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:45:27.354892 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:45:27.411661 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5e9629-6393-4a14-a2b8-bc2ae1e0c0f3 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4b0886666584397be686ee02a505269', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc2e3a7a1bcc480891c0b433291c00b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:45:27.412467 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5e9629-6393-4a14-a2b8-bc2ae1e0c0f3 service glance] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:45:27.412677 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5e9629-6393-4a14-a2b8-bc2ae1e0c0f3 service glance] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:45:27.412951 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5e9629-6393-4a14-a2b8-bc2ae1e0c0f3 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:45:27.414866 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-7b5e9629-6393-4a14-a2b8-bc2ae1e0c0f3 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:45:27.545592 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5e9629-6393-4a14-a2b8-bc2ae1e0c0f3 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:45:27.547108 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5e9629-6393-4a14-a2b8-bc2ae1e0c0f3 service glance] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:45:27.567096 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 533/1076] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Oct 27 09:45:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 09:45:28.491753 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4301cf-f112-4c5b-ae1c-ac92688239ee None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:45:28.492287 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4301cf-f112-4c5b-ae1c-ac92688239ee None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:45:28.492418 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4301cf-f112-4c5b-ae1c-ac92688239ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:45:28.555748 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:45:28.564800 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-2f4301cf-f112-4c5b-ae1c-ac92688239ee None None] MFA Rules not processed for user `c18a92a796934277ad64a51ef3f7bb23`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:45:28.566275 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-2f4301cf-f112-4c5b-ae1c-ac92688239ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:45:28.661376 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 544/1077] 10.222.0.65 () {58 vars in 1009 bytes} [Thu Oct 27 09:45:28 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 09:45:28.710178 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b96eb5-b402-467b-a2f0-d69ab602971d None None] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:45:28.710803 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b96eb5-b402-467b-a2f0-d69ab602971d None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:45:28.710912 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b96eb5-b402-467b-a2f0-d69ab602971d None None] PATH_INFO: `/` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:45:28.712520 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 534/1078] 10.222.0.65 () {54 vars in 943 bytes} [Thu Oct 27 09:45:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 09:45:28.719517 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886a166e-3895-4602-9f05-fbb50d572093 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:45:28.719812 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886a166e-3895-4602-9f05-fbb50d572093 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:45:28.720121 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886a166e-3895-4602-9f05-fbb50d572093 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:45:28.799733 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-886a166e-3895-4602-9f05-fbb50d572093 None None] MFA Rules not processed for user `01e32fc35c8b467e9604b325cf1527aa`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:45:28.800951 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-886a166e-3895-4602-9f05-fbb50d572093 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:45:28.880778 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:45:28.921004 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 545/1079] 10.222.0.65 () {58 vars in 1040 bytes} [Thu Oct 27 09:45:28 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 09:45:28.930494 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b96eb5-b402-467b-a2f0-d69ab602971d None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:45:28.932033 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-b3b96eb5-b402-467b-a2f0-d69ab602971d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:45:28.996229 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:45:29.075397 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b96eb5-b402-467b-a2f0-d69ab602971d None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:45:29.185186 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bbebe0-72f5-4775-bb17-bc91150fd972 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e32fc35c8b467e9604b325cf1527aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc2e3a7a1bcc480891c0b433291c00b1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:45:29.185708 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bbebe0-72f5-4775-bb17-bc91150fd972 service swift] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:45:29.185989 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bbebe0-72f5-4775-bb17-bc91150fd972 service swift] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:45:29.186267 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bbebe0-72f5-4775-bb17-bc91150fd972 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:45:29.187942 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-13bbebe0-72f5-4775-bb17-bc91150fd972 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:45:29.236424 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:45:29.277138 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bbebe0-72f5-4775-bb17-bc91150fd972 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:45:29.278763 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bbebe0-72f5-4775-bb17-bc91150fd972 service swift] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:45:29.287026 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 535/1080] 10.222.0.65 () {60 vars in 1384 bytes} [Thu Oct 27 09:45:28 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 27 09:45:29.615530 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc1ec7a-6292-42a9-ad77-f2bc021de296 None None] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:45:29.616369 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc1ec7a-6292-42a9-ad77-f2bc021de296 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:45:29.616550 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc1ec7a-6292-42a9-ad77-f2bc021de296 None None] PATH_INFO: `/` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:45:29.617905 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 546/1081] 10.222.0.65 () {54 vars in 927 bytes} [Thu Oct 27 09:45:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 09:45:29.623627 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988230a0-a4f0-480e-9027-b494f8cde988 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:45:29.627176 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988230a0-a4f0-480e-9027-b494f8cde988 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:45:29.627176 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988230a0-a4f0-480e-9027-b494f8cde988 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:45:29.702632 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-988230a0-a4f0-480e-9027-b494f8cde988 None None] MFA Rules not processed for user `b5065084bf664b99bdeac46067cb0f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:45:29.704015 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-988230a0-a4f0-480e-9027-b494f8cde988 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:45:29.824202 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 536/1082] 10.222.0.65 () {58 vars in 1024 bytes} [Thu Oct 27 09:45:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 09:45:30.131449 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc1ec7a-6292-42a9-ad77-f2bc021de296 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:45:30.132984 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-6cc1ec7a-6292-42a9-ad77-f2bc021de296 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:45:30.311947 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc1ec7a-6292-42a9-ad77-f2bc021de296 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:45:30.370229 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:45:30.448101 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5c91ee-7e9d-4eda-a4b1-67fff86d9afe service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd0d23ef039d4f1591a589d302ef165f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc2e3a7a1bcc480891c0b433291c00b1', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:45:30.448823 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5c91ee-7e9d-4eda-a4b1-67fff86d9afe service nova] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:45:30.449110 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5c91ee-7e9d-4eda-a4b1-67fff86d9afe service nova] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:45:30.449402 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5c91ee-7e9d-4eda-a4b1-67fff86d9afe service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:45:30.451036 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-7c5c91ee-7e9d-4eda-a4b1-67fff86d9afe service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:45:30.556303 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5c91ee-7e9d-4eda-a4b1-67fff86d9afe service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:45:30.558009 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5c91ee-7e9d-4eda-a4b1-67fff86d9afe service nova] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:45:30.581962 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 547/1083] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Oct 27 09:45:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 453 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 09:45:33.086924 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee54d123-6e79-459a-ac8e-8250eb67b6a6 None None] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:45:33.087874 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee54d123-6e79-459a-ac8e-8250eb67b6a6 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:45:33.088339 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee54d123-6e79-459a-ac8e-8250eb67b6a6 None None] PATH_INFO: `/` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:45:33.090005 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 537/1084] 10.222.0.65 () {54 vars in 927 bytes} [Thu Oct 27 09:45:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 09:45:33.099037 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c40bd19-6305-443e-a93c-acd72385c9a0 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:45:33.099037 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c40bd19-6305-443e-a93c-acd72385c9a0 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:45:33.099037 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c40bd19-6305-443e-a93c-acd72385c9a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:45:33.172300 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-6c40bd19-6305-443e-a93c-acd72385c9a0 None None] MFA Rules not processed for user `b5065084bf664b99bdeac46067cb0f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:45:33.173605 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-6c40bd19-6305-443e-a93c-acd72385c9a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:45:33.177268 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:45:33.306562 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 548/1085] 10.222.0.65 () {58 vars in 1024 bytes} [Thu Oct 27 09:45:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 09:45:33.609996 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee54d123-6e79-459a-ac8e-8250eb67b6a6 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:45:33.611566 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-ee54d123-6e79-459a-ac8e-8250eb67b6a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:45:33.663625 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:45:33.786034 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee54d123-6e79-459a-ac8e-8250eb67b6a6 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:45:33.923763 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:45:33.926026 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76ec3ea-ce48-4a77-80b0-32917563125e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd0d23ef039d4f1591a589d302ef165f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc2e3a7a1bcc480891c0b433291c00b1', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:45:33.927258 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76ec3ea-ce48-4a77-80b0-32917563125e service nova] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:45:33.927528 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76ec3ea-ce48-4a77-80b0-32917563125e service nova] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:45:33.927805 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76ec3ea-ce48-4a77-80b0-32917563125e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:45:33.929598 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-a76ec3ea-ce48-4a77-80b0-32917563125e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:45:34.037148 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76ec3ea-ce48-4a77-80b0-32917563125e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:45:34.039054 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76ec3ea-ce48-4a77-80b0-32917563125e service nova] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:45:34.061843 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 538/1086] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Oct 27 09:45:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 452 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 09:45:43.306185 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=41 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:45:44.059196 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=46 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:45:53.956759 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d04c88-bedb-4849-83da-2229bca42ce4 None None] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:45:53.957340 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d04c88-bedb-4849-83da-2229bca42ce4 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:45:53.957340 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d04c88-bedb-4849-83da-2229bca42ce4 None None] PATH_INFO: `/` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:45:53.958740 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 549/1087] 10.222.0.65 () {54 vars in 918 bytes} [Thu Oct 27 09:45:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 27 09:45:53.964909 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb967c9-0ead-4667-bcc9-7cef3f58ffd8 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:45:53.965454 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb967c9-0ead-4667-bcc9-7cef3f58ffd8 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:45:53.965454 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb967c9-0ead-4667-bcc9-7cef3f58ffd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:45:54.046472 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-1cb967c9-0ead-4667-bcc9-7cef3f58ffd8 None None] MFA Rules not processed for user `f8c47ff5d72943f6bab09b5df6198d64`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:45:54.047724 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-1cb967c9-0ead-4667-bcc9-7cef3f58ffd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:45:54.156124 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 539/1088] 10.222.0.65 () {58 vars in 1015 bytes} [Thu Oct 27 09:45:53 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 09:45:54.171360 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44991b83-b1e4-41bd-88de-096ccc7fe80d None None] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:45:54.171642 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44991b83-b1e4-41bd-88de-096ccc7fe80d None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:45:54.171916 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44991b83-b1e4-41bd-88de-096ccc7fe80d None None] PATH_INFO: `/` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:45:54.173257 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 550/1089] 10.222.0.65 () {54 vars in 918 bytes} [Thu Oct 27 09:45:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 09:45:54.178461 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97eb8f8-92c0-47ed-89d8-3b99118fc2d1 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:45:54.178772 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97eb8f8-92c0-47ed-89d8-3b99118fc2d1 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:45:54.179051 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97eb8f8-92c0-47ed-89d8-3b99118fc2d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:45:54.256022 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:45:54.259158 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-b97eb8f8-92c0-47ed-89d8-3b99118fc2d1 None None] MFA Rules not processed for user `fd0d23ef039d4f1591a589d302ef165f`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:45:54.260375 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-b97eb8f8-92c0-47ed-89d8-3b99118fc2d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:45:54.381582 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 540/1090] 10.222.0.65 () {58 vars in 1015 bytes} [Thu Oct 27 09:45:54 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 09:45:57.015522 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ef7a98-8a01-4d04-9ff6-e65487a85bd2 None None] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:45:57.016056 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ef7a98-8a01-4d04-9ff6-e65487a85bd2 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:45:57.016056 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ef7a98-8a01-4d04-9ff6-e65487a85bd2 None None] PATH_INFO: `/` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:45:57.017418 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 551/1091] 127.0.0.1 () {54 vars in 917 bytes} [Thu Oct 27 09:45:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 09:45:57.023833 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f24cbde-bafd-4ee5-8843-08f5ba5e52ef None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:45:57.024330 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f24cbde-bafd-4ee5-8843-08f5ba5e52ef None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:45:57.024436 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f24cbde-bafd-4ee5-8843-08f5ba5e52ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:45:57.098419 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-0f24cbde-bafd-4ee5-8843-08f5ba5e52ef None None] MFA Rules not processed for user `b5065084bf664b99bdeac46067cb0f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:45:57.099593 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-0f24cbde-bafd-4ee5-8843-08f5ba5e52ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:45:57.155639 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:45:57.199940 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 541/1092] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Oct 27 09:45:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 09:45:57.504821 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ef7a98-8a01-4d04-9ff6-e65487a85bd2 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:45:57.506561 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-05ef7a98-8a01-4d04-9ff6-e65487a85bd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:45:57.661213 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ef7a98-8a01-4d04-9ff6-e65487a85bd2 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:45:57.735306 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:45:57.776030 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08557a1-dbe4-4558-a223-9db1daefe58e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd0d23ef039d4f1591a589d302ef165f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc2e3a7a1bcc480891c0b433291c00b1', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:45:57.776668 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08557a1-dbe4-4558-a223-9db1daefe58e service nova] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:45:57.776949 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08557a1-dbe4-4558-a223-9db1daefe58e service nova] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:45:57.777225 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08557a1-dbe4-4558-a223-9db1daefe58e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:45:57.778854 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-a08557a1-dbe4-4558-a223-9db1daefe58e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:45:57.870891 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08557a1-dbe4-4558-a223-9db1daefe58e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:45:57.872497 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08557a1-dbe4-4558-a223-9db1daefe58e service nova] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:45:57.890547 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 552/1093] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Oct 27 09:45:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 09:45:59.028940 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a82601-b740-45a9-a787-83e6fb791db5 None None] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:45:59.029482 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a82601-b740-45a9-a787-83e6fb791db5 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:45:59.029482 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a82601-b740-45a9-a787-83e6fb791db5 None None] PATH_INFO: `/` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:45:59.030858 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 542/1094] 127.0.0.1 () {54 vars in 901 bytes} [Thu Oct 27 09:45:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 09:45:59.035811 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dfa9d2-33a4-4f43-af02-b8211dfc2fa6 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:45:59.039952 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dfa9d2-33a4-4f43-af02-b8211dfc2fa6 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:45:59.039952 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dfa9d2-33a4-4f43-af02-b8211dfc2fa6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:45:59.113090 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-28dfa9d2-33a4-4f43-af02-b8211dfc2fa6 None None] MFA Rules not processed for user `b5065084bf664b99bdeac46067cb0f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:45:59.114259 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-28dfa9d2-33a4-4f43-af02-b8211dfc2fa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:45:59.141714 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:45:59.216199 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 553/1095] 127.0.0.1 () {58 vars in 998 bytes} [Thu Oct 27 09:45:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 09:45:59.374054 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a82601-b740-45a9-a787-83e6fb791db5 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:45:59.375547 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-b9a82601-b740-45a9-a787-83e6fb791db5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:45:59.528058 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a82601-b740-45a9-a787-83e6fb791db5 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:45:59.570495 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:45:59.647884 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772d5af1-23c8-4792-b2a2-8de83ff9fcc5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd0d23ef039d4f1591a589d302ef165f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc2e3a7a1bcc480891c0b433291c00b1', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:45:59.648493 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772d5af1-23c8-4792-b2a2-8de83ff9fcc5 service nova] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:45:59.648781 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772d5af1-23c8-4792-b2a2-8de83ff9fcc5 service nova] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:45:59.649058 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772d5af1-23c8-4792-b2a2-8de83ff9fcc5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:45:59.650686 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-772d5af1-23c8-4792-b2a2-8de83ff9fcc5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:45:59.743474 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772d5af1-23c8-4792-b2a2-8de83ff9fcc5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:45:59.745091 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772d5af1-23c8-4792-b2a2-8de83ff9fcc5 service nova] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:45:59.763586 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 543/1096] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Oct 27 09:45:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 09:46:00.897793 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e082d58d-8066-4b72-b444-76911abe9e08 None None] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:46:00.898389 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e082d58d-8066-4b72-b444-76911abe9e08 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:46:00.898389 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e082d58d-8066-4b72-b444-76911abe9e08 None None] PATH_INFO: `/` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:46:00.899813 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 554/1097] 127.0.0.1 () {54 vars in 901 bytes} [Thu Oct 27 09:46:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 09:46:00.904990 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88091e21-679d-484c-ab84-be07b67cfc5c None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:46:00.905424 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88091e21-679d-484c-ab84-be07b67cfc5c None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:46:00.905545 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88091e21-679d-484c-ab84-be07b67cfc5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:46:00.963686 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:46:00.988050 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-88091e21-679d-484c-ab84-be07b67cfc5c None None] MFA Rules not processed for user `b5065084bf664b99bdeac46067cb0f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:46:00.989265 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-88091e21-679d-484c-ab84-be07b67cfc5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:46:01.088138 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 544/1098] 127.0.0.1 () {58 vars in 998 bytes} [Thu Oct 27 09:46:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 09:46:01.242212 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e082d58d-8066-4b72-b444-76911abe9e08 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:46:01.243709 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-e082d58d-8066-4b72-b444-76911abe9e08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:46:01.396995 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e082d58d-8066-4b72-b444-76911abe9e08 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:46:01.409698 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:46:01.510009 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ad8f1e-dfce-480a-853e-39cdb99137e9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd0d23ef039d4f1591a589d302ef165f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc2e3a7a1bcc480891c0b433291c00b1', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:46:01.510645 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ad8f1e-dfce-480a-853e-39cdb99137e9 service nova] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:46:01.510929 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ad8f1e-dfce-480a-853e-39cdb99137e9 service nova] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:46:01.511204 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ad8f1e-dfce-480a-853e-39cdb99137e9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:46:01.512799 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-d9ad8f1e-dfce-480a-853e-39cdb99137e9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:46:01.604955 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ad8f1e-dfce-480a-853e-39cdb99137e9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:46:01.606600 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ad8f1e-dfce-480a-853e-39cdb99137e9 service nova] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:46:01.625054 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 555/1099] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Oct 27 09:46:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 09:46:02.727970 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998432b4-0d35-4fde-a1d9-b03bb0f69ad1 None None] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:46:02.728506 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998432b4-0d35-4fde-a1d9-b03bb0f69ad1 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:46:02.728506 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998432b4-0d35-4fde-a1d9-b03bb0f69ad1 None None] PATH_INFO: `/` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:46:02.729871 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 545/1100] 127.0.0.1 () {54 vars in 901 bytes} [Thu Oct 27 09:46:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 09:46:02.734941 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e30f82-0144-4427-8854-4bcc616b7f7f None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:46:02.735374 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e30f82-0144-4427-8854-4bcc616b7f7f None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:46:02.735481 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e30f82-0144-4427-8854-4bcc616b7f7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:46:02.756118 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:46:02.813100 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-42e30f82-0144-4427-8854-4bcc616b7f7f None None] MFA Rules not processed for user `b5065084bf664b99bdeac46067cb0f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:46:02.814295 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-42e30f82-0144-4427-8854-4bcc616b7f7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:46:02.913465 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 556/1101] 127.0.0.1 () {58 vars in 998 bytes} [Thu Oct 27 09:46:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 09:46:03.068284 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998432b4-0d35-4fde-a1d9-b03bb0f69ad1 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:46:03.069849 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-998432b4-0d35-4fde-a1d9-b03bb0f69ad1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:46:03.188757 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:46:03.231734 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998432b4-0d35-4fde-a1d9-b03bb0f69ad1 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:46:03.370752 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04986522-e7a9-48ed-a561-fed61135b31e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd0d23ef039d4f1591a589d302ef165f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc2e3a7a1bcc480891c0b433291c00b1', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:46:03.371661 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04986522-e7a9-48ed-a561-fed61135b31e service nova] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:46:03.371948 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04986522-e7a9-48ed-a561-fed61135b31e service nova] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:46:03.372229 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04986522-e7a9-48ed-a561-fed61135b31e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:46:03.374082 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-04986522-e7a9-48ed-a561-fed61135b31e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:46:03.482191 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:46:03.499964 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04986522-e7a9-48ed-a561-fed61135b31e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:46:03.504460 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04986522-e7a9-48ed-a561-fed61135b31e service nova] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:46:03.525106 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 546/1102] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Oct 27 09:46:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 457 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 09:46:04.690564 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a710325-9ebd-4be9-9d50-cb68fa5706e4 None None] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:46:04.691080 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a710325-9ebd-4be9-9d50-cb68fa5706e4 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:46:04.691196 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a710325-9ebd-4be9-9d50-cb68fa5706e4 None None] PATH_INFO: `/` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:46:04.692536 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 557/1103] 127.0.0.1 () {54 vars in 901 bytes} [Thu Oct 27 09:46:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 09:46:04.697487 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0079791-55cc-404e-996c-8ed6a3501d88 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:46:04.697913 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0079791-55cc-404e-996c-8ed6a3501d88 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:46:04.698039 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0079791-55cc-404e-996c-8ed6a3501d88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:46:04.778439 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-f0079791-55cc-404e-996c-8ed6a3501d88 None None] MFA Rules not processed for user `b5065084bf664b99bdeac46067cb0f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:46:04.779684 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-f0079791-55cc-404e-996c-8ed6a3501d88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:46:04.883503 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 547/1104] 127.0.0.1 () {58 vars in 998 bytes} [Thu Oct 27 09:46:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 09:46:05.043756 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a710325-9ebd-4be9-9d50-cb68fa5706e4 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:46:05.045282 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-7a710325-9ebd-4be9-9d50-cb68fa5706e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:46:05.134764 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:46:05.200219 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a710325-9ebd-4be9-9d50-cb68fa5706e4 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:46:05.315761 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2a49dc-86af-4ab1-a549-14f619e03423 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd0d23ef039d4f1591a589d302ef165f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc2e3a7a1bcc480891c0b433291c00b1', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:46:05.316362 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2a49dc-86af-4ab1-a549-14f619e03423 service nova] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:46:05.316640 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2a49dc-86af-4ab1-a549-14f619e03423 service nova] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:46:05.316909 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2a49dc-86af-4ab1-a549-14f619e03423 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:46:05.318496 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-ed2a49dc-86af-4ab1-a549-14f619e03423 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:46:05.367989 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:46:05.412157 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2a49dc-86af-4ab1-a549-14f619e03423 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:46:05.413767 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2a49dc-86af-4ab1-a549-14f619e03423 service nova] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:46:05.433238 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 558/1105] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Oct 27 09:46:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 09:46:06.554648 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f397957a-1481-4e83-9438-6f116d95c86e None None] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:46:06.555222 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f397957a-1481-4e83-9438-6f116d95c86e None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:46:06.555222 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f397957a-1481-4e83-9438-6f116d95c86e None None] PATH_INFO: `/` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:46:06.556640 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 548/1106] 127.0.0.1 () {54 vars in 901 bytes} [Thu Oct 27 09:46:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 09:46:06.561463 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33168f7-482b-4c13-b89d-8ac52574b302 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:46:06.561878 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33168f7-482b-4c13-b89d-8ac52574b302 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:46:06.562023 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33168f7-482b-4c13-b89d-8ac52574b302 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:46:06.641838 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-c33168f7-482b-4c13-b89d-8ac52574b302 None None] MFA Rules not processed for user `b5065084bf664b99bdeac46067cb0f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:46:06.643665 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-c33168f7-482b-4c13-b89d-8ac52574b302 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:46:06.740912 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 559/1107] 127.0.0.1 () {58 vars in 998 bytes} [Thu Oct 27 09:46:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 09:46:06.892490 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f397957a-1481-4e83-9438-6f116d95c86e None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:46:06.894303 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-f397957a-1481-4e83-9438-6f116d95c86e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:46:06.946045 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:46:07.046674 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f397957a-1481-4e83-9438-6f116d95c86e None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:46:07.167787 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7ea8be-dfff-4886-a8d2-165913fcf245 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd0d23ef039d4f1591a589d302ef165f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc2e3a7a1bcc480891c0b433291c00b1', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:46:07.168392 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7ea8be-dfff-4886-a8d2-165913fcf245 service nova] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:46:07.168671 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7ea8be-dfff-4886-a8d2-165913fcf245 service nova] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:46:07.168939 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7ea8be-dfff-4886-a8d2-165913fcf245 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:46:07.170540 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-9b7ea8be-dfff-4886-a8d2-165913fcf245 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:46:07.178196 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:46:07.263554 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7ea8be-dfff-4886-a8d2-165913fcf245 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:46:07.265107 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7ea8be-dfff-4886-a8d2-165913fcf245 service nova] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:46:07.282702 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 549/1108] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Oct 27 09:46:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 09:46:08.388206 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f926a19-b36b-46bb-b61a-c5b65122f3a7 None None] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:46:08.388875 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f926a19-b36b-46bb-b61a-c5b65122f3a7 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:46:08.388875 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f926a19-b36b-46bb-b61a-c5b65122f3a7 None None] PATH_INFO: `/` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:46:08.390067 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 560/1109] 127.0.0.1 () {54 vars in 901 bytes} [Thu Oct 27 09:46:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 09:46:08.395832 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52e1828-c7b3-4ce6-88c6-ffc4e3ed6742 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:46:08.396283 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52e1828-c7b3-4ce6-88c6-ffc4e3ed6742 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:46:08.396381 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52e1828-c7b3-4ce6-88c6-ffc4e3ed6742 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:46:08.474527 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-e52e1828-c7b3-4ce6-88c6-ffc4e3ed6742 None None] MFA Rules not processed for user `b5065084bf664b99bdeac46067cb0f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:46:08.475834 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-e52e1828-c7b3-4ce6-88c6-ffc4e3ed6742 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:46:08.543589 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:46:08.573258 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 550/1110] 127.0.0.1 () {58 vars in 998 bytes} [Thu Oct 27 09:46:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 09:46:08.724118 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f926a19-b36b-46bb-b61a-c5b65122f3a7 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:46:08.725679 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-7f926a19-b36b-46bb-b61a-c5b65122f3a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:46:08.742990 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:46:08.872165 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f926a19-b36b-46bb-b61a-c5b65122f3a7 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:46:08.959183 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:46:08.988832 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7f81e4-b8f6-4c61-a12a-88c9c404ede1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd0d23ef039d4f1591a589d302ef165f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc2e3a7a1bcc480891c0b433291c00b1', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:46:08.989336 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7f81e4-b8f6-4c61-a12a-88c9c404ede1 service nova] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:46:08.989611 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7f81e4-b8f6-4c61-a12a-88c9c404ede1 service nova] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:46:08.989883 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7f81e4-b8f6-4c61-a12a-88c9c404ede1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:46:08.992354 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-eb7f81e4-b8f6-4c61-a12a-88c9c404ede1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:46:09.084063 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7f81e4-b8f6-4c61-a12a-88c9c404ede1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:46:09.085661 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7f81e4-b8f6-4c61-a12a-88c9c404ede1 service nova] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:46:09.103706 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 561/1111] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Oct 27 09:46:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 09:46:10.197517 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c8319b-014c-4d56-a909-36c157b527f9 None None] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:46:10.198062 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c8319b-014c-4d56-a909-36c157b527f9 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:46:10.198062 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c8319b-014c-4d56-a909-36c157b527f9 None None] PATH_INFO: `/` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:46:10.199437 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 551/1112] 127.0.0.1 () {54 vars in 901 bytes} [Thu Oct 27 09:46:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 09:46:10.204322 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e679ba0e-ff31-4080-bc56-175fc7bcf358 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:46:10.204755 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e679ba0e-ff31-4080-bc56-175fc7bcf358 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:46:10.205481 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e679ba0e-ff31-4080-bc56-175fc7bcf358 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:46:10.284527 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-e679ba0e-ff31-4080-bc56-175fc7bcf358 None None] MFA Rules not processed for user `b5065084bf664b99bdeac46067cb0f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:46:10.285769 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-e679ba0e-ff31-4080-bc56-175fc7bcf358 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:46:10.327999 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:46:10.384849 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 562/1113] 127.0.0.1 () {58 vars in 998 bytes} [Thu Oct 27 09:46:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 09:46:10.540830 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c8319b-014c-4d56-a909-36c157b527f9 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:46:10.542255 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-05c8319b-014c-4d56-a909-36c157b527f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:46:10.690989 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c8319b-014c-4d56-a909-36c157b527f9 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:46:10.747349 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:46:10.807445 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99222f3b-7ee5-47fe-859c-2523696dfea4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd0d23ef039d4f1591a589d302ef165f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc2e3a7a1bcc480891c0b433291c00b1', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:46:10.807996 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99222f3b-7ee5-47fe-859c-2523696dfea4 service nova] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:46:10.808276 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99222f3b-7ee5-47fe-859c-2523696dfea4 service nova] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:46:10.808550 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99222f3b-7ee5-47fe-859c-2523696dfea4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:46:10.810145 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-99222f3b-7ee5-47fe-859c-2523696dfea4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:46:10.902076 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99222f3b-7ee5-47fe-859c-2523696dfea4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:46:10.903734 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99222f3b-7ee5-47fe-859c-2523696dfea4 service nova] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:46:10.921690 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 552/1114] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Oct 27 09:46:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 09:46:12.082702 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a0f78c-c429-4f06-863f-de1ced3891c6 None None] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:46:12.083293 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a0f78c-c429-4f06-863f-de1ced3891c6 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:46:12.083293 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a0f78c-c429-4f06-863f-de1ced3891c6 None None] PATH_INFO: `/` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:46:12.084584 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 563/1115] 127.0.0.1 () {54 vars in 901 bytes} [Thu Oct 27 09:46:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 09:46:12.089575 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee237d0-0599-4079-8a8b-b138c05e4fba None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:46:12.090036 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee237d0-0599-4079-8a8b-b138c05e4fba None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:46:12.090142 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee237d0-0599-4079-8a8b-b138c05e4fba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:46:12.175523 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-eee237d0-0599-4079-8a8b-b138c05e4fba None None] MFA Rules not processed for user `b5065084bf664b99bdeac46067cb0f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:46:12.176739 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-eee237d0-0599-4079-8a8b-b138c05e4fba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:46:12.178801 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:46:12.274366 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 553/1116] 127.0.0.1 () {58 vars in 998 bytes} [Thu Oct 27 09:46:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 09:46:12.426621 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a0f78c-c429-4f06-863f-de1ced3891c6 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:46:12.428134 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-b4a0f78c-c429-4f06-863f-de1ced3891c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:46:12.574257 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a0f78c-c429-4f06-863f-de1ced3891c6 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:46:12.601912 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:46:12.688433 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad654df0-4dc6-4460-812b-23d435bc178b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd0d23ef039d4f1591a589d302ef165f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc2e3a7a1bcc480891c0b433291c00b1', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:46:12.688954 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad654df0-4dc6-4460-812b-23d435bc178b service nova] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:46:12.689239 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad654df0-4dc6-4460-812b-23d435bc178b service nova] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:46:12.689607 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad654df0-4dc6-4460-812b-23d435bc178b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:46:12.691740 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-ad654df0-4dc6-4460-812b-23d435bc178b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:46:12.780844 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad654df0-4dc6-4460-812b-23d435bc178b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:46:12.782448 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad654df0-4dc6-4460-812b-23d435bc178b service nova] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:46:12.801090 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 564/1117] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Oct 27 09:46:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 09:46:14.881952 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e0c49d-5a18-4067-89e4-5b72040cf9d9 None None] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:46:14.882566 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e0c49d-5a18-4067-89e4-5b72040cf9d9 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:46:14.882566 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e0c49d-5a18-4067-89e4-5b72040cf9d9 None None] PATH_INFO: `/` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:46:14.883802 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 554/1118] 127.0.0.1 () {54 vars in 917 bytes} [Thu Oct 27 09:46:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 09:46:14.889149 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47717caa-691c-4146-9df1-18ed50ce0fcd None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:46:14.889568 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47717caa-691c-4146-9df1-18ed50ce0fcd None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:46:14.889679 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47717caa-691c-4146-9df1-18ed50ce0fcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:46:14.931714 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:46:14.959197 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-47717caa-691c-4146-9df1-18ed50ce0fcd None None] MFA Rules not processed for user `b5065084bf664b99bdeac46067cb0f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:46:14.960435 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-47717caa-691c-4146-9df1-18ed50ce0fcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:46:15.068521 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 565/1119] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Oct 27 09:46:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 09:46:15.358735 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e0c49d-5a18-4067-89e4-5b72040cf9d9 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:46:15.361041 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-58e0c49d-5a18-4067-89e4-5b72040cf9d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:46:15.468821 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e0c49d-5a18-4067-89e4-5b72040cf9d9 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:46:15.503964 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:46:15.545890 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b79828-8cdc-4ea3-b827-757a16ce808d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6191cc41efa74f46b49022cf387f7a4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc2e3a7a1bcc480891c0b433291c00b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:46:15.546482 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b79828-8cdc-4ea3-b827-757a16ce808d service neutron] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:46:15.546794 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b79828-8cdc-4ea3-b827-757a16ce808d service neutron] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:46:15.547066 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b79828-8cdc-4ea3-b827-757a16ce808d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:46:15.548664 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-d8b79828-8cdc-4ea3-b827-757a16ce808d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:46:15.663234 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b79828-8cdc-4ea3-b827-757a16ce808d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:46:15.664666 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b79828-8cdc-4ea3-b827-757a16ce808d service neutron] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:46:15.684102 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 555/1120] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Oct 27 09:46:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 09:46:18.052873 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272a37cf-7f44-4fd9-8de4-baf39da583aa None None] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:46:18.053434 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272a37cf-7f44-4fd9-8de4-baf39da583aa None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:46:18.053434 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272a37cf-7f44-4fd9-8de4-baf39da583aa None None] PATH_INFO: `/` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:46:18.054777 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 566/1121] 127.0.0.1 () {54 vars in 917 bytes} [Thu Oct 27 09:46:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 09:46:18.060118 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ecfcd5-9126-45ca-abeb-fd4194f7417f None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:46:18.063224 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ecfcd5-9126-45ca-abeb-fd4194f7417f None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:46:18.063224 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ecfcd5-9126-45ca-abeb-fd4194f7417f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:46:18.136365 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-70ecfcd5-9126-45ca-abeb-fd4194f7417f None None] MFA Rules not processed for user `b5065084bf664b99bdeac46067cb0f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:46:18.137509 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-70ecfcd5-9126-45ca-abeb-fd4194f7417f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:46:18.150952 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:46:18.237494 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 556/1122] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Oct 27 09:46:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 09:46:18.523129 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272a37cf-7f44-4fd9-8de4-baf39da583aa None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:46:18.524684 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-272a37cf-7f44-4fd9-8de4-baf39da583aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:46:18.629294 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272a37cf-7f44-4fd9-8de4-baf39da583aa None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:46:18.642793 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:46:18.704182 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f413c0-742a-4df7-806f-9bf403f56fb0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6191cc41efa74f46b49022cf387f7a4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc2e3a7a1bcc480891c0b433291c00b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:46:18.705316 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f413c0-742a-4df7-806f-9bf403f56fb0 service neutron] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:46:18.705595 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f413c0-742a-4df7-806f-9bf403f56fb0 service neutron] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:46:18.705957 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f413c0-742a-4df7-806f-9bf403f56fb0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:46:18.707591 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-e5f413c0-742a-4df7-806f-9bf403f56fb0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:46:18.817710 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f413c0-742a-4df7-806f-9bf403f56fb0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:46:18.819084 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f413c0-742a-4df7-806f-9bf403f56fb0 service neutron] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:46:18.837445 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 567/1123] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Oct 27 09:46:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 09:46:21.400564 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e359c28-660c-471a-bf57-dd0a2e25458d None None] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:46:21.401203 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e359c28-660c-471a-bf57-dd0a2e25458d None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:46:21.401203 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e359c28-660c-471a-bf57-dd0a2e25458d None None] PATH_INFO: `/` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:46:21.402571 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 557/1124] 127.0.0.1 () {54 vars in 917 bytes} [Thu Oct 27 09:46:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 09:46:21.410264 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8caa88d8-bfb0-4cf0-8844-7a2286e10058 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:46:21.410264 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8caa88d8-bfb0-4cf0-8844-7a2286e10058 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:46:21.410862 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8caa88d8-bfb0-4cf0-8844-7a2286e10058 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:46:21.460013 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:46:21.478187 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-8caa88d8-bfb0-4cf0-8844-7a2286e10058 None None] MFA Rules not processed for user `b5065084bf664b99bdeac46067cb0f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:46:21.479451 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-8caa88d8-bfb0-4cf0-8844-7a2286e10058 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:46:21.582581 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 568/1125] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Oct 27 09:46:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 09:46:21.873280 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e359c28-660c-471a-bf57-dd0a2e25458d None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:46:21.874865 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-8e359c28-660c-471a-bf57-dd0a2e25458d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:46:21.984580 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e359c28-660c-471a-bf57-dd0a2e25458d None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:46:22.026492 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:46:22.059978 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff735873-fe35-49a1-845a-4d26d547ba4f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6191cc41efa74f46b49022cf387f7a4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc2e3a7a1bcc480891c0b433291c00b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:46:22.060580 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff735873-fe35-49a1-845a-4d26d547ba4f service neutron] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:46:22.060861 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff735873-fe35-49a1-845a-4d26d547ba4f service neutron] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:46:22.061400 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff735873-fe35-49a1-845a-4d26d547ba4f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:46:22.063023 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-ff735873-fe35-49a1-845a-4d26d547ba4f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:46:22.178160 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff735873-fe35-49a1-845a-4d26d547ba4f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:46:22.179639 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff735873-fe35-49a1-845a-4d26d547ba4f service neutron] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:46:22.198979 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 558/1126] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Oct 27 09:46:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 09:46:24.545608 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345e22b7-10a0-4c2a-8294-3604814b3f56 None None] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:46:24.546227 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345e22b7-10a0-4c2a-8294-3604814b3f56 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:46:24.546802 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345e22b7-10a0-4c2a-8294-3604814b3f56 None None] PATH_INFO: `/` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:46:24.549251 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 569/1127] 127.0.0.1 () {54 vars in 917 bytes} [Thu Oct 27 09:46:24 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 09:46:24.554874 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4baca569-7134-4062-b47e-b6a1ecc4cb94 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:46:24.555345 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4baca569-7134-4062-b47e-b6a1ecc4cb94 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:46:24.555453 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4baca569-7134-4062-b47e-b6a1ecc4cb94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:46:24.624501 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-4baca569-7134-4062-b47e-b6a1ecc4cb94 None None] MFA Rules not processed for user `b5065084bf664b99bdeac46067cb0f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:46:24.625715 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-4baca569-7134-4062-b47e-b6a1ecc4cb94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:46:24.649066 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:46:24.730609 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 559/1128] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Oct 27 09:46:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 09:46:25.020929 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345e22b7-10a0-4c2a-8294-3604814b3f56 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:46:25.022589 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-345e22b7-10a0-4c2a-8294-3604814b3f56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:46:25.130782 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345e22b7-10a0-4c2a-8294-3604814b3f56 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:46:25.152245 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:46:25.207770 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec33e6ae-a740-48dd-8bba-5bf8574ab55a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6191cc41efa74f46b49022cf387f7a4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc2e3a7a1bcc480891c0b433291c00b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:46:25.208384 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec33e6ae-a740-48dd-8bba-5bf8574ab55a service neutron] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:46:25.208670 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec33e6ae-a740-48dd-8bba-5bf8574ab55a service neutron] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:46:25.208947 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec33e6ae-a740-48dd-8bba-5bf8574ab55a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:46:25.210596 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-ec33e6ae-a740-48dd-8bba-5bf8574ab55a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:46:25.323795 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec33e6ae-a740-48dd-8bba-5bf8574ab55a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:46:25.325237 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec33e6ae-a740-48dd-8bba-5bf8574ab55a service neutron] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:46:25.343165 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 570/1129] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Oct 27 09:46:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 09:46:27.601698 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2aa116d-5bd0-45da-a554-64ce86fc140b None None] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:46:27.602258 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2aa116d-5bd0-45da-a554-64ce86fc140b None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:46:27.602258 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2aa116d-5bd0-45da-a554-64ce86fc140b None None] PATH_INFO: `/` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:46:27.603674 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 560/1130] 127.0.0.1 () {54 vars in 917 bytes} [Thu Oct 27 09:46:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 09:46:27.609101 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a913a15a-577c-49a1-938c-5748cd186a3f None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:46:27.609565 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a913a15a-577c-49a1-938c-5748cd186a3f None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:46:27.609695 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a913a15a-577c-49a1-938c-5748cd186a3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:46:27.676434 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:46:27.679173 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-a913a15a-577c-49a1-938c-5748cd186a3f None None] MFA Rules not processed for user `b5065084bf664b99bdeac46067cb0f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:46:27.684942 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-a913a15a-577c-49a1-938c-5748cd186a3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:46:27.781694 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 571/1131] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Oct 27 09:46:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 09:46:28.071095 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2aa116d-5bd0-45da-a554-64ce86fc140b None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:46:28.076735 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-c2aa116d-5bd0-45da-a554-64ce86fc140b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:46:28.184338 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2aa116d-5bd0-45da-a554-64ce86fc140b None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:46:28.236551 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:46:28.261135 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19869e1e-52f3-4337-b4e9-d2f512a65cc9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6191cc41efa74f46b49022cf387f7a4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc2e3a7a1bcc480891c0b433291c00b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:46:28.261736 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19869e1e-52f3-4337-b4e9-d2f512a65cc9 service neutron] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:46:28.262012 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19869e1e-52f3-4337-b4e9-d2f512a65cc9 service neutron] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:46:28.262281 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19869e1e-52f3-4337-b4e9-d2f512a65cc9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:46:28.264544 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-19869e1e-52f3-4337-b4e9-d2f512a65cc9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:46:28.381467 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19869e1e-52f3-4337-b4e9-d2f512a65cc9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:46:28.382853 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19869e1e-52f3-4337-b4e9-d2f512a65cc9 service neutron] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:46:28.402539 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 561/1132] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Oct 27 09:46:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 09:46:30.714304 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c6d63d-2fbc-40aa-90fc-1f1599d0f2aa None None] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:46:30.714911 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c6d63d-2fbc-40aa-90fc-1f1599d0f2aa None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:46:30.715016 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c6d63d-2fbc-40aa-90fc-1f1599d0f2aa None None] PATH_INFO: `/` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:46:30.716293 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 572/1133] 127.0.0.1 () {54 vars in 917 bytes} [Thu Oct 27 09:46:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 09:46:30.723086 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628fa731-20ec-4259-8eab-d08bb9590ad4 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:46:30.723545 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628fa731-20ec-4259-8eab-d08bb9590ad4 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:46:30.723663 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628fa731-20ec-4259-8eab-d08bb9590ad4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:46:30.791652 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-628fa731-20ec-4259-8eab-d08bb9590ad4 None None] MFA Rules not processed for user `b5065084bf664b99bdeac46067cb0f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:46:30.792877 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-628fa731-20ec-4259-8eab-d08bb9590ad4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:46:30.825052 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:46:30.900162 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 562/1134] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Oct 27 09:46:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 09:46:31.206724 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c6d63d-2fbc-40aa-90fc-1f1599d0f2aa None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:46:31.208266 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-35c6d63d-2fbc-40aa-90fc-1f1599d0f2aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:46:31.313846 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c6d63d-2fbc-40aa-90fc-1f1599d0f2aa None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:46:31.342922 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:46:31.389297 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aaa9794-6372-4b0b-8c08-8300e767755f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6191cc41efa74f46b49022cf387f7a4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc2e3a7a1bcc480891c0b433291c00b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:46:31.389900 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aaa9794-6372-4b0b-8c08-8300e767755f service neutron] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:46:31.390178 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aaa9794-6372-4b0b-8c08-8300e767755f service neutron] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:46:31.390451 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aaa9794-6372-4b0b-8c08-8300e767755f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:46:31.392555 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-1aaa9794-6372-4b0b-8c08-8300e767755f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:46:31.501613 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aaa9794-6372-4b0b-8c08-8300e767755f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:46:31.503002 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aaa9794-6372-4b0b-8c08-8300e767755f service neutron] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:46:31.520847 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 573/1135] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Oct 27 09:46:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 09:46:33.730509 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49976c80-0fe7-4a30-b995-002a4372394a None None] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:46:33.731110 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49976c80-0fe7-4a30-b995-002a4372394a None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:46:33.731110 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49976c80-0fe7-4a30-b995-002a4372394a None None] PATH_INFO: `/` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:46:33.732426 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 563/1136] 127.0.0.1 () {54 vars in 917 bytes} [Thu Oct 27 09:46:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 09:46:33.738320 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc30118-97cd-4d53-b49d-1d67311c8eac None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:46:33.738809 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc30118-97cd-4d53-b49d-1d67311c8eac None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:46:33.738905 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc30118-97cd-4d53-b49d-1d67311c8eac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:46:33.805358 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-5cc30118-97cd-4d53-b49d-1d67311c8eac None None] MFA Rules not processed for user `b5065084bf664b99bdeac46067cb0f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:46:33.806614 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-5cc30118-97cd-4d53-b49d-1d67311c8eac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:46:33.816509 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:46:33.908048 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 574/1137] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Oct 27 09:46:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 09:46:34.205826 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49976c80-0fe7-4a30-b995-002a4372394a None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:46:34.207391 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-49976c80-0fe7-4a30-b995-002a4372394a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:46:34.317288 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49976c80-0fe7-4a30-b995-002a4372394a None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:46:34.377733 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:46:34.397219 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2f10d0-60dd-4147-a2bc-a96e4ae0518f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6191cc41efa74f46b49022cf387f7a4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc2e3a7a1bcc480891c0b433291c00b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:46:34.397829 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2f10d0-60dd-4147-a2bc-a96e4ae0518f service neutron] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:46:34.398107 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2f10d0-60dd-4147-a2bc-a96e4ae0518f service neutron] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:46:34.398385 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2f10d0-60dd-4147-a2bc-a96e4ae0518f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:46:34.400051 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-be2f10d0-60dd-4147-a2bc-a96e4ae0518f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:46:34.509995 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2f10d0-60dd-4147-a2bc-a96e4ae0518f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:46:34.511371 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2f10d0-60dd-4147-a2bc-a96e4ae0518f service neutron] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:46:34.529954 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 564/1138] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Oct 27 09:46:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 09:46:36.905309 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83001924-9d94-4d34-9b6d-f0216771dff0 None None] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:46:36.905867 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83001924-9d94-4d34-9b6d-f0216771dff0 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:46:36.905867 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83001924-9d94-4d34-9b6d-f0216771dff0 None None] PATH_INFO: `/` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:46:36.907907 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 575/1139] 127.0.0.1 () {54 vars in 917 bytes} [Thu Oct 27 09:46:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 09:46:36.913657 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8da5719-db04-4dd3-b7a8-6f39e3d89268 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:46:36.914120 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8da5719-db04-4dd3-b7a8-6f39e3d89268 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:46:36.914226 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8da5719-db04-4dd3-b7a8-6f39e3d89268 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:46:36.980449 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-a8da5719-db04-4dd3-b7a8-6f39e3d89268 None None] MFA Rules not processed for user `b5065084bf664b99bdeac46067cb0f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:46:36.981652 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-a8da5719-db04-4dd3-b7a8-6f39e3d89268 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:46:37.021529 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:46:37.082877 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 565/1140] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Oct 27 09:46:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 09:46:37.366111 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83001924-9d94-4d34-9b6d-f0216771dff0 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:46:37.367691 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-83001924-9d94-4d34-9b6d-f0216771dff0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:46:37.477029 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83001924-9d94-4d34-9b6d-f0216771dff0 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:46:37.517550 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:46:37.555654 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7950c8-627e-4045-a516-e99b8d80c5cf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6191cc41efa74f46b49022cf387f7a4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc2e3a7a1bcc480891c0b433291c00b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:46:37.556259 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7950c8-627e-4045-a516-e99b8d80c5cf service neutron] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:46:37.556534 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7950c8-627e-4045-a516-e99b8d80c5cf service neutron] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:46:37.556796 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7950c8-627e-4045-a516-e99b8d80c5cf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:46:37.558425 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-bf7950c8-627e-4045-a516-e99b8d80c5cf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:46:37.670887 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7950c8-627e-4045-a516-e99b8d80c5cf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:46:37.672361 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7950c8-627e-4045-a516-e99b8d80c5cf service neutron] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:46:37.691756 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 576/1141] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Oct 27 09:46:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 09:46:39.900067 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356afc03-4fdf-4a87-8111-e62887871bbf None None] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:46:39.900633 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356afc03-4fdf-4a87-8111-e62887871bbf None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:46:39.900633 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356afc03-4fdf-4a87-8111-e62887871bbf None None] PATH_INFO: `/` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:46:39.901955 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 566/1142] 127.0.0.1 () {54 vars in 917 bytes} [Thu Oct 27 09:46:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 09:46:39.908489 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3a8f19-30b6-4061-913a-fa64b6d07dd2 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:46:39.908984 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3a8f19-30b6-4061-913a-fa64b6d07dd2 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:46:39.909088 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3a8f19-30b6-4061-913a-fa64b6d07dd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:46:39.976999 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-ec3a8f19-30b6-4061-913a-fa64b6d07dd2 None None] MFA Rules not processed for user `b5065084bf664b99bdeac46067cb0f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:46:39.978187 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-ec3a8f19-30b6-4061-913a-fa64b6d07dd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:46:39.996181 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:46:40.076657 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 577/1143] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Oct 27 09:46:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 09:46:40.375101 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356afc03-4fdf-4a87-8111-e62887871bbf None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:46:40.377309 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-356afc03-4fdf-4a87-8111-e62887871bbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:46:40.481224 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356afc03-4fdf-4a87-8111-e62887871bbf None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:46:40.550911 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:46:40.557448 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27e1b97-f579-4aa0-b1f1-321d7e164888 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6191cc41efa74f46b49022cf387f7a4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc2e3a7a1bcc480891c0b433291c00b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:46:40.558056 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27e1b97-f579-4aa0-b1f1-321d7e164888 service neutron] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:46:40.558340 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27e1b97-f579-4aa0-b1f1-321d7e164888 service neutron] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:46:40.558730 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27e1b97-f579-4aa0-b1f1-321d7e164888 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:46:40.560558 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-a27e1b97-f579-4aa0-b1f1-321d7e164888 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:46:40.675854 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27e1b97-f579-4aa0-b1f1-321d7e164888 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:46:40.677298 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27e1b97-f579-4aa0-b1f1-321d7e164888 service neutron] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:46:40.697135 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 567/1144] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Oct 27 09:46:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 09:46:42.911079 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bba3af5-1396-4d0a-a89b-645d45ec972e None None] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:46:42.911617 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bba3af5-1396-4d0a-a89b-645d45ec972e None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:46:42.911617 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bba3af5-1396-4d0a-a89b-645d45ec972e None None] PATH_INFO: `/` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:46:42.913013 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 578/1145] 127.0.0.1 () {54 vars in 917 bytes} [Thu Oct 27 09:46:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 09:46:42.918352 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd0ae40-6670-4a29-94e8-295a0e1a5396 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:46:42.918786 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd0ae40-6670-4a29-94e8-295a0e1a5396 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:46:42.919306 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd0ae40-6670-4a29-94e8-295a0e1a5396 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:46:42.988752 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-8bd0ae40-6670-4a29-94e8-295a0e1a5396 None None] MFA Rules not processed for user `b5065084bf664b99bdeac46067cb0f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:46:42.989976 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-8bd0ae40-6670-4a29-94e8-295a0e1a5396 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:46:43.040288 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:46:43.089948 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 568/1146] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Oct 27 09:46:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 09:46:43.374103 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bba3af5-1396-4d0a-a89b-645d45ec972e None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:46:43.375714 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-6bba3af5-1396-4d0a-a89b-645d45ec972e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:46:43.480567 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bba3af5-1396-4d0a-a89b-645d45ec972e None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:46:43.530047 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:46:43.556443 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b8a68c-4567-4d48-927a-be90d80df06e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6191cc41efa74f46b49022cf387f7a4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc2e3a7a1bcc480891c0b433291c00b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:46:43.557028 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b8a68c-4567-4d48-927a-be90d80df06e service neutron] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:46:43.557306 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b8a68c-4567-4d48-927a-be90d80df06e service neutron] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:46:43.557574 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b8a68c-4567-4d48-927a-be90d80df06e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:46:43.559176 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-42b8a68c-4567-4d48-927a-be90d80df06e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:46:43.669048 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b8a68c-4567-4d48-927a-be90d80df06e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:46:43.670496 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b8a68c-4567-4d48-927a-be90d80df06e service neutron] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:46:43.691059 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 579/1147] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Oct 27 09:46:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 09:46:53.097962 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=22 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:46:53.688253 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=66 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:47:04.161053 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092314d7-7cb1-4aaa-80d8-3c142f5324d8 None None] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:47:04.161630 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092314d7-7cb1-4aaa-80d8-3c142f5324d8 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:47:04.161630 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092314d7-7cb1-4aaa-80d8-3c142f5324d8 None None] PATH_INFO: `/` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:47:04.162977 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 569/1148] 10.222.0.65 () {54 vars in 927 bytes} [Thu Oct 27 09:47:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 09:47:04.168405 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3711ac03-84c9-4167-9188-35c3aebaaebb None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:47:04.168840 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3711ac03-84c9-4167-9188-35c3aebaaebb None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:47:04.168940 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3711ac03-84c9-4167-9188-35c3aebaaebb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:47:04.244486 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-3711ac03-84c9-4167-9188-35c3aebaaebb None None] MFA Rules not processed for user `b5065084bf664b99bdeac46067cb0f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:47:04.245745 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-3711ac03-84c9-4167-9188-35c3aebaaebb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:47:04.352172 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 580/1149] 10.222.0.65 () {58 vars in 1024 bytes} [Thu Oct 27 09:47:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 09:47:04.727793 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d46403-b21f-4454-95a5-148ee60ef411 None None] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:47:04.728090 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d46403-b21f-4454-95a5-148ee60ef411 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:47:04.728370 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d46403-b21f-4454-95a5-148ee60ef411 None None] PATH_INFO: `/` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:47:04.729804 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 570/1150] 10.222.0.65 () {54 vars in 962 bytes} [Thu Oct 27 09:47:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 09:47:04.736095 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071d16f4-7c5b-4f52-aeb0-2fcd06787121 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:47:04.736666 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071d16f4-7c5b-4f52-aeb0-2fcd06787121 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:47:04.737008 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071d16f4-7c5b-4f52-aeb0-2fcd06787121 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:47:04.835180 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-071d16f4-7c5b-4f52-aeb0-2fcd06787121 None None] MFA Rules not processed for user `c4b0886666584397be686ee02a505269`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:47:04.836770 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-071d16f4-7c5b-4f52-aeb0-2fcd06787121 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:47:04.865573 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:47:04.938326 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 581/1151] 10.222.0.65 () {58 vars in 1059 bytes} [Thu Oct 27 09:47:04 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 09:47:04.946779 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d46403-b21f-4454-95a5-148ee60ef411 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:47:04.948443 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-95d46403-b21f-4454-95a5-148ee60ef411 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:47:05.075937 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d46403-b21f-4454-95a5-148ee60ef411 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:47:05.151165 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c01beb4-4ee9-4f9f-b3f9-89d9f75ede25 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4b0886666584397be686ee02a505269', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc2e3a7a1bcc480891c0b433291c00b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:47:05.151778 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c01beb4-4ee9-4f9f-b3f9-89d9f75ede25 service glance] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:47:05.152059 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c01beb4-4ee9-4f9f-b3f9-89d9f75ede25 service glance] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:47:05.152332 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c01beb4-4ee9-4f9f-b3f9-89d9f75ede25 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:47:05.154009 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-5c01beb4-4ee9-4f9f-b3f9-89d9f75ede25 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:47:05.210963 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:47:05.271857 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c01beb4-4ee9-4f9f-b3f9-89d9f75ede25 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:47:05.273392 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c01beb4-4ee9-4f9f-b3f9-89d9f75ede25 service glance] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:47:05.302478 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 571/1152] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Oct 27 09:47:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 09:47:07.570506 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1bf1aa-a736-45fe-81a5-3e6d45a9bbfd None None] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:47:07.571081 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1bf1aa-a736-45fe-81a5-3e6d45a9bbfd None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:47:07.571081 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1bf1aa-a736-45fe-81a5-3e6d45a9bbfd None None] PATH_INFO: `/` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:47:07.572406 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 582/1153] 10.222.0.65 () {54 vars in 927 bytes} [Thu Oct 27 09:47:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 09:47:07.578075 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5c6245-f288-4174-8142-898e4eb89250 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:47:07.578510 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5c6245-f288-4174-8142-898e4eb89250 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:47:07.578680 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5c6245-f288-4174-8142-898e4eb89250 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:47:07.649855 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-cb5c6245-f288-4174-8142-898e4eb89250 None None] MFA Rules not processed for user `b5065084bf664b99bdeac46067cb0f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:47:07.651108 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-cb5c6245-f288-4174-8142-898e4eb89250 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:47:07.751908 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 572/1154] 10.222.0.65 () {58 vars in 1024 bytes} [Thu Oct 27 09:47:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 09:47:08.026889 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1bf1aa-a736-45fe-81a5-3e6d45a9bbfd None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:47:08.028362 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-0a1bf1aa-a736-45fe-81a5-3e6d45a9bbfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:47:08.158659 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1bf1aa-a736-45fe-81a5-3e6d45a9bbfd None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:47:08.208847 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:47:08.253363 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ba6641-0c69-46ed-a55f-4b2af371fffd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:47:08.253958 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ba6641-0c69-46ed-a55f-4b2af371fffd admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:47:08.254236 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ba6641-0c69-46ed-a55f-4b2af371fffd admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:47:08.254506 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ba6641-0c69-46ed-a55f-4b2af371fffd admin admin] PATH_INFO: `/v3/projects` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:47:08.255436 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ba6641-0c69-46ed-a55f-4b2af371fffd admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:47:08.256180 dv-cinder-797970-7-smb devstack@keystone.service[88311]: WARNING py.warnings [None req-14ba6641-0c69-46ed-a55f-4b2af371fffd admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 27 09:47:08.256180 dv-cinder-797970-7-smb devstack@keystone.service[88311]: warnings.warn(msg) Oct 27 09:47:08.256180 dv-cinder-797970-7-smb devstack@keystone.service[88311]: Oct 27 09:47:08.257365 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ba6641-0c69-46ed-a55f-4b2af371fffd admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:47:08.276505 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 583/1155] 10.222.0.65 () {56 vars in 1108 bytes} [Thu Oct 27 09:47:08 2022] GET /identity/v3/projects => generated 2553 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 09:47:10.476733 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dc865e-f2e3-4e90-b6f4-63b8bdd1a0d1 None None] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:47:10.477301 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dc865e-f2e3-4e90-b6f4-63b8bdd1a0d1 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:47:10.477301 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dc865e-f2e3-4e90-b6f4-63b8bdd1a0d1 None None] PATH_INFO: `/` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:47:10.478676 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 573/1156] 10.222.0.65 () {54 vars in 927 bytes} [Thu Oct 27 09:47:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 09:47:10.484568 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc82508-8ce0-4c02-b22c-e3f56b636fc5 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:47:10.485025 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc82508-8ce0-4c02-b22c-e3f56b636fc5 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:47:10.485136 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc82508-8ce0-4c02-b22c-e3f56b636fc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:47:10.552548 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-7bc82508-8ce0-4c02-b22c-e3f56b636fc5 None None] MFA Rules not processed for user `b5065084bf664b99bdeac46067cb0f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:47:10.553769 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-7bc82508-8ce0-4c02-b22c-e3f56b636fc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:47:10.652979 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 584/1157] 10.222.0.65 () {58 vars in 1024 bytes} [Thu Oct 27 09:47:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 09:47:10.955777 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62dc865e-f2e3-4e90-b6f4-63b8bdd1a0d1 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:47:10.957640 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-62dc865e-f2e3-4e90-b6f4-63b8bdd1a0d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:47:10.968294 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:47:11.108451 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62dc865e-f2e3-4e90-b6f4-63b8bdd1a0d1 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:47:11.196043 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:47:11.228749 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c869c60-1bab-41ce-a328-b005c7a5d340 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd0d23ef039d4f1591a589d302ef165f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc2e3a7a1bcc480891c0b433291c00b1', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:47:11.233361 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c869c60-1bab-41ce-a328-b005c7a5d340 service nova] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:47:11.233361 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c869c60-1bab-41ce-a328-b005c7a5d340 service nova] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:47:11.233361 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c869c60-1bab-41ce-a328-b005c7a5d340 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:47:11.233361 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-3c869c60-1bab-41ce-a328-b005c7a5d340 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:47:11.326158 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c869c60-1bab-41ce-a328-b005c7a5d340 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:47:11.328691 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c869c60-1bab-41ce-a328-b005c7a5d340 service nova] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:47:11.348039 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 574/1158] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Oct 27 09:47:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 09:47:13.726369 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88321d3-bd58-418f-9edd-256da62fb9be None None] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:47:13.726961 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88321d3-bd58-418f-9edd-256da62fb9be None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:47:13.727069 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88321d3-bd58-418f-9edd-256da62fb9be None None] PATH_INFO: `/` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:47:13.728324 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 585/1159] 10.222.0.65 () {54 vars in 927 bytes} [Thu Oct 27 09:47:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 09:47:13.734637 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f435847c-60a4-41ec-be9f-2e45463be2a5 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:47:13.735096 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f435847c-60a4-41ec-be9f-2e45463be2a5 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:47:13.735194 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f435847c-60a4-41ec-be9f-2e45463be2a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:47:13.801544 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-f435847c-60a4-41ec-be9f-2e45463be2a5 None None] MFA Rules not processed for user `b5065084bf664b99bdeac46067cb0f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:47:13.802805 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-f435847c-60a4-41ec-be9f-2e45463be2a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:47:13.850178 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:47:13.900919 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 575/1160] 10.222.0.65 () {58 vars in 1024 bytes} [Thu Oct 27 09:47:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 09:47:14.193226 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88321d3-bd58-418f-9edd-256da62fb9be None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:47:14.194838 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-a88321d3-bd58-418f-9edd-256da62fb9be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:47:14.220450 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:47:14.303840 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88321d3-bd58-418f-9edd-256da62fb9be None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:47:14.383576 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5b40ca-18cd-44a0-b245-767e42dce026 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6191cc41efa74f46b49022cf387f7a4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc2e3a7a1bcc480891c0b433291c00b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:47:14.384182 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5b40ca-18cd-44a0-b245-767e42dce026 service neutron] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:47:14.384465 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5b40ca-18cd-44a0-b245-767e42dce026 service neutron] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:47:14.384741 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5b40ca-18cd-44a0-b245-767e42dce026 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:47:14.386360 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-9e5b40ca-18cd-44a0-b245-767e42dce026 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:47:14.461345 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:47:14.497170 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5b40ca-18cd-44a0-b245-767e42dce026 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:47:14.498685 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5b40ca-18cd-44a0-b245-767e42dce026 service neutron] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:47:14.517701 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 586/1161] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Oct 27 09:47:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 09:47:16.781802 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15922cfd-e204-417e-9dfa-83b74faecdff None None] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:47:16.782384 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15922cfd-e204-417e-9dfa-83b74faecdff None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:47:16.782384 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15922cfd-e204-417e-9dfa-83b74faecdff None None] PATH_INFO: `/` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:47:16.783751 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 576/1162] 10.222.0.65 () {54 vars in 927 bytes} [Thu Oct 27 09:47:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 09:47:16.789284 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e797a9-9098-4931-a651-a6cd71b87800 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:47:16.789749 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e797a9-9098-4931-a651-a6cd71b87800 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:47:16.789853 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e797a9-9098-4931-a651-a6cd71b87800 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:47:16.861542 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-a5e797a9-9098-4931-a651-a6cd71b87800 None None] MFA Rules not processed for user `b5065084bf664b99bdeac46067cb0f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:47:16.862805 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-a5e797a9-9098-4931-a651-a6cd71b87800 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:47:16.961225 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 587/1163] 10.222.0.65 () {58 vars in 1024 bytes} [Thu Oct 27 09:47:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 09:47:17.252450 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15922cfd-e204-417e-9dfa-83b74faecdff None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:47:17.253992 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-15922cfd-e204-417e-9dfa-83b74faecdff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:47:17.371339 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15922cfd-e204-417e-9dfa-83b74faecdff None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:47:17.446094 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:47:17.447812 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea719ac-2d77-4a52-8bd1-a44a370b6b73 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6191cc41efa74f46b49022cf387f7a4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc2e3a7a1bcc480891c0b433291c00b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:47:17.464292 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea719ac-2d77-4a52-8bd1-a44a370b6b73 service neutron] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:47:17.464292 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea719ac-2d77-4a52-8bd1-a44a370b6b73 service neutron] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:47:17.464292 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea719ac-2d77-4a52-8bd1-a44a370b6b73 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:47:17.464292 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-0ea719ac-2d77-4a52-8bd1-a44a370b6b73 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:47:17.566216 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea719ac-2d77-4a52-8bd1-a44a370b6b73 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:47:17.567614 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea719ac-2d77-4a52-8bd1-a44a370b6b73 service neutron] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:47:17.587159 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 577/1164] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Oct 27 09:47:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 09:47:19.878120 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd2ac67-c95e-4abb-93f9-5741b1394da2 None None] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:47:19.878688 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd2ac67-c95e-4abb-93f9-5741b1394da2 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:47:19.878688 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd2ac67-c95e-4abb-93f9-5741b1394da2 None None] PATH_INFO: `/` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:47:19.880067 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 588/1165] 10.222.0.65 () {54 vars in 927 bytes} [Thu Oct 27 09:47:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 09:47:19.885949 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24315ca2-a794-4513-bf5d-071000e51612 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:47:19.886455 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24315ca2-a794-4513-bf5d-071000e51612 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:47:19.886586 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24315ca2-a794-4513-bf5d-071000e51612 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:47:19.956046 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-24315ca2-a794-4513-bf5d-071000e51612 None None] MFA Rules not processed for user `b5065084bf664b99bdeac46067cb0f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:47:19.957264 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-24315ca2-a794-4513-bf5d-071000e51612 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:47:20.011594 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:47:20.056291 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 578/1166] 10.222.0.65 () {58 vars in 1024 bytes} [Thu Oct 27 09:47:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 09:47:20.348106 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd2ac67-c95e-4abb-93f9-5741b1394da2 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:47:20.349657 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-7cd2ac67-c95e-4abb-93f9-5741b1394da2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:47:20.386277 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:47:20.455283 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd2ac67-c95e-4abb-93f9-5741b1394da2 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:47:20.531715 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a882c97-19b7-49ce-9e3a-8e414a32cdab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6191cc41efa74f46b49022cf387f7a4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc2e3a7a1bcc480891c0b433291c00b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:47:20.532320 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a882c97-19b7-49ce-9e3a-8e414a32cdab service neutron] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:47:20.532598 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a882c97-19b7-49ce-9e3a-8e414a32cdab service neutron] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:47:20.532861 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a882c97-19b7-49ce-9e3a-8e414a32cdab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:47:20.534454 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-7a882c97-19b7-49ce-9e3a-8e414a32cdab service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:47:20.613424 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:47:20.643643 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a882c97-19b7-49ce-9e3a-8e414a32cdab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:47:20.645190 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a882c97-19b7-49ce-9e3a-8e414a32cdab service neutron] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:47:20.663803 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 589/1167] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Oct 27 09:47:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 09:47:23.260552 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d7b2ef-253e-44a4-a581-2bebdcc2d54c None None] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:47:23.261115 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d7b2ef-253e-44a4-a581-2bebdcc2d54c None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:47:23.261115 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d7b2ef-253e-44a4-a581-2bebdcc2d54c None None] PATH_INFO: `/` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:47:23.262439 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 579/1168] 10.222.0.65 () {54 vars in 927 bytes} [Thu Oct 27 09:47:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 09:47:23.268926 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bee52b5-0224-4404-a1d0-6a361e6a6870 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:47:23.269356 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bee52b5-0224-4404-a1d0-6a361e6a6870 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:47:23.269530 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bee52b5-0224-4404-a1d0-6a361e6a6870 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:47:23.336580 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-7bee52b5-0224-4404-a1d0-6a361e6a6870 None None] MFA Rules not processed for user `b5065084bf664b99bdeac46067cb0f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:47:23.337794 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-7bee52b5-0224-4404-a1d0-6a361e6a6870 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:47:23.446124 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 590/1169] 10.222.0.65 () {58 vars in 1024 bytes} [Thu Oct 27 09:47:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 09:47:23.741706 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d7b2ef-253e-44a4-a581-2bebdcc2d54c None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:47:23.743305 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-19d7b2ef-253e-44a4-a581-2bebdcc2d54c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:47:23.853853 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d7b2ef-253e-44a4-a581-2bebdcc2d54c None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:47:23.930995 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bc13b1-16d0-4106-af94-50dd9ffef334 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6191cc41efa74f46b49022cf387f7a4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc2e3a7a1bcc480891c0b433291c00b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:47:23.931602 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bc13b1-16d0-4106-af94-50dd9ffef334 service neutron] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:47:23.932142 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bc13b1-16d0-4106-af94-50dd9ffef334 service neutron] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:47:23.932416 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bc13b1-16d0-4106-af94-50dd9ffef334 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:47:23.934025 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-70bc13b1-16d0-4106-af94-50dd9ffef334 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:47:23.943834 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:47:24.049645 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70bc13b1-16d0-4106-af94-50dd9ffef334 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:47:24.051040 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70bc13b1-16d0-4106-af94-50dd9ffef334 service neutron] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:47:24.070439 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 580/1170] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Oct 27 09:47:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 09:47:33.444605 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=82 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:47:34.068099 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=50 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:48:49.526382 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1523dcb7-3120-48b4-8bd3-bec178f8cbd4 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:48:49.527027 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1523dcb7-3120-48b4-8bd3-bec178f8cbd4 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:48:49.527027 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1523dcb7-3120-48b4-8bd3-bec178f8cbd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:48:49.607484 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-1523dcb7-3120-48b4-8bd3-bec178f8cbd4 None None] MFA Rules not processed for user `b5065084bf664b99bdeac46067cb0f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:48:49.609003 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-1523dcb7-3120-48b4-8bd3-bec178f8cbd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:48:49.711440 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 591/1171] 10.222.0.65 () {58 vars in 958 bytes} [Thu Oct 27 09:48:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 09:48:49.719592 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee06c7f-cd0f-41a4-9454-df073aa484e3 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:48:49.725533 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee06c7f-cd0f-41a4-9454-df073aa484e3 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:48:49.725533 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee06c7f-cd0f-41a4-9454-df073aa484e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:48:49.798344 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-5ee06c7f-cd0f-41a4-9454-df073aa484e3 None None] MFA Rules not processed for user `b5065084bf664b99bdeac46067cb0f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:48:49.799518 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-5ee06c7f-cd0f-41a4-9454-df073aa484e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:48:49.901461 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 581/1172] 10.222.0.65 () {58 vars in 958 bytes} [Thu Oct 27 09:48:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 09:48:49.906277 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1523dcb7-3120-48b4-8bd3-bec178f8cbd4 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:48:49.907519 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-1523dcb7-3120-48b4-8bd3-bec178f8cbd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:48:49.919157 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1523dcb7-3120-48b4-8bd3-bec178f8cbd4 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:48:49.981179 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:48:50.015786 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe9def0-27a6-4ac9-9151-9ab93655c91e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:48:50.016388 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe9def0-27a6-4ac9-9151-9ab93655c91e admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:48:50.016670 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe9def0-27a6-4ac9-9151-9ab93655c91e admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:48:50.016942 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe9def0-27a6-4ac9-9151-9ab93655c91e admin admin] PATH_INFO: `/v3/domains` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:48:50.017575 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe9def0-27a6-4ac9-9151-9ab93655c91e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 09:48:50.017874 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe9def0-27a6-4ac9-9151-9ab93655c91e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:48:50.018915 dv-cinder-797970-7-smb devstack@keystone.service[88311]: WARNING py.warnings [None req-ffe9def0-27a6-4ac9-9151-9ab93655c91e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 09:48:50.018915 dv-cinder-797970-7-smb devstack@keystone.service[88311]: warnings.warn(msg) Oct 27 09:48:50.018915 dv-cinder-797970-7-smb devstack@keystone.service[88311]: Oct 27 09:48:50.019807 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe9def0-27a6-4ac9-9151-9ab93655c91e admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:48:50.031561 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 592/1173] 10.222.0.65 () {58 vars in 1153 bytes} [Thu Oct 27 09:48:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 09:48:50.041619 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee06c7f-cd0f-41a4-9454-df073aa484e3 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:48:50.051250 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee06c7f-cd0f-41a4-9454-df073aa484e3 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:48:50.115274 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:48:50.149850 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f748b0-1cd3-4e0f-80e7-a58eea2c6954 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:48:50.150477 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f748b0-1cd3-4e0f-80e7-a58eea2c6954 admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:48:50.150780 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f748b0-1cd3-4e0f-80e7-a58eea2c6954 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:48:50.151052 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f748b0-1cd3-4e0f-80e7-a58eea2c6954 admin admin] PATH_INFO: `/v3/projects` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:48:50.151685 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f748b0-1cd3-4e0f-80e7-a58eea2c6954 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:48:50.152798 dv-cinder-797970-7-smb devstack@keystone.service[88312]: WARNING py.warnings [None req-71f748b0-1cd3-4e0f-80e7-a58eea2c6954 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 27 09:48:50.152798 dv-cinder-797970-7-smb devstack@keystone.service[88312]: warnings.warn(msg) Oct 27 09:48:50.152798 dv-cinder-797970-7-smb devstack@keystone.service[88312]: Oct 27 09:48:50.153983 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f748b0-1cd3-4e0f-80e7-a58eea2c6954 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:48:50.247166 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 582/1174] 10.222.0.65 () {60 vars in 1153 bytes} [Thu Oct 27 09:48:50 2022] POST /identity/v3/projects => generated 379 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 09:48:50.251342 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe9def0-27a6-4ac9-9151-9ab93655c91e admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:48:50.252900 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-ffe9def0-27a6-4ac9-9151-9ab93655c91e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:48:50.286746 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe9def0-27a6-4ac9-9151-9ab93655c91e admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:48:50.382397 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac7751a-2b27-4751-894d-8eb478e9d485 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:48:50.382932 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac7751a-2b27-4751-894d-8eb478e9d485 admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:48:50.383214 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac7751a-2b27-4751-894d-8eb478e9d485 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:48:50.383482 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac7751a-2b27-4751-894d-8eb478e9d485 admin admin] PATH_INFO: `/v3/users` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:48:50.384111 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac7751a-2b27-4751-894d-8eb478e9d485 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:48:50.385155 dv-cinder-797970-7-smb devstack@keystone.service[88311]: WARNING py.warnings [None req-dac7751a-2b27-4751-894d-8eb478e9d485 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 27 09:48:50.385155 dv-cinder-797970-7-smb devstack@keystone.service[88311]: warnings.warn(msg) Oct 27 09:48:50.385155 dv-cinder-797970-7-smb devstack@keystone.service[88311]: Oct 27 09:48:50.386379 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac7751a-2b27-4751-894d-8eb478e9d485 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:48:50.481278 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 593/1175] 10.222.0.65 () {60 vars in 1144 bytes} [Thu Oct 27 09:48:50 2022] POST /identity/v3/users => generated 290 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 09:48:50.485415 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f748b0-1cd3-4e0f-80e7-a58eea2c6954 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:48:50.487083 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-71f748b0-1cd3-4e0f-80e7-a58eea2c6954 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:48:50.550031 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f748b0-1cd3-4e0f-80e7-a58eea2c6954 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:48:50.635889 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:48:50.646177 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d0a7fd-357c-4c77-b3db-f18d49354f56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:48:50.646796 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d0a7fd-357c-4c77-b3db-f18d49354f56 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:48:50.647082 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d0a7fd-357c-4c77-b3db-f18d49354f56 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:48:50.647358 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d0a7fd-357c-4c77-b3db-f18d49354f56 admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:48:50.648030 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d0a7fd-357c-4c77-b3db-f18d49354f56 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:48:50.649665 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d0a7fd-357c-4c77-b3db-f18d49354f56 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:48:50.663668 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 583/1176] 10.222.0.65 () {58 vars in 1122 bytes} [Thu Oct 27 09:48:50 2022] GET /identity/v3/roles => generated 1420 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 09:48:50.669177 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac7751a-2b27-4751-894d-8eb478e9d485 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:48:50.671093 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-dac7751a-2b27-4751-894d-8eb478e9d485 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:48:50.683620 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac7751a-2b27-4751-894d-8eb478e9d485 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:48:50.710878 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:48:50.784305 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1d4630-e0e1-4e52-aff7-a76a118c1a57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:48:50.784922 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1d4630-e0e1-4e52-aff7-a76a118c1a57 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:48:50.785206 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1d4630-e0e1-4e52-aff7-a76a118c1a57 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:48:50.785484 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1d4630-e0e1-4e52-aff7-a76a118c1a57 admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:48:50.786277 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1d4630-e0e1-4e52-aff7-a76a118c1a57 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:48:50.788795 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1d4630-e0e1-4e52-aff7-a76a118c1a57 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:48:50.802025 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 594/1177] 10.222.0.65 () {58 vars in 1122 bytes} [Thu Oct 27 09:48:50 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 09:48:50.806159 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d0a7fd-357c-4c77-b3db-f18d49354f56 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:48:50.808118 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-39d0a7fd-357c-4c77-b3db-f18d49354f56 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:48:50.843117 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d0a7fd-357c-4c77-b3db-f18d49354f56 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:48:50.941821 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09338b12-e5e7-4004-bc3d-04b1a23f6bf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:48:50.942486 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09338b12-e5e7-4004-bc3d-04b1a23f6bf5 admin admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:48:50.942805 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09338b12-e5e7-4004-bc3d-04b1a23f6bf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:48:50.943082 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09338b12-e5e7-4004-bc3d-04b1a23f6bf5 admin admin] PATH_INFO: `/v3/projects/2b2cb1ec815c4d6aa4043f95283e8235/users/30d61f919d9a448e900ab7823bb9f76a/roles/43543ce1450245af9661cb017bac17bd` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:48:50.968828 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09338b12-e5e7-4004-bc3d-04b1a23f6bf5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2b2cb1ec815c4d6aa4043f95283e8235, user_id=30d61f919d9a448e900ab7823bb9f76a, role_id=43543ce1450245af9661cb017bac17bd)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:48:50.971572 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09338b12-e5e7-4004-bc3d-04b1a23f6bf5 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:48:51.110050 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 584/1178] 10.222.0.65 () {60 vars in 1483 bytes} [Thu Oct 27 09:48:50 2022] PUT /identity/v3/projects/2b2cb1ec815c4d6aa4043f95283e8235/users/30d61f919d9a448e900ab7823bb9f76a/roles/43543ce1450245af9661cb017bac17bd => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 09:48:51.121772 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bad162-5487-45e1-9d75-013190239858 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:48:51.122061 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bad162-5487-45e1-9d75-013190239858 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:48:51.122337 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bad162-5487-45e1-9d75-013190239858 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:48:51.183695 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-56bad162-5487-45e1-9d75-013190239858 None None] MFA Rules not processed for user `30d61f919d9a448e900ab7823bb9f76a`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:48:51.184895 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-56bad162-5487-45e1-9d75-013190239858 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:48:51.265220 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 595/1179] 10.222.0.65 () {58 vars in 958 bytes} [Thu Oct 27 09:48:51 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 09:48:51.278653 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd343a1a-018f-4e9d-9296-274ee3483ace None None] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:48:51.278963 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd343a1a-018f-4e9d-9296-274ee3483ace None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:48:51.279244 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd343a1a-018f-4e9d-9296-274ee3483ace None None] PATH_INFO: `/` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:48:51.280651 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 585/1180] 10.222.0.65 () {54 vars in 963 bytes} [Thu Oct 27 09:48:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 09:48:51.285464 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0da9869-5ce6-45a5-8fea-f0a9e7a092b3 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:48:51.285752 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0da9869-5ce6-45a5-8fea-f0a9e7a092b3 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:48:51.286059 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0da9869-5ce6-45a5-8fea-f0a9e7a092b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:48:51.320058 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:48:51.364855 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-e0da9869-5ce6-45a5-8fea-f0a9e7a092b3 None None] MFA Rules not processed for user `b8e5d5f04c4741bb86ca4a0f667d4ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:48:51.366072 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-e0da9869-5ce6-45a5-8fea-f0a9e7a092b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:48:51.444345 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 596/1181] 10.222.0.65 () {58 vars in 1060 bytes} [Thu Oct 27 09:48:51 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 09:48:51.452588 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd343a1a-018f-4e9d-9296-274ee3483ace None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:48:51.454151 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-fd343a1a-018f-4e9d-9296-274ee3483ace None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:48:51.505318 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:48:51.562628 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd343a1a-018f-4e9d-9296-274ee3483ace None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:48:51.639812 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc6689a-e1ff-48d7-b743-f6034ea085b0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8e5d5f04c4741bb86ca4a0f667d4ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc2e3a7a1bcc480891c0b433291c00b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:48:51.640422 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc6689a-e1ff-48d7-b743-f6034ea085b0 service cinder] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:48:51.640701 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc6689a-e1ff-48d7-b743-f6034ea085b0 service cinder] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:48:51.640979 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc6689a-e1ff-48d7-b743-f6034ea085b0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:48:51.642608 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-bbc6689a-e1ff-48d7-b743-f6034ea085b0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:48:51.743450 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc6689a-e1ff-48d7-b743-f6034ea085b0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:48:51.745783 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc6689a-e1ff-48d7-b743-f6034ea085b0 service cinder] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:48:51.749295 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:48:51.763712 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 586/1182] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Oct 27 09:48:51 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 09:48:51.810431 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d0abe0-8b26-4db4-a74c-5e3d8a62c9c8 None None] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:48:51.810886 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d0abe0-8b26-4db4-a74c-5e3d8a62c9c8 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:48:51.810994 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d0abe0-8b26-4db4-a74c-5e3d8a62c9c8 None None] PATH_INFO: `/` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:48:51.812230 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 597/1183] 10.222.0.65 () {52 vars in 830 bytes} [Thu Oct 27 09:48:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 09:48:51.815946 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc6689a-e1ff-48d7-b743-f6034ea085b0 service cinder] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:48:51.817113 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-bbc6689a-e1ff-48d7-b743-f6034ea085b0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:48:51.922002 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc6689a-e1ff-48d7-b743-f6034ea085b0 service cinder] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:48:52.020179 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54e80bb-25e6-486a-a856-9d0160d3b35d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:48:52.020718 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54e80bb-25e6-486a-a856-9d0160d3b35d admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:48:52.020997 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54e80bb-25e6-486a-a856-9d0160d3b35d admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:48:52.021270 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54e80bb-25e6-486a-a856-9d0160d3b35d admin admin] PATH_INFO: `/v3/users/30d61f919d9a448e900ab7823bb9f76a` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:48:52.036186 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54e80bb-25e6-486a-a856-9d0160d3b35d admin admin] RBAC: Authorizing `identity:delete_user(user_id=30d61f919d9a448e900ab7823bb9f76a)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:48:52.037219 dv-cinder-797970-7-smb devstack@keystone.service[88312]: WARNING py.warnings [None req-c54e80bb-25e6-486a-a856-9d0160d3b35d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 27 09:48:52.037219 dv-cinder-797970-7-smb devstack@keystone.service[88312]: warnings.warn(msg) Oct 27 09:48:52.037219 dv-cinder-797970-7-smb devstack@keystone.service[88312]: Oct 27 09:48:52.038451 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54e80bb-25e6-486a-a856-9d0160d3b35d admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:48:52.049119 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:48:52.221400 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-c54e80bb-25e6-486a-a856-9d0160d3b35d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '30d61f919d9a448e900ab7823bb9f76a'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:48:52.246112 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-c54e80bb-25e6-486a-a856-9d0160d3b35d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '30d61f919d9a448e900ab7823bb9f76a'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:48:52.246722 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-c54e80bb-25e6-486a-a856-9d0160d3b35d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '30d61f919d9a448e900ab7823bb9f76a'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:48:52.261978 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-c54e80bb-25e6-486a-a856-9d0160d3b35d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '30d61f919d9a448e900ab7823bb9f76a'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:48:52.312835 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-c54e80bb-25e6-486a-a856-9d0160d3b35d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '30d61f919d9a448e900ab7823bb9f76a'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:48:52.319117 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 587/1184] 10.222.0.65 () {58 vars in 1224 bytes} [Thu Oct 27 09:48:51 2022] DELETE /identity/v3/users/30d61f919d9a448e900ab7823bb9f76a => generated 0 bytes in 504 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 09:48:52.324569 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8681c936-e9fc-451e-a488-84eb9a935e5d None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:48:52.324569 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8681c936-e9fc-451e-a488-84eb9a935e5d None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:48:52.324808 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8681c936-e9fc-451e-a488-84eb9a935e5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:48:52.382849 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-8681c936-e9fc-451e-a488-84eb9a935e5d None None] MFA Rules not processed for user `b5065084bf664b99bdeac46067cb0f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:48:52.384582 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-8681c936-e9fc-451e-a488-84eb9a935e5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:48:52.463348 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:48:52.475164 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 598/1185] 10.222.0.65 () {58 vars in 958 bytes} [Thu Oct 27 09:48:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 09:48:52.487077 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54e80bb-25e6-486a-a856-9d0160d3b35d admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:48:52.488307 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-c54e80bb-25e6-486a-a856-9d0160d3b35d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:48:52.594433 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54e80bb-25e6-486a-a856-9d0160d3b35d admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:48:52.649872 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:48:52.669262 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5871e61-e9f3-485f-9963-3d118f77df9d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6191cc41efa74f46b49022cf387f7a4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc2e3a7a1bcc480891c0b433291c00b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:48:52.669876 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5871e61-e9f3-485f-9963-3d118f77df9d service neutron] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:48:52.670160 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5871e61-e9f3-485f-9963-3d118f77df9d service neutron] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:48:52.670437 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5871e61-e9f3-485f-9963-3d118f77df9d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:48:52.672117 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-a5871e61-e9f3-485f-9963-3d118f77df9d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:48:52.789792 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5871e61-e9f3-485f-9963-3d118f77df9d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:48:52.791978 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5871e61-e9f3-485f-9963-3d118f77df9d service neutron] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:48:52.811402 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 588/1186] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Oct 27 09:48:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 09:48:53.267707 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8681c936-e9fc-451e-a488-84eb9a935e5d None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:48:53.272997 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-8681c936-e9fc-451e-a488-84eb9a935e5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:48:53.281653 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8681c936-e9fc-451e-a488-84eb9a935e5d None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:48:53.404802 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af62d398-8366-46d0-88ca-0716cce840f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:48:53.405442 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af62d398-8366-46d0-88ca-0716cce840f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:48:53.405722 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af62d398-8366-46d0-88ca-0716cce840f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:48:53.405993 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af62d398-8366-46d0-88ca-0716cce840f0 admin admin] PATH_INFO: `/v3/projects/2b2cb1ec815c4d6aa4043f95283e8235` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:48:53.417071 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af62d398-8366-46d0-88ca-0716cce840f0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2b2cb1ec815c4d6aa4043f95283e8235)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:48:53.421766 dv-cinder-797970-7-smb devstack@keystone.service[88311]: WARNING py.warnings [None req-af62d398-8366-46d0-88ca-0716cce840f0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 27 09:48:53.421766 dv-cinder-797970-7-smb devstack@keystone.service[88311]: warnings.warn(msg) Oct 27 09:48:53.421766 dv-cinder-797970-7-smb devstack@keystone.service[88311]: Oct 27 09:48:53.421766 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af62d398-8366-46d0-88ca-0716cce840f0 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:48:53.554465 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-af62d398-8366-46d0-88ca-0716cce840f0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2b2cb1ec815c4d6aa4043f95283e8235', 'request_id': 'req-af62d398-8366-46d0-88ca-0716cce840f0'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:48:53.567850 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-af62d398-8366-46d0-88ca-0716cce840f0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2b2cb1ec815c4d6aa4043f95283e8235', 'request_id': 'req-af62d398-8366-46d0-88ca-0716cce840f0'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:48:53.673630 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-af62d398-8366-46d0-88ca-0716cce840f0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2b2cb1ec815c4d6aa4043f95283e8235', 'request_id': 'req-af62d398-8366-46d0-88ca-0716cce840f0'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:48:53.701987 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-af62d398-8366-46d0-88ca-0716cce840f0 admin admin] The token cache is being invalidate because project 2b2cb1ec815c4d6aa4043f95283e8235 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 09:48:53.702288 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-af62d398-8366-46d0-88ca-0716cce840f0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:48:53.702979 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-af62d398-8366-46d0-88ca-0716cce840f0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:48:53.705380 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 599/1187] 10.222.0.65 () {58 vars in 1233 bytes} [Thu Oct 27 09:48:53 2022] DELETE /identity/v3/projects/2b2cb1ec815c4d6aa4043f95283e8235 => generated 0 bytes in 438 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 09:49:02.808835 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=62 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:49:03.698755 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:50:28.424917 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fd5f09-6a29-4ed4-87f2-f2a29c31c635 None None] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:50:28.425551 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fd5f09-6a29-4ed4-87f2-f2a29c31c635 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:50:28.425551 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fd5f09-6a29-4ed4-87f2-f2a29c31c635 None None] PATH_INFO: `/` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:50:28.426900 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 589/1188] 127.0.0.1 () {54 vars in 901 bytes} [Thu Oct 27 09:50:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 27 09:50:28.431972 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca92b218-10b7-4bf3-9db4-5214c7e6e6e7 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:50:28.432948 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca92b218-10b7-4bf3-9db4-5214c7e6e6e7 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:50:28.433133 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca92b218-10b7-4bf3-9db4-5214c7e6e6e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:50:28.515915 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-ca92b218-10b7-4bf3-9db4-5214c7e6e6e7 None None] MFA Rules not processed for user `b5065084bf664b99bdeac46067cb0f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:50:28.517142 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-ca92b218-10b7-4bf3-9db4-5214c7e6e6e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:50:28.621407 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 600/1189] 127.0.0.1 () {58 vars in 998 bytes} [Thu Oct 27 09:50:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 09:50:28.779411 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fd5f09-6a29-4ed4-87f2-f2a29c31c635 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:50:28.781578 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-51fd5f09-6a29-4ed4-87f2-f2a29c31c635 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:50:28.907235 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fd5f09-6a29-4ed4-87f2-f2a29c31c635 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:50:28.912908 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d305c97-b267-423e-8922-c5e4419a7c34 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd0d23ef039d4f1591a589d302ef165f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc2e3a7a1bcc480891c0b433291c00b1', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:50:28.913512 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d305c97-b267-423e-8922-c5e4419a7c34 service nova] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:50:28.913803 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d305c97-b267-423e-8922-c5e4419a7c34 service nova] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:50:28.914080 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d305c97-b267-423e-8922-c5e4419a7c34 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:50:28.923378 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d305c97-b267-423e-8922-c5e4419a7c34 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:50:28.924995 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d305c97-b267-423e-8922-c5e4419a7c34 service nova] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:50:28.935455 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 590/1190] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Oct 27 09:50:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 09:50:30.056144 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51e6f61-3957-492a-834a-eaeeafef6e45 None None] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:50:30.056706 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51e6f61-3957-492a-834a-eaeeafef6e45 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:50:30.056706 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51e6f61-3957-492a-834a-eaeeafef6e45 None None] PATH_INFO: `/` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:50:30.058301 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 601/1191] 127.0.0.1 () {54 vars in 901 bytes} [Thu Oct 27 09:50:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 09:50:30.063494 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7783453-7e63-4f84-a53b-572375ffde4f None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:50:30.063978 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7783453-7e63-4f84-a53b-572375ffde4f None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:50:30.064083 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7783453-7e63-4f84-a53b-572375ffde4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:50:30.084527 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-f7783453-7e63-4f84-a53b-572375ffde4f None None] MFA Rules not processed for user `b5065084bf664b99bdeac46067cb0f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:50:30.085837 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-f7783453-7e63-4f84-a53b-572375ffde4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:50:30.094910 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 591/1192] 127.0.0.1 () {58 vars in 998 bytes} [Thu Oct 27 09:50:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 09:50:30.249983 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51e6f61-3957-492a-834a-eaeeafef6e45 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:50:30.264632 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51e6f61-3957-492a-834a-eaeeafef6e45 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:50:30.270142 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15a0a4f-ccb9-4506-8f30-936755e94ef8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd0d23ef039d4f1591a589d302ef165f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc2e3a7a1bcc480891c0b433291c00b1', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:50:30.270774 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15a0a4f-ccb9-4506-8f30-936755e94ef8 service nova] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:50:30.271060 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15a0a4f-ccb9-4506-8f30-936755e94ef8 service nova] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:50:30.271374 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15a0a4f-ccb9-4506-8f30-936755e94ef8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:50:30.280201 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15a0a4f-ccb9-4506-8f30-936755e94ef8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:50:30.281810 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15a0a4f-ccb9-4506-8f30-936755e94ef8 service nova] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:50:30.291359 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 602/1193] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Oct 27 09:50:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 09:50:30.439313 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2412db-44f0-433a-ae8d-75f1855ee97a None None] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:50:30.439616 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2412db-44f0-433a-ae8d-75f1855ee97a None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:50:30.439892 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2412db-44f0-433a-ae8d-75f1855ee97a None None] PATH_INFO: `/v3` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:50:30.441179 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 592/1194] 10.222.0.74 () {54 vars in 925 bytes} [Thu Oct 27 09:50:30 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 09:50:30.448202 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59983e28-860b-4c00-88c8-70bb31b01c54 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:50:30.448508 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59983e28-860b-4c00-88c8-70bb31b01c54 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:50:30.448790 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59983e28-860b-4c00-88c8-70bb31b01c54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:50:30.510112 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-59983e28-860b-4c00-88c8-70bb31b01c54 None None] MFA Rules not processed for user `f8c47ff5d72943f6bab09b5df6198d64`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:50:30.512091 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-59983e28-860b-4c00-88c8-70bb31b01c54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:50:30.529322 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:50:30.584488 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 603/1195] 10.222.0.74 () {58 vars in 1015 bytes} [Thu Oct 27 09:50:30 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 09:50:34.423220 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879a15d2-03a6-40e3-b189-61337f524c73 None None] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:50:34.423708 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879a15d2-03a6-40e3-b189-61337f524c73 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:50:34.423832 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879a15d2-03a6-40e3-b189-61337f524c73 None None] PATH_INFO: `/` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:50:34.425113 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 593/1196] 10.222.0.65 () {54 vars in 961 bytes} [Thu Oct 27 09:50:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 09:50:34.430368 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f26183-d43c-419f-8310-d2cbb111d42d None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:50:34.430845 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f26183-d43c-419f-8310-d2cbb111d42d None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:50:34.431039 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f26183-d43c-419f-8310-d2cbb111d42d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:50:34.453254 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-62f26183-d43c-419f-8310-d2cbb111d42d None None] MFA Rules not processed for user `f8c47ff5d72943f6bab09b5df6198d64`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:50:34.454475 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-62f26183-d43c-419f-8310-d2cbb111d42d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:50:34.463123 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 604/1197] 10.222.0.65 () {58 vars in 1058 bytes} [Thu Oct 27 09:50:34 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 09:50:34.471954 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879a15d2-03a6-40e3-b189-61337f524c73 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:50:34.486308 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879a15d2-03a6-40e3-b189-61337f524c73 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:50:34.491333 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbe5b98-641a-4176-a9fb-8195d5e27e8c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8c47ff5d72943f6bab09b5df6198d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc2e3a7a1bcc480891c0b433291c00b1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:50:34.491921 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbe5b98-641a-4176-a9fb-8195d5e27e8c service placement] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:50:34.492205 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbe5b98-641a-4176-a9fb-8195d5e27e8c service placement] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:50:34.492483 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbe5b98-641a-4176-a9fb-8195d5e27e8c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:50:34.500835 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbe5b98-641a-4176-a9fb-8195d5e27e8c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:50:34.502418 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbe5b98-641a-4176-a9fb-8195d5e27e8c service placement] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:50:34.512170 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 594/1198] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Oct 27 09:50:34 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 09:50:41.748660 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7840fe-5cfa-480b-a3f7-bccf455d0574 None None] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:50:41.749245 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7840fe-5cfa-480b-a3f7-bccf455d0574 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:50:41.749245 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7840fe-5cfa-480b-a3f7-bccf455d0574 None None] PATH_INFO: `/` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:50:41.750577 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 605/1199] 127.0.0.1 () {54 vars in 901 bytes} [Thu Oct 27 09:50:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 09:50:41.755400 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ac1e35-2bff-48c5-9d81-7560d2f6cd76 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:50:41.755835 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ac1e35-2bff-48c5-9d81-7560d2f6cd76 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:50:41.755939 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ac1e35-2bff-48c5-9d81-7560d2f6cd76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:50:41.775584 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-68ac1e35-2bff-48c5-9d81-7560d2f6cd76 None None] MFA Rules not processed for user `b5065084bf664b99bdeac46067cb0f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:50:41.777457 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-68ac1e35-2bff-48c5-9d81-7560d2f6cd76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:50:41.785392 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 595/1200] 127.0.0.1 () {58 vars in 998 bytes} [Thu Oct 27 09:50:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 09:50:41.940627 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7840fe-5cfa-480b-a3f7-bccf455d0574 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:50:41.955682 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7840fe-5cfa-480b-a3f7-bccf455d0574 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:50:41.961626 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2885a79f-7878-472c-90fe-f3b852f140c6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd0d23ef039d4f1591a589d302ef165f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc2e3a7a1bcc480891c0b433291c00b1', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:50:41.962218 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2885a79f-7878-472c-90fe-f3b852f140c6 service nova] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:50:41.962499 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2885a79f-7878-472c-90fe-f3b852f140c6 service nova] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:50:41.962799 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2885a79f-7878-472c-90fe-f3b852f140c6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:50:41.972129 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2885a79f-7878-472c-90fe-f3b852f140c6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:50:41.973733 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2885a79f-7878-472c-90fe-f3b852f140c6 service nova] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:50:41.983416 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 606/1201] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Oct 27 09:50:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 09:50:43.048440 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58663ca6-7810-430b-ba55-c8109380971a None None] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:50:43.048975 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58663ca6-7810-430b-ba55-c8109380971a None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:50:43.048975 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58663ca6-7810-430b-ba55-c8109380971a None None] PATH_INFO: `/` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:50:43.050245 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 596/1202] 127.0.0.1 () {54 vars in 901 bytes} [Thu Oct 27 09:50:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 09:50:43.055222 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34e8edf-f042-4eaf-9dbc-2e5eff8b2b8b None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:50:43.055639 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34e8edf-f042-4eaf-9dbc-2e5eff8b2b8b None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:50:43.055770 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34e8edf-f042-4eaf-9dbc-2e5eff8b2b8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:50:43.074823 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-d34e8edf-f042-4eaf-9dbc-2e5eff8b2b8b None None] MFA Rules not processed for user `b5065084bf664b99bdeac46067cb0f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:50:43.076024 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-d34e8edf-f042-4eaf-9dbc-2e5eff8b2b8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:50:43.083991 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 607/1203] 127.0.0.1 () {58 vars in 998 bytes} [Thu Oct 27 09:50:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 09:50:43.241340 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58663ca6-7810-430b-ba55-c8109380971a None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:50:43.256501 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58663ca6-7810-430b-ba55-c8109380971a None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:50:43.261830 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd730ff-f8a5-4e7f-af07-e13fe84da356 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd0d23ef039d4f1591a589d302ef165f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc2e3a7a1bcc480891c0b433291c00b1', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:50:43.262415 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd730ff-f8a5-4e7f-af07-e13fe84da356 service nova] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:50:43.262736 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd730ff-f8a5-4e7f-af07-e13fe84da356 service nova] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:50:43.263012 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd730ff-f8a5-4e7f-af07-e13fe84da356 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:50:43.271129 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd730ff-f8a5-4e7f-af07-e13fe84da356 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:50:43.272706 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd730ff-f8a5-4e7f-af07-e13fe84da356 service nova] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:50:43.283070 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 597/1204] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Oct 27 09:50:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 09:50:47.333436 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc67372-9c0a-45e3-b8c6-dad59a010d45 None None] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:50:47.334066 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc67372-9c0a-45e3-b8c6-dad59a010d45 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:50:47.334066 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc67372-9c0a-45e3-b8c6-dad59a010d45 None None] PATH_INFO: `/` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:50:47.335406 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 608/1205] 127.0.0.1 () {54 vars in 917 bytes} [Thu Oct 27 09:50:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 09:50:47.341903 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9042beb-16ce-47d1-b99a-3533e642671e None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:50:47.342717 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9042beb-16ce-47d1-b99a-3533e642671e None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:50:47.342893 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9042beb-16ce-47d1-b99a-3533e642671e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:50:47.363192 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-c9042beb-16ce-47d1-b99a-3533e642671e None None] MFA Rules not processed for user `b5065084bf664b99bdeac46067cb0f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:50:47.364435 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-c9042beb-16ce-47d1-b99a-3533e642671e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:50:47.372430 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 598/1206] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Oct 27 09:50:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 09:50:47.663311 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc67372-9c0a-45e3-b8c6-dad59a010d45 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:50:47.665011 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-acc67372-9c0a-45e3-b8c6-dad59a010d45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:50:47.743523 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc67372-9c0a-45e3-b8c6-dad59a010d45 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:50:47.747664 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422b1324-bf29-4d9e-a8b9-40b77a72d535 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6191cc41efa74f46b49022cf387f7a4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc2e3a7a1bcc480891c0b433291c00b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:50:47.748264 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422b1324-bf29-4d9e-a8b9-40b77a72d535 service neutron] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:50:47.748540 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422b1324-bf29-4d9e-a8b9-40b77a72d535 service neutron] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:50:47.748809 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422b1324-bf29-4d9e-a8b9-40b77a72d535 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:50:47.758156 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422b1324-bf29-4d9e-a8b9-40b77a72d535 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:50:47.759626 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422b1324-bf29-4d9e-a8b9-40b77a72d535 service neutron] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:50:47.769584 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 609/1207] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Oct 27 09:50:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 09:50:49.957091 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa4176e-3474-4343-a413-35fdf3304acb None None] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:50:49.957628 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa4176e-3474-4343-a413-35fdf3304acb None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:50:49.957628 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa4176e-3474-4343-a413-35fdf3304acb None None] PATH_INFO: `/` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:50:49.959080 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 599/1208] 127.0.0.1 () {54 vars in 917 bytes} [Thu Oct 27 09:50:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 09:50:49.964794 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723888b9-93b3-4590-b62c-98267f1b77fa None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:50:49.965314 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723888b9-93b3-4590-b62c-98267f1b77fa None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:50:49.965452 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723888b9-93b3-4590-b62c-98267f1b77fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:50:49.985266 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-723888b9-93b3-4590-b62c-98267f1b77fa None None] MFA Rules not processed for user `b5065084bf664b99bdeac46067cb0f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:50:49.986476 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-723888b9-93b3-4590-b62c-98267f1b77fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:50:49.994420 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 610/1209] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Oct 27 09:50:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 09:50:50.299801 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa4176e-3474-4343-a413-35fdf3304acb None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:50:50.311701 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa4176e-3474-4343-a413-35fdf3304acb None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:50:50.315345 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1d43b7-f222-4c0f-b02c-d15df714445e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6191cc41efa74f46b49022cf387f7a4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc2e3a7a1bcc480891c0b433291c00b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:50:50.316498 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1d43b7-f222-4c0f-b02c-d15df714445e service neutron] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:50:50.316498 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1d43b7-f222-4c0f-b02c-d15df714445e service neutron] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:50:50.316498 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1d43b7-f222-4c0f-b02c-d15df714445e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:50:50.326204 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1d43b7-f222-4c0f-b02c-d15df714445e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:50:50.327726 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1d43b7-f222-4c0f-b02c-d15df714445e service neutron] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:50:50.337500 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 600/1210] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Oct 27 09:50:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 09:50:54.021256 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b54e8b-3bb0-444c-b0d4-5865f9681cb3 None None] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:50:54.021832 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b54e8b-3bb0-444c-b0d4-5865f9681cb3 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:50:54.021935 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b54e8b-3bb0-444c-b0d4-5865f9681cb3 None None] PATH_INFO: `/` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:50:54.023278 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 611/1211] 127.0.0.1 () {54 vars in 917 bytes} [Thu Oct 27 09:50:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 09:50:54.029598 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291c990d-3fda-430a-b1fe-be0f2f02d40d None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:50:54.030389 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291c990d-3fda-430a-b1fe-be0f2f02d40d None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:50:54.030708 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291c990d-3fda-430a-b1fe-be0f2f02d40d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:50:54.038322 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=81 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:50:54.050624 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-291c990d-3fda-430a-b1fe-be0f2f02d40d None None] MFA Rules not processed for user `b5065084bf664b99bdeac46067cb0f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:50:54.069311 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-291c990d-3fda-430a-b1fe-be0f2f02d40d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:50:54.069311 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 601/1212] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Oct 27 09:50:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 09:50:54.374038 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b54e8b-3bb0-444c-b0d4-5865f9681cb3 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:50:54.375783 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-13b54e8b-3bb0-444c-b0d4-5865f9681cb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:50:54.443071 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:50:54.459905 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b54e8b-3bb0-444c-b0d4-5865f9681cb3 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:50:54.466000 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49620ca-5a1f-4eab-a4e6-2da18d218149 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8e5d5f04c4741bb86ca4a0f667d4ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc2e3a7a1bcc480891c0b433291c00b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:50:54.467061 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49620ca-5a1f-4eab-a4e6-2da18d218149 service cinder] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:50:54.467567 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49620ca-5a1f-4eab-a4e6-2da18d218149 service cinder] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:50:54.468059 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49620ca-5a1f-4eab-a4e6-2da18d218149 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:50:54.477800 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49620ca-5a1f-4eab-a4e6-2da18d218149 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:50:54.479385 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49620ca-5a1f-4eab-a4e6-2da18d218149 service cinder] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:50:54.488795 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 612/1213] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Oct 27 09:50:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 09:50:56.694594 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78a3c1e-a422-4045-9a46-aeac820dca10 None None] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:50:56.695169 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78a3c1e-a422-4045-9a46-aeac820dca10 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:50:56.695169 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78a3c1e-a422-4045-9a46-aeac820dca10 None None] PATH_INFO: `/` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:50:56.696546 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 602/1214] 127.0.0.1 () {54 vars in 917 bytes} [Thu Oct 27 09:50:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 09:50:56.703073 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cb1807-f0b6-4795-85f2-e63046babb79 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:50:56.703527 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cb1807-f0b6-4795-85f2-e63046babb79 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:50:56.703629 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cb1807-f0b6-4795-85f2-e63046babb79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:50:56.723072 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-c1cb1807-f0b6-4795-85f2-e63046babb79 None None] MFA Rules not processed for user `b5065084bf664b99bdeac46067cb0f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:50:56.724271 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-c1cb1807-f0b6-4795-85f2-e63046babb79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:50:56.732234 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 613/1215] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Oct 27 09:50:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 09:50:57.036993 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78a3c1e-a422-4045-9a46-aeac820dca10 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:50:57.039226 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-f78a3c1e-a422-4045-9a46-aeac820dca10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:50:57.053999 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78a3c1e-a422-4045-9a46-aeac820dca10 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:50:57.058659 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea82aeb7-0646-44bf-8116-9847202865c1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8e5d5f04c4741bb86ca4a0f667d4ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc2e3a7a1bcc480891c0b433291c00b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:50:57.059258 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea82aeb7-0646-44bf-8116-9847202865c1 service cinder] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:50:57.059539 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea82aeb7-0646-44bf-8116-9847202865c1 service cinder] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:50:57.059811 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea82aeb7-0646-44bf-8116-9847202865c1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:50:57.069104 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea82aeb7-0646-44bf-8116-9847202865c1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:50:57.070547 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea82aeb7-0646-44bf-8116-9847202865c1 service cinder] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:50:57.080304 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 603/1216] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Oct 27 09:50:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 09:51:06.718109 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=11 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:51:07.075933 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=8 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:52:28.481333 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b94d3b6-38f2-46ad-b460-39ca9a7d75cb None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:52:28.483001 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b94d3b6-38f2-46ad-b460-39ca9a7d75cb None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:52:28.483001 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b94d3b6-38f2-46ad-b460-39ca9a7d75cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:52:28.508937 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-0b94d3b6-38f2-46ad-b460-39ca9a7d75cb None None] MFA Rules not processed for user `b5065084bf664b99bdeac46067cb0f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:52:28.511179 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-0b94d3b6-38f2-46ad-b460-39ca9a7d75cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:52:28.526196 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 614/1217] 10.222.0.65 () {58 vars in 958 bytes} [Thu Oct 27 09:52:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 09:52:28.537123 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd60b18c-522a-4b22-bd10-089cfc897f58 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:52:28.537730 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd60b18c-522a-4b22-bd10-089cfc897f58 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:52:28.537730 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd60b18c-522a-4b22-bd10-089cfc897f58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:52:28.563386 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-dd60b18c-522a-4b22-bd10-089cfc897f58 None None] MFA Rules not processed for user `b5065084bf664b99bdeac46067cb0f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:52:28.564599 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-dd60b18c-522a-4b22-bd10-089cfc897f58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:52:28.578210 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 604/1218] 10.222.0.65 () {58 vars in 958 bytes} [Thu Oct 27 09:52:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 09:52:28.583148 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b94d3b6-38f2-46ad-b460-39ca9a7d75cb None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:52:28.599627 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b94d3b6-38f2-46ad-b460-39ca9a7d75cb None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:52:28.609012 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442661a5-7fd6-4c00-8e90-478491ca894e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:52:28.609966 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442661a5-7fd6-4c00-8e90-478491ca894e admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:52:28.610443 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442661a5-7fd6-4c00-8e90-478491ca894e admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:52:28.610943 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442661a5-7fd6-4c00-8e90-478491ca894e admin admin] PATH_INFO: `/v3/domains` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:52:28.611788 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442661a5-7fd6-4c00-8e90-478491ca894e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 09:52:28.612379 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442661a5-7fd6-4c00-8e90-478491ca894e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:52:28.614167 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442661a5-7fd6-4c00-8e90-478491ca894e admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:52:28.632729 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 615/1219] 10.222.0.65 () {58 vars in 1153 bytes} [Thu Oct 27 09:52:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 09:52:28.643326 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd60b18c-522a-4b22-bd10-089cfc897f58 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:52:28.658201 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd60b18c-522a-4b22-bd10-089cfc897f58 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:52:28.665380 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c6af39-1700-45ee-8e93-ac03e09a77f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:52:28.666269 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c6af39-1700-45ee-8e93-ac03e09a77f7 admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:52:28.666617 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c6af39-1700-45ee-8e93-ac03e09a77f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:52:28.666902 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c6af39-1700-45ee-8e93-ac03e09a77f7 admin admin] PATH_INFO: `/v3/projects` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:52:28.667579 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c6af39-1700-45ee-8e93-ac03e09a77f7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:52:28.669585 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c6af39-1700-45ee-8e93-ac03e09a77f7 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:52:28.831130 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 605/1220] 10.222.0.65 () {60 vars in 1153 bytes} [Thu Oct 27 09:52:28 2022] POST /identity/v3/projects => generated 383 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 09:52:28.835919 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442661a5-7fd6-4c00-8e90-478491ca894e admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:52:28.856730 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442661a5-7fd6-4c00-8e90-478491ca894e admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:52:28.949434 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6903b265-e50d-4c45-8b6c-2412325c17cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:52:28.950074 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6903b265-e50d-4c45-8b6c-2412325c17cd admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:52:28.950355 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6903b265-e50d-4c45-8b6c-2412325c17cd admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:52:28.950656 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6903b265-e50d-4c45-8b6c-2412325c17cd admin admin] PATH_INFO: `/v3/users` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:52:28.951488 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6903b265-e50d-4c45-8b6c-2412325c17cd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:52:28.953480 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6903b265-e50d-4c45-8b6c-2412325c17cd admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:52:29.055902 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 616/1221] 10.222.0.65 () {60 vars in 1144 bytes} [Thu Oct 27 09:52:28 2022] POST /identity/v3/users => generated 292 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 09:52:29.059736 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c6af39-1700-45ee-8e93-ac03e09a77f7 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:52:29.064578 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33ce92f-1db6-4e78-a08c-d6aed17bc89a None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:52:29.064863 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33ce92f-1db6-4e78-a08c-d6aed17bc89a None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:52:29.065069 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33ce92f-1db6-4e78-a08c-d6aed17bc89a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:52:29.075086 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c6af39-1700-45ee-8e93-ac03e09a77f7 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:52:29.082769 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac592ee-9f55-4ee6-9cdc-2acd861ae68c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:52:29.083737 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac592ee-9f55-4ee6-9cdc-2acd861ae68c admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:52:29.084022 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac592ee-9f55-4ee6-9cdc-2acd861ae68c admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:52:29.084302 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac592ee-9f55-4ee6-9cdc-2acd861ae68c admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:52:29.084955 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac592ee-9f55-4ee6-9cdc-2acd861ae68c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:52:29.086824 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac592ee-9f55-4ee6-9cdc-2acd861ae68c admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:52:29.096501 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-b33ce92f-1db6-4e78-a08c-d6aed17bc89a None None] MFA Rules not processed for user `b5065084bf664b99bdeac46067cb0f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:52:29.097740 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-b33ce92f-1db6-4e78-a08c-d6aed17bc89a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:52:29.103902 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 606/1222] 10.222.0.65 () {58 vars in 1122 bytes} [Thu Oct 27 09:52:29 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 09:52:29.112540 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedd197b-80f2-43b6-8b52-7c5153c51f06 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:52:29.112818 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedd197b-80f2-43b6-8b52-7c5153c51f06 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:52:29.113079 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedd197b-80f2-43b6-8b52-7c5153c51f06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:52:29.124528 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 617/1223] 10.222.0.65 () {58 vars in 958 bytes} [Thu Oct 27 09:52:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 09:52:29.125391 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33ce92f-1db6-4e78-a08c-d6aed17bc89a None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:52:29.151998 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-cedd197b-80f2-43b6-8b52-7c5153c51f06 None None] MFA Rules not processed for user `b5065084bf664b99bdeac46067cb0f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:52:29.152344 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33ce92f-1db6-4e78-a08c-d6aed17bc89a None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:52:29.153333 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-cedd197b-80f2-43b6-8b52-7c5153c51f06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:52:29.164165 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeedb0cb-de14-4829-b96c-0c9bd6762363 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:52:29.164787 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeedb0cb-de14-4829-b96c-0c9bd6762363 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:52:29.165070 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeedb0cb-de14-4829-b96c-0c9bd6762363 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:52:29.165346 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeedb0cb-de14-4829-b96c-0c9bd6762363 admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:52:29.166841 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeedb0cb-de14-4829-b96c-0c9bd6762363 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:52:29.168473 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeedb0cb-de14-4829-b96c-0c9bd6762363 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:52:29.169246 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 607/1224] 10.222.0.65 () {58 vars in 958 bytes} [Thu Oct 27 09:52:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 09:52:29.170601 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e963afaa-d0fd-431a-be6d-8088c2f658a3 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:52:29.170889 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e963afaa-d0fd-431a-be6d-8088c2f658a3 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:52:29.171165 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e963afaa-d0fd-431a-be6d-8088c2f658a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:52:29.191103 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 618/1225] 10.222.0.65 () {58 vars in 1122 bytes} [Thu Oct 27 09:52:29 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 09:52:29.192456 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d892e6-970b-4f6f-bb13-73f9169e0bb1 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:52:29.192740 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d892e6-970b-4f6f-bb13-73f9169e0bb1 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:52:29.193011 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d892e6-970b-4f6f-bb13-73f9169e0bb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:52:29.193432 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-e963afaa-d0fd-431a-be6d-8088c2f658a3 None None] MFA Rules not processed for user `b5065084bf664b99bdeac46067cb0f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:52:29.202600 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-e963afaa-d0fd-431a-be6d-8088c2f658a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:52:29.211774 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 608/1226] 10.222.0.65 () {58 vars in 958 bytes} [Thu Oct 27 09:52:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 09:52:29.214219 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7a1b99-ca6f-442f-80c0-b4814b330ed7 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:52:29.214527 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7a1b99-ca6f-442f-80c0-b4814b330ed7 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:52:29.219687 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7a1b99-ca6f-442f-80c0-b4814b330ed7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:52:29.220960 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-41d892e6-970b-4f6f-bb13-73f9169e0bb1 None None] MFA Rules not processed for user `b5065084bf664b99bdeac46067cb0f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:52:29.222704 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-41d892e6-970b-4f6f-bb13-73f9169e0bb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:52:29.250773 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 619/1227] 10.222.0.65 () {58 vars in 958 bytes} [Thu Oct 27 09:52:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 09:52:29.252010 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d892e6-970b-4f6f-bb13-73f9169e0bb1 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:52:29.258641 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-5c7a1b99-ca6f-442f-80c0-b4814b330ed7 None None] MFA Rules not processed for user `b5065084bf664b99bdeac46067cb0f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:52:29.261268 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-5c7a1b99-ca6f-442f-80c0-b4814b330ed7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:52:29.264764 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d892e6-970b-4f6f-bb13-73f9169e0bb1 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:52:29.277446 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8e1dae-dae4-4967-9687-008ab6b2f305 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:52:29.278394 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 609/1228] 10.222.0.65 () {58 vars in 958 bytes} [Thu Oct 27 09:52:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 09:52:29.278839 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8e1dae-dae4-4967-9687-008ab6b2f305 admin admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:52:29.279277 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8e1dae-dae4-4967-9687-008ab6b2f305 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:52:29.279576 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7a1b99-ca6f-442f-80c0-b4814b330ed7 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:52:29.279911 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8e1dae-dae4-4967-9687-008ab6b2f305 admin admin] PATH_INFO: `/v3/projects/65915f6e7295487b80da1fa669235c3d/users/2acf9b6c3a394be389cd17d7fade3cf4/roles/43543ce1450245af9661cb017bac17bd` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:52:29.292735 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7a1b99-ca6f-442f-80c0-b4814b330ed7 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:52:29.297648 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8e1dae-dae4-4967-9687-008ab6b2f305 admin admin] RBAC: Authorizing `identity:create_grant(project_id=65915f6e7295487b80da1fa669235c3d, user_id=2acf9b6c3a394be389cd17d7fade3cf4, role_id=43543ce1450245af9661cb017bac17bd)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:52:29.298146 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b30eca3-ef53-4f8a-93a3-7c7fda6f3abe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:52:29.298976 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b30eca3-ef53-4f8a-93a3-7c7fda6f3abe admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:52:29.299478 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b30eca3-ef53-4f8a-93a3-7c7fda6f3abe admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:52:29.299820 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b30eca3-ef53-4f8a-93a3-7c7fda6f3abe admin admin] PATH_INFO: `/v3/domains` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:52:29.300464 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8e1dae-dae4-4967-9687-008ab6b2f305 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:52:29.300608 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b30eca3-ef53-4f8a-93a3-7c7fda6f3abe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 09:52:29.300990 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b30eca3-ef53-4f8a-93a3-7c7fda6f3abe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:52:29.302068 dv-cinder-797970-7-smb devstack@keystone.service[88312]: WARNING py.warnings [None req-2b30eca3-ef53-4f8a-93a3-7c7fda6f3abe admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 09:52:29.302068 dv-cinder-797970-7-smb devstack@keystone.service[88312]: warnings.warn(msg) Oct 27 09:52:29.302068 dv-cinder-797970-7-smb devstack@keystone.service[88312]: Oct 27 09:52:29.303173 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b30eca3-ef53-4f8a-93a3-7c7fda6f3abe admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:52:29.322658 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 610/1229] 10.222.0.65 () {58 vars in 1153 bytes} [Thu Oct 27 09:52:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 09:52:29.322658 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74d4763-8d46-44bf-a50b-085bbffd1534 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:52:29.322658 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74d4763-8d46-44bf-a50b-085bbffd1534 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:52:29.322658 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74d4763-8d46-44bf-a50b-085bbffd1534 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:52:29.342368 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-f74d4763-8d46-44bf-a50b-085bbffd1534 None None] MFA Rules not processed for user `b5065084bf664b99bdeac46067cb0f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:52:29.343674 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-f74d4763-8d46-44bf-a50b-085bbffd1534 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:52:29.351646 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 611/1230] 10.222.0.65 () {58 vars in 958 bytes} [Thu Oct 27 09:52:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 09:52:29.352818 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7331ddeb-0c1e-4dc2-9073-67542374c9c8 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:52:29.353160 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7331ddeb-0c1e-4dc2-9073-67542374c9c8 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:52:29.353952 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7331ddeb-0c1e-4dc2-9073-67542374c9c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:52:29.375311 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-7331ddeb-0c1e-4dc2-9073-67542374c9c8 None None] MFA Rules not processed for user `b5065084bf664b99bdeac46067cb0f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:52:29.375613 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 620/1231] 10.222.0.65 () {60 vars in 1483 bytes} [Thu Oct 27 09:52:29 2022] PUT /identity/v3/projects/65915f6e7295487b80da1fa669235c3d/users/2acf9b6c3a394be389cd17d7fade3cf4/roles/43543ce1450245af9661cb017bac17bd => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 09:52:29.376525 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-7331ddeb-0c1e-4dc2-9073-67542374c9c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:52:29.376862 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0aabb80-d451-4be1-bd39-3e9352dc8031 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:52:29.377149 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0aabb80-d451-4be1-bd39-3e9352dc8031 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:52:29.377424 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0aabb80-d451-4be1-bd39-3e9352dc8031 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:52:29.397498 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-b0aabb80-d451-4be1-bd39-3e9352dc8031 None None] MFA Rules not processed for user `b5065084bf664b99bdeac46067cb0f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:52:29.402436 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-b0aabb80-d451-4be1-bd39-3e9352dc8031 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:52:29.447875 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 612/1232] 10.222.0.65 () {58 vars in 958 bytes} [Thu Oct 27 09:52:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 09:52:29.449275 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bbff23-0a15-4505-b346-a1fb7e110009 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:52:29.449574 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bbff23-0a15-4505-b346-a1fb7e110009 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:52:29.449851 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bbff23-0a15-4505-b346-a1fb7e110009 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:52:29.466297 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 621/1233] 10.222.0.65 () {58 vars in 958 bytes} [Thu Oct 27 09:52:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 09:52:29.467418 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0aabb80-d451-4be1-bd39-3e9352dc8031 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:52:29.476361 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-d1bbff23-0a15-4505-b346-a1fb7e110009 None None] MFA Rules not processed for user `b5065084bf664b99bdeac46067cb0f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:52:29.476894 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0aabb80-d451-4be1-bd39-3e9352dc8031 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:52:29.477706 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-d1bbff23-0a15-4505-b346-a1fb7e110009 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:52:29.482317 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6357b80-e87f-44f5-b0ae-e49243d2d18a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:52:29.483055 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6357b80-e87f-44f5-b0ae-e49243d2d18a admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:52:29.483774 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6357b80-e87f-44f5-b0ae-e49243d2d18a admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:52:29.483774 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6357b80-e87f-44f5-b0ae-e49243d2d18a admin admin] PATH_INFO: `/v3/domains` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:52:29.484264 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6357b80-e87f-44f5-b0ae-e49243d2d18a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 09:52:29.484574 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6357b80-e87f-44f5-b0ae-e49243d2d18a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:52:29.486183 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6357b80-e87f-44f5-b0ae-e49243d2d18a admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:52:29.487027 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 613/1234] 10.222.0.65 () {58 vars in 958 bytes} [Thu Oct 27 09:52:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 09:52:29.488478 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43af8cdb-543d-435b-a45f-746f48e80224 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:52:29.489311 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43af8cdb-543d-435b-a45f-746f48e80224 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:52:29.489596 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43af8cdb-543d-435b-a45f-746f48e80224 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:52:29.499307 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 622/1235] 10.222.0.65 () {58 vars in 1153 bytes} [Thu Oct 27 09:52:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 09:52:29.500233 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6357b80-e87f-44f5-b0ae-e49243d2d18a admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:52:29.510573 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6357b80-e87f-44f5-b0ae-e49243d2d18a admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:52:29.515729 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a46fbb-9be1-4ca9-9bfb-42a6d51c883d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:52:29.516318 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a46fbb-9be1-4ca9-9bfb-42a6d51c883d admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:52:29.516597 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a46fbb-9be1-4ca9-9bfb-42a6d51c883d admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:52:29.516868 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a46fbb-9be1-4ca9-9bfb-42a6d51c883d admin admin] PATH_INFO: `/v3/projects` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:52:29.517490 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a46fbb-9be1-4ca9-9bfb-42a6d51c883d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:52:29.518190 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-43af8cdb-543d-435b-a45f-746f48e80224 None None] MFA Rules not processed for user `b5065084bf664b99bdeac46067cb0f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:52:29.518494 dv-cinder-797970-7-smb devstack@keystone.service[88311]: WARNING py.warnings [None req-c4a46fbb-9be1-4ca9-9bfb-42a6d51c883d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 27 09:52:29.518494 dv-cinder-797970-7-smb devstack@keystone.service[88311]: warnings.warn(msg) Oct 27 09:52:29.518494 dv-cinder-797970-7-smb devstack@keystone.service[88311]: Oct 27 09:52:29.519509 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-43af8cdb-543d-435b-a45f-746f48e80224 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:52:29.519717 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a46fbb-9be1-4ca9-9bfb-42a6d51c883d admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:52:29.525475 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:52:29.528241 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 614/1236] 10.222.0.65 () {58 vars in 958 bytes} [Thu Oct 27 09:52:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 09:52:29.529499 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf55863f-8437-4026-86d1-540e1e8ce7c0 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:52:29.529847 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf55863f-8437-4026-86d1-540e1e8ce7c0 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:52:29.530069 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf55863f-8437-4026-86d1-540e1e8ce7c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:52:29.550022 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-cf55863f-8437-4026-86d1-540e1e8ce7c0 None None] MFA Rules not processed for user `b5065084bf664b99bdeac46067cb0f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:52:29.551251 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-cf55863f-8437-4026-86d1-540e1e8ce7c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:52:29.559669 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 615/1237] 10.222.0.65 () {58 vars in 958 bytes} [Thu Oct 27 09:52:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 09:52:29.560835 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ef504e-ba88-4628-8677-d423afe34546 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:52:29.561160 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ef504e-ba88-4628-8677-d423afe34546 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:52:29.561506 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ef504e-ba88-4628-8677-d423afe34546 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:52:29.580402 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-79ef504e-ba88-4628-8677-d423afe34546 None None] MFA Rules not processed for user `b5065084bf664b99bdeac46067cb0f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:52:29.581519 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-79ef504e-ba88-4628-8677-d423afe34546 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:52:29.589159 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 616/1238] 10.222.0.65 () {58 vars in 958 bytes} [Thu Oct 27 09:52:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 09:52:29.590329 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e23223-03e5-45e0-b1b5-0981b6c1d1cb None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:52:29.590654 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e23223-03e5-45e0-b1b5-0981b6c1d1cb None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:52:29.590928 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e23223-03e5-45e0-b1b5-0981b6c1d1cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:52:29.610188 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-43e23223-03e5-45e0-b1b5-0981b6c1d1cb None None] MFA Rules not processed for user `b5065084bf664b99bdeac46067cb0f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:52:29.611410 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-43e23223-03e5-45e0-b1b5-0981b6c1d1cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:52:29.619890 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 617/1239] 10.222.0.65 () {58 vars in 958 bytes} [Thu Oct 27 09:52:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 09:52:29.620722 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e23223-03e5-45e0-b1b5-0981b6c1d1cb None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:52:29.630305 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e23223-03e5-45e0-b1b5-0981b6c1d1cb None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:52:29.633051 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 623/1240] 10.222.0.65 () {60 vars in 1153 bytes} [Thu Oct 27 09:52:29 2022] POST /identity/v3/projects => generated 389 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 09:52:29.637208 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cb9d79-9a7e-48cf-ab8b-3f9a06bd9b96 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:52:29.637327 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc071b5-509d-43dd-845b-eae4772ecf9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:52:29.637426 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cb9d79-9a7e-48cf-ab8b-3f9a06bd9b96 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:52:29.637426 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cb9d79-9a7e-48cf-ab8b-3f9a06bd9b96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:52:29.637579 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc071b5-509d-43dd-845b-eae4772ecf9f admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:52:29.637579 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc071b5-509d-43dd-845b-eae4772ecf9f admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:52:29.637579 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc071b5-509d-43dd-845b-eae4772ecf9f admin admin] PATH_INFO: `/v3/domains` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:52:29.637579 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc071b5-509d-43dd-845b-eae4772ecf9f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 09:52:29.637927 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc071b5-509d-43dd-845b-eae4772ecf9f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:52:29.639363 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc071b5-509d-43dd-845b-eae4772ecf9f admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:52:29.651757 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 618/1241] 10.222.0.65 () {58 vars in 1153 bytes} [Thu Oct 27 09:52:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 09:52:29.652518 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc071b5-509d-43dd-845b-eae4772ecf9f admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:52:29.656050 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-44cb9d79-9a7e-48cf-ab8b-3f9a06bd9b96 None None] MFA Rules not processed for user `b5065084bf664b99bdeac46067cb0f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:52:29.657294 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-44cb9d79-9a7e-48cf-ab8b-3f9a06bd9b96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:52:29.663448 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc071b5-509d-43dd-845b-eae4772ecf9f admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:52:29.687833 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:52:29.722628 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4436ff57-27fa-423d-88cd-942342a0dae4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:52:29.723244 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4436ff57-27fa-423d-88cd-942342a0dae4 admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:52:29.723532 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4436ff57-27fa-423d-88cd-942342a0dae4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:52:29.723811 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4436ff57-27fa-423d-88cd-942342a0dae4 admin admin] PATH_INFO: `/v3/projects` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:52:29.729175 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4436ff57-27fa-423d-88cd-942342a0dae4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:52:29.729347 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 624/1242] 10.222.0.65 () {58 vars in 958 bytes} [Thu Oct 27 09:52:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 09:52:29.729347 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad42ed8-cf9b-4a0f-8b59-5cf5bb0cb7db None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:52:29.729347 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad42ed8-cf9b-4a0f-8b59-5cf5bb0cb7db None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:52:29.729347 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad42ed8-cf9b-4a0f-8b59-5cf5bb0cb7db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:52:29.729671 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4436ff57-27fa-423d-88cd-942342a0dae4 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:52:29.747901 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-0ad42ed8-cf9b-4a0f-8b59-5cf5bb0cb7db None None] MFA Rules not processed for user `b5065084bf664b99bdeac46067cb0f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:52:29.749116 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-0ad42ed8-cf9b-4a0f-8b59-5cf5bb0cb7db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:52:29.757172 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 625/1243] 10.222.0.65 () {58 vars in 958 bytes} [Thu Oct 27 09:52:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 09:52:29.757999 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad42ed8-cf9b-4a0f-8b59-5cf5bb0cb7db None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:52:29.768376 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad42ed8-cf9b-4a0f-8b59-5cf5bb0cb7db None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:52:29.773311 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07e3416-82f8-449e-81c6-dd4b87f687d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:52:29.778489 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07e3416-82f8-449e-81c6-dd4b87f687d0 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:52:29.778489 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07e3416-82f8-449e-81c6-dd4b87f687d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:52:29.778489 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07e3416-82f8-449e-81c6-dd4b87f687d0 admin admin] PATH_INFO: `/v3/domains` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:52:29.778489 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07e3416-82f8-449e-81c6-dd4b87f687d0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 09:52:29.778489 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07e3416-82f8-449e-81c6-dd4b87f687d0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:52:29.778489 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07e3416-82f8-449e-81c6-dd4b87f687d0 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:52:29.789637 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 626/1244] 10.222.0.65 () {58 vars in 1153 bytes} [Thu Oct 27 09:52:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 09:52:29.791062 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07e3416-82f8-449e-81c6-dd4b87f687d0 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:52:29.849068 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07e3416-82f8-449e-81c6-dd4b87f687d0 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:52:29.852902 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d710f1c-4a75-4574-a4ad-f1e531a883e2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6191cc41efa74f46b49022cf387f7a4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc2e3a7a1bcc480891c0b433291c00b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:52:29.853535 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d710f1c-4a75-4574-a4ad-f1e531a883e2 service neutron] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:52:29.853814 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d710f1c-4a75-4574-a4ad-f1e531a883e2 service neutron] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:52:29.854083 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d710f1c-4a75-4574-a4ad-f1e531a883e2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:52:29.863397 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d710f1c-4a75-4574-a4ad-f1e531a883e2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:52:29.864820 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d710f1c-4a75-4574-a4ad-f1e531a883e2 service neutron] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:52:29.867689 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 619/1245] 10.222.0.65 () {60 vars in 1153 bytes} [Thu Oct 27 09:52:29 2022] POST /identity/v3/projects => generated 383 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 09:52:29.870294 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4436ff57-27fa-423d-88cd-942342a0dae4 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:52:29.875269 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 627/1246] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Oct 27 09:52:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 09:52:29.876135 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d710f1c-4a75-4574-a4ad-f1e531a883e2 service neutron] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:52:29.886923 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d710f1c-4a75-4574-a4ad-f1e531a883e2 service neutron] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:52:29.941360 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4436ff57-27fa-423d-88cd-942342a0dae4 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:52:29.946271 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680635e6-1201-4a74-8646-86aca06a3c3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:52:29.947463 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680635e6-1201-4a74-8646-86aca06a3c3e admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:52:29.947742 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680635e6-1201-4a74-8646-86aca06a3c3e admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:52:29.948018 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680635e6-1201-4a74-8646-86aca06a3c3e admin admin] PATH_INFO: `/v3/domains` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:52:29.948664 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680635e6-1201-4a74-8646-86aca06a3c3e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 09:52:29.948968 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680635e6-1201-4a74-8646-86aca06a3c3e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:52:29.950675 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680635e6-1201-4a74-8646-86aca06a3c3e admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:52:29.951034 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b954ede-7b1d-424a-85cf-957a4fc2d83c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:52:29.951649 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b954ede-7b1d-424a-85cf-957a4fc2d83c admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:52:29.951934 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b954ede-7b1d-424a-85cf-957a4fc2d83c admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:52:29.952416 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b954ede-7b1d-424a-85cf-957a4fc2d83c admin admin] PATH_INFO: `/v3/users` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:52:29.953627 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b954ede-7b1d-424a-85cf-957a4fc2d83c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:52:29.955838 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b954ede-7b1d-424a-85cf-957a4fc2d83c admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:52:29.963213 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 620/1247] 10.222.0.65 () {58 vars in 1153 bytes} [Thu Oct 27 09:52:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 09:52:29.964255 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680635e6-1201-4a74-8646-86aca06a3c3e admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:52:29.976093 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680635e6-1201-4a74-8646-86aca06a3c3e admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:52:29.981412 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76b2e7d-6689-4874-87a0-d758d96cea18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:52:29.982014 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76b2e7d-6689-4874-87a0-d758d96cea18 admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:52:29.982338 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76b2e7d-6689-4874-87a0-d758d96cea18 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:52:29.982646 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76b2e7d-6689-4874-87a0-d758d96cea18 admin admin] PATH_INFO: `/v3/projects` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:52:29.983282 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76b2e7d-6689-4874-87a0-d758d96cea18 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:52:29.985213 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76b2e7d-6689-4874-87a0-d758d96cea18 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:52:30.061557 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:52:30.067365 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 628/1248] 10.222.0.65 () {60 vars in 1144 bytes} [Thu Oct 27 09:52:29 2022] POST /identity/v3/users => generated 295 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 09:52:30.068757 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b954ede-7b1d-424a-85cf-957a4fc2d83c admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:52:30.079022 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b954ede-7b1d-424a-85cf-957a4fc2d83c admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:52:30.083914 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc17b59-2e21-4796-b98a-f95acdf329ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:52:30.097261 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc17b59-2e21-4796-b98a-f95acdf329ff admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:52:30.097261 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc17b59-2e21-4796-b98a-f95acdf329ff admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:52:30.097261 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc17b59-2e21-4796-b98a-f95acdf329ff admin admin] PATH_INFO: `/v3/domains` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:52:30.097261 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc17b59-2e21-4796-b98a-f95acdf329ff admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 09:52:30.097261 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc17b59-2e21-4796-b98a-f95acdf329ff admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:52:30.097261 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc17b59-2e21-4796-b98a-f95acdf329ff admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:52:30.101386 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 629/1249] 10.222.0.65 () {58 vars in 1153 bytes} [Thu Oct 27 09:52:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 09:52:30.102253 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc17b59-2e21-4796-b98a-f95acdf329ff admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:52:30.113313 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc17b59-2e21-4796-b98a-f95acdf329ff admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:52:30.118258 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0734116-a99d-4199-8e18-a1c330be9fe2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:52:30.119442 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0734116-a99d-4199-8e18-a1c330be9fe2 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:52:30.120216 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0734116-a99d-4199-8e18-a1c330be9fe2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:52:30.120216 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0734116-a99d-4199-8e18-a1c330be9fe2 admin admin] PATH_INFO: `/v3/domains` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:52:30.120737 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0734116-a99d-4199-8e18-a1c330be9fe2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 09:52:30.121045 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0734116-a99d-4199-8e18-a1c330be9fe2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:52:30.122710 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0734116-a99d-4199-8e18-a1c330be9fe2 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:52:30.125828 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 621/1250] 10.222.0.65 () {60 vars in 1153 bytes} [Thu Oct 27 09:52:29 2022] POST /identity/v3/projects => generated 373 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 09:52:30.126696 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76b2e7d-6689-4874-87a0-d758d96cea18 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:52:30.146913 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 630/1251] 10.222.0.65 () {58 vars in 1153 bytes} [Thu Oct 27 09:52:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 09:52:30.146913 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0734116-a99d-4199-8e18-a1c330be9fe2 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:52:30.154468 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0734116-a99d-4199-8e18-a1c330be9fe2 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:52:30.202774 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76b2e7d-6689-4874-87a0-d758d96cea18 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:52:30.207739 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7363df10-0d99-4c34-a5ef-3651f51b6b42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:52:30.208363 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7363df10-0d99-4c34-a5ef-3651f51b6b42 admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:52:30.208643 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7363df10-0d99-4c34-a5ef-3651f51b6b42 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:52:30.208919 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7363df10-0d99-4c34-a5ef-3651f51b6b42 admin admin] PATH_INFO: `/v3/projects` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:52:30.209553 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7363df10-0d99-4c34-a5ef-3651f51b6b42 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:52:30.211542 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7363df10-0d99-4c34-a5ef-3651f51b6b42 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:52:30.221485 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8810e7de-781f-4fd2-945b-bc5dd95c2565 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:52:30.222629 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8810e7de-781f-4fd2-945b-bc5dd95c2565 admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:52:30.223036 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8810e7de-781f-4fd2-945b-bc5dd95c2565 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:52:30.223196 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8810e7de-781f-4fd2-945b-bc5dd95c2565 admin admin] PATH_INFO: `/v3/users` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:52:30.224015 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8810e7de-781f-4fd2-945b-bc5dd95c2565 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:52:30.226989 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8810e7de-781f-4fd2-945b-bc5dd95c2565 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:52:30.341362 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 622/1252] 10.222.0.65 () {60 vars in 1153 bytes} [Thu Oct 27 09:52:30 2022] POST /identity/v3/projects => generated 373 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 09:52:30.342687 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7363df10-0d99-4c34-a5ef-3651f51b6b42 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:52:30.353057 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:52:30.369850 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 631/1253] 10.222.0.65 () {60 vars in 1144 bytes} [Thu Oct 27 09:52:30 2022] POST /identity/v3/users => generated 292 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 09:52:30.371024 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8810e7de-781f-4fd2-945b-bc5dd95c2565 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:52:30.382229 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8810e7de-781f-4fd2-945b-bc5dd95c2565 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:52:30.408417 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7363df10-0d99-4c34-a5ef-3651f51b6b42 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:52:30.413579 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086632ba-bb3b-4412-bd14-f3c6b14533e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:52:30.414189 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086632ba-bb3b-4412-bd14-f3c6b14533e9 admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:52:30.414476 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086632ba-bb3b-4412-bd14-f3c6b14533e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:52:30.414779 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086632ba-bb3b-4412-bd14-f3c6b14533e9 admin admin] PATH_INFO: `/v3/projects` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:52:30.415411 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086632ba-bb3b-4412-bd14-f3c6b14533e9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:52:30.418064 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086632ba-bb3b-4412-bd14-f3c6b14533e9 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:52:30.444632 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9937dfef-d151-4fc0-b73f-6f1a59036337 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:52:30.450006 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9937dfef-d151-4fc0-b73f-6f1a59036337 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:52:30.450006 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9937dfef-d151-4fc0-b73f-6f1a59036337 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:52:30.450006 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9937dfef-d151-4fc0-b73f-6f1a59036337 admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:52:30.450006 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9937dfef-d151-4fc0-b73f-6f1a59036337 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:52:30.450006 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9937dfef-d151-4fc0-b73f-6f1a59036337 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:52:30.458882 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 632/1254] 10.222.0.65 () {58 vars in 1122 bytes} [Thu Oct 27 09:52:30 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 09:52:30.459669 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9937dfef-d151-4fc0-b73f-6f1a59036337 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:52:30.472207 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9937dfef-d151-4fc0-b73f-6f1a59036337 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:52:30.479884 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d3577f-9842-40fe-a3f6-81c6e9a12622 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:52:30.480472 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d3577f-9842-40fe-a3f6-81c6e9a12622 admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:52:30.480760 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d3577f-9842-40fe-a3f6-81c6e9a12622 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:52:30.481046 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d3577f-9842-40fe-a3f6-81c6e9a12622 admin admin] PATH_INFO: `/v3/projects` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:52:30.481662 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d3577f-9842-40fe-a3f6-81c6e9a12622 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:52:30.483657 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d3577f-9842-40fe-a3f6-81c6e9a12622 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:52:30.524664 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 623/1255] 10.222.0.65 () {60 vars in 1153 bytes} [Thu Oct 27 09:52:30 2022] POST /identity/v3/projects => generated 363 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 09:52:30.524664 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086632ba-bb3b-4412-bd14-f3c6b14533e9 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:52:30.589694 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 633/1256] 10.222.0.65 () {60 vars in 1153 bytes} [Thu Oct 27 09:52:30 2022] POST /identity/v3/projects => generated 391 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 09:52:30.591866 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d3577f-9842-40fe-a3f6-81c6e9a12622 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:52:30.608174 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086632ba-bb3b-4412-bd14-f3c6b14533e9 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:52:30.648954 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:52:30.673338 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d3577f-9842-40fe-a3f6-81c6e9a12622 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:52:30.673670 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adafb79c-4c0e-4fe1-96cd-2284491beb6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:52:30.674282 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adafb79c-4c0e-4fe1-96cd-2284491beb6c admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:52:30.674721 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adafb79c-4c0e-4fe1-96cd-2284491beb6c admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:52:30.674934 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adafb79c-4c0e-4fe1-96cd-2284491beb6c admin admin] PATH_INFO: `/v3/users` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:52:30.675641 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adafb79c-4c0e-4fe1-96cd-2284491beb6c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:52:30.676642 dv-cinder-797970-7-smb devstack@keystone.service[88312]: WARNING py.warnings [None req-adafb79c-4c0e-4fe1-96cd-2284491beb6c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 27 09:52:30.676642 dv-cinder-797970-7-smb devstack@keystone.service[88312]: warnings.warn(msg) Oct 27 09:52:30.676642 dv-cinder-797970-7-smb devstack@keystone.service[88312]: Oct 27 09:52:30.677849 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adafb79c-4c0e-4fe1-96cd-2284491beb6c admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:52:30.678595 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95202e76-a09f-45a7-ad9e-7ca1684aafc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:52:30.679204 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95202e76-a09f-45a7-ad9e-7ca1684aafc3 admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:52:30.679488 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95202e76-a09f-45a7-ad9e-7ca1684aafc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:52:30.679762 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95202e76-a09f-45a7-ad9e-7ca1684aafc3 admin admin] PATH_INFO: `/v3/projects` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:52:30.680394 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95202e76-a09f-45a7-ad9e-7ca1684aafc3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:52:30.682887 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95202e76-a09f-45a7-ad9e-7ca1684aafc3 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:52:30.795103 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 624/1257] 10.222.0.65 () {60 vars in 1144 bytes} [Thu Oct 27 09:52:30 2022] POST /identity/v3/users => generated 287 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 09:52:30.795103 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adafb79c-4c0e-4fe1-96cd-2284491beb6c admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:52:30.804440 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adafb79c-4c0e-4fe1-96cd-2284491beb6c admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:52:30.809298 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b5de98-9fef-478b-90af-13e1e2d61618 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:52:30.809937 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b5de98-9fef-478b-90af-13e1e2d61618 admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:52:30.810219 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b5de98-9fef-478b-90af-13e1e2d61618 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:52:30.810498 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b5de98-9fef-478b-90af-13e1e2d61618 admin admin] PATH_INFO: `/v3/users` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:52:30.811168 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b5de98-9fef-478b-90af-13e1e2d61618 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:52:30.813280 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b5de98-9fef-478b-90af-13e1e2d61618 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:52:30.872740 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 634/1258] 10.222.0.65 () {60 vars in 1153 bytes} [Thu Oct 27 09:52:30 2022] POST /identity/v3/projects => generated 377 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 09:52:30.872740 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95202e76-a09f-45a7-ad9e-7ca1684aafc3 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:52:30.929216 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 625/1259] 10.222.0.65 () {60 vars in 1144 bytes} [Thu Oct 27 09:52:30 2022] POST /identity/v3/users => generated 287 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 09:52:30.934120 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b5de98-9fef-478b-90af-13e1e2d61618 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:52:30.936873 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95202e76-a09f-45a7-ad9e-7ca1684aafc3 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:52:30.941762 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4ce3ce-948a-4e8a-8ac3-eace3a6f067b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:52:30.942456 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4ce3ce-948a-4e8a-8ac3-eace3a6f067b admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:52:30.942855 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4ce3ce-948a-4e8a-8ac3-eace3a6f067b admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:52:30.943138 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4ce3ce-948a-4e8a-8ac3-eace3a6f067b admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:52:30.943843 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4ce3ce-948a-4e8a-8ac3-eace3a6f067b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:52:30.944911 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b5de98-9fef-478b-90af-13e1e2d61618 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:52:30.945522 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4ce3ce-948a-4e8a-8ac3-eace3a6f067b admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:52:30.950408 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d098fd2-0514-414f-8dc2-f30fcc610a82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:52:30.951187 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d098fd2-0514-414f-8dc2-f30fcc610a82 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:52:30.951561 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d098fd2-0514-414f-8dc2-f30fcc610a82 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:52:30.951957 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d098fd2-0514-414f-8dc2-f30fcc610a82 admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:52:30.952689 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d098fd2-0514-414f-8dc2-f30fcc610a82 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:52:30.954366 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d098fd2-0514-414f-8dc2-f30fcc610a82 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:52:30.957603 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 635/1260] 10.222.0.65 () {58 vars in 1122 bytes} [Thu Oct 27 09:52:30 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 09:52:30.959514 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4ce3ce-948a-4e8a-8ac3-eace3a6f067b admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:52:30.965831 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 626/1261] 10.222.0.65 () {58 vars in 1122 bytes} [Thu Oct 27 09:52:30 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 09:52:30.966729 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d098fd2-0514-414f-8dc2-f30fcc610a82 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:52:30.972084 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:52:30.972259 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4ce3ce-948a-4e8a-8ac3-eace3a6f067b admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:52:30.976935 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7dfdc7e-5faa-4a63-935d-966b11eb1a9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:52:30.977334 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d098fd2-0514-414f-8dc2-f30fcc610a82 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:52:30.977538 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dfdc7e-5faa-4a63-935d-966b11eb1a9b admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:52:30.977819 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dfdc7e-5faa-4a63-935d-966b11eb1a9b admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:52:30.978132 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dfdc7e-5faa-4a63-935d-966b11eb1a9b admin admin] PATH_INFO: `/v3/users` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:52:30.978808 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7dfdc7e-5faa-4a63-935d-966b11eb1a9b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:52:30.980749 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7dfdc7e-5faa-4a63-935d-966b11eb1a9b admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:52:30.982404 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588f7e28-6ec8-47c5-a978-5c6618777b33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:52:30.983072 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588f7e28-6ec8-47c5-a978-5c6618777b33 admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:52:30.983404 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588f7e28-6ec8-47c5-a978-5c6618777b33 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:52:30.983679 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588f7e28-6ec8-47c5-a978-5c6618777b33 admin admin] PATH_INFO: `/v3/users` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:52:30.984306 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588f7e28-6ec8-47c5-a978-5c6618777b33 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:52:30.986179 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588f7e28-6ec8-47c5-a978-5c6618777b33 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:52:31.101472 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 627/1262] 10.222.0.65 () {60 vars in 1144 bytes} [Thu Oct 27 09:52:30 2022] POST /identity/v3/users => generated 296 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 09:52:31.102322 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588f7e28-6ec8-47c5-a978-5c6618777b33 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:52:31.103012 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 636/1263] 10.222.0.65 () {60 vars in 1144 bytes} [Thu Oct 27 09:52:30 2022] POST /identity/v3/users => generated 282 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 09:52:31.104496 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7dfdc7e-5faa-4a63-935d-966b11eb1a9b admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:52:31.117432 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588f7e28-6ec8-47c5-a978-5c6618777b33 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:52:31.117552 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7dfdc7e-5faa-4a63-935d-966b11eb1a9b admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:52:31.122290 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42746058-3c4d-4124-ab6a-5642fb62c740 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:52:31.123005 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42746058-3c4d-4124-ab6a-5642fb62c740 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:52:31.123226 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42746058-3c4d-4124-ab6a-5642fb62c740 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:52:31.123518 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42746058-3c4d-4124-ab6a-5642fb62c740 admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:52:31.123621 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b10c03-6de2-4c98-b4ac-1529c8aae908 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:52:31.124172 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42746058-3c4d-4124-ab6a-5642fb62c740 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:52:31.124291 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b10c03-6de2-4c98-b4ac-1529c8aae908 admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:52:31.124545 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b10c03-6de2-4c98-b4ac-1529c8aae908 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:52:31.124822 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b10c03-6de2-4c98-b4ac-1529c8aae908 admin admin] PATH_INFO: `/v3/users` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:52:31.125459 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b10c03-6de2-4c98-b4ac-1529c8aae908 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:52:31.125760 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42746058-3c4d-4124-ab6a-5642fb62c740 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:52:31.127859 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b10c03-6de2-4c98-b4ac-1529c8aae908 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:52:31.141053 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 628/1264] 10.222.0.65 () {58 vars in 1122 bytes} [Thu Oct 27 09:52:31 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 09:52:31.141053 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42746058-3c4d-4124-ab6a-5642fb62c740 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:52:31.161240 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42746058-3c4d-4124-ab6a-5642fb62c740 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:52:31.161240 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96003e4-778f-4f9d-b0e5-4b89eda7bedb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:52:31.161240 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96003e4-778f-4f9d-b0e5-4b89eda7bedb admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:52:31.161240 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96003e4-778f-4f9d-b0e5-4b89eda7bedb admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:52:31.161705 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96003e4-778f-4f9d-b0e5-4b89eda7bedb admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:52:31.161705 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96003e4-778f-4f9d-b0e5-4b89eda7bedb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:52:31.162186 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96003e4-778f-4f9d-b0e5-4b89eda7bedb admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:52:31.177574 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 629/1265] 10.222.0.65 () {58 vars in 1122 bytes} [Thu Oct 27 09:52:31 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 09:52:31.177574 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96003e4-778f-4f9d-b0e5-4b89eda7bedb admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:52:31.186012 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96003e4-778f-4f9d-b0e5-4b89eda7bedb admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:52:31.190774 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f15eb7a-8de7-45f2-b537-1a8d13d99149 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:52:31.195102 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f15eb7a-8de7-45f2-b537-1a8d13d99149 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:52:31.195102 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f15eb7a-8de7-45f2-b537-1a8d13d99149 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:52:31.195102 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f15eb7a-8de7-45f2-b537-1a8d13d99149 admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:52:31.195102 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f15eb7a-8de7-45f2-b537-1a8d13d99149 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:52:31.195102 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f15eb7a-8de7-45f2-b537-1a8d13d99149 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:52:31.205398 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 630/1266] 10.222.0.65 () {58 vars in 1122 bytes} [Thu Oct 27 09:52:31 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 09:52:31.206186 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f15eb7a-8de7-45f2-b537-1a8d13d99149 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:52:31.217067 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f15eb7a-8de7-45f2-b537-1a8d13d99149 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:52:31.222084 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e462527e-5562-408c-85ea-1a795fb36e74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:52:31.222757 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e462527e-5562-408c-85ea-1a795fb36e74 admin admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:52:31.223043 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e462527e-5562-408c-85ea-1a795fb36e74 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:52:31.223379 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e462527e-5562-408c-85ea-1a795fb36e74 admin admin] PATH_INFO: `/v3/projects/a34bb5aa40d94208a1416eab1fc20f2f/users/c46fe9f4b4db4dcb981c5a1a2cc5f463/roles/43543ce1450245af9661cb017bac17bd` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:52:31.238427 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e462527e-5562-408c-85ea-1a795fb36e74 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a34bb5aa40d94208a1416eab1fc20f2f, user_id=c46fe9f4b4db4dcb981c5a1a2cc5f463, role_id=43543ce1450245af9661cb017bac17bd)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:52:31.241204 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e462527e-5562-408c-85ea-1a795fb36e74 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:52:31.261192 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 637/1267] 10.222.0.65 () {60 vars in 1144 bytes} [Thu Oct 27 09:52:31 2022] POST /identity/v3/users => generated 289 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 09:52:31.262274 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b10c03-6de2-4c98-b4ac-1529c8aae908 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:52:31.271917 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b10c03-6de2-4c98-b4ac-1529c8aae908 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:52:31.277210 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bc7067-97ed-40f3-84a3-4cb3a8c4615d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:52:31.277799 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bc7067-97ed-40f3-84a3-4cb3a8c4615d admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:52:31.278078 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bc7067-97ed-40f3-84a3-4cb3a8c4615d admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:52:31.278353 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bc7067-97ed-40f3-84a3-4cb3a8c4615d admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:52:31.279089 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4bc7067-97ed-40f3-84a3-4cb3a8c4615d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:52:31.280671 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4bc7067-97ed-40f3-84a3-4cb3a8c4615d admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:52:31.293013 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 638/1268] 10.222.0.65 () {58 vars in 1122 bytes} [Thu Oct 27 09:52:31 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 09:52:31.293869 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bc7067-97ed-40f3-84a3-4cb3a8c4615d admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:52:31.303605 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bc7067-97ed-40f3-84a3-4cb3a8c4615d admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:52:31.308966 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c30da3-ac39-49ea-bd4e-c300f0d169b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:52:31.309544 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c30da3-ac39-49ea-bd4e-c300f0d169b9 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:52:31.309954 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c30da3-ac39-49ea-bd4e-c300f0d169b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:52:31.310141 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c30da3-ac39-49ea-bd4e-c300f0d169b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:52:31.310743 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c30da3-ac39-49ea-bd4e-c300f0d169b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:52:31.312338 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c30da3-ac39-49ea-bd4e-c300f0d169b9 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:52:31.326469 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 639/1269] 10.222.0.65 () {58 vars in 1122 bytes} [Thu Oct 27 09:52:31 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 09:52:31.326469 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c30da3-ac39-49ea-bd4e-c300f0d169b9 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:52:31.333686 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c30da3-ac39-49ea-bd4e-c300f0d169b9 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:52:31.339258 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b940cbf-b2ab-48ea-8702-ab8b7dd5e4f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:52:31.350039 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b940cbf-b2ab-48ea-8702-ab8b7dd5e4f2 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:52:31.350039 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b940cbf-b2ab-48ea-8702-ab8b7dd5e4f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:52:31.350039 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b940cbf-b2ab-48ea-8702-ab8b7dd5e4f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:52:31.350039 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b940cbf-b2ab-48ea-8702-ab8b7dd5e4f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:52:31.350039 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b940cbf-b2ab-48ea-8702-ab8b7dd5e4f2 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:52:31.352965 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 640/1270] 10.222.0.65 () {58 vars in 1122 bytes} [Thu Oct 27 09:52:31 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 09:52:31.353834 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b940cbf-b2ab-48ea-8702-ab8b7dd5e4f2 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:52:31.363961 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b940cbf-b2ab-48ea-8702-ab8b7dd5e4f2 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:52:31.369322 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16aae8a-aaa8-4a8d-ac39-20a65d103e07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:52:31.369944 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16aae8a-aaa8-4a8d-ac39-20a65d103e07 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:52:31.370224 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16aae8a-aaa8-4a8d-ac39-20a65d103e07 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:52:31.370492 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16aae8a-aaa8-4a8d-ac39-20a65d103e07 admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:52:31.371158 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16aae8a-aaa8-4a8d-ac39-20a65d103e07 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:52:31.372753 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16aae8a-aaa8-4a8d-ac39-20a65d103e07 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:52:31.392635 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 631/1271] 10.222.0.65 () {60 vars in 1483 bytes} [Thu Oct 27 09:52:31 2022] PUT /identity/v3/projects/a34bb5aa40d94208a1416eab1fc20f2f/users/c46fe9f4b4db4dcb981c5a1a2cc5f463/roles/43543ce1450245af9661cb017bac17bd => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 09:52:31.392635 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e462527e-5562-408c-85ea-1a795fb36e74 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:52:31.392942 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 641/1272] 10.222.0.65 () {58 vars in 1122 bytes} [Thu Oct 27 09:52:31 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 09:52:31.392942 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16aae8a-aaa8-4a8d-ac39-20a65d103e07 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:52:31.398102 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16aae8a-aaa8-4a8d-ac39-20a65d103e07 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:52:31.436554 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:52:31.446288 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e462527e-5562-408c-85ea-1a795fb36e74 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:52:31.451859 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a727d8a8-f6d0-441a-bbad-d052091c1d08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:52:31.452601 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a727d8a8-f6d0-441a-bbad-d052091c1d08 admin admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:52:31.452928 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a727d8a8-f6d0-441a-bbad-d052091c1d08 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:52:31.453258 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a727d8a8-f6d0-441a-bbad-d052091c1d08 admin admin] PATH_INFO: `/v3/projects/c73ae81918c3463e9b4cf6f091037314/users/145999414cdd48ebb29f5f206dcf0bc5/roles/43543ce1450245af9661cb017bac17bd` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:52:31.455071 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227d9619-238c-4ead-b884-54748bcf111b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:52:31.455679 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227d9619-238c-4ead-b884-54748bcf111b admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:52:31.455957 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227d9619-238c-4ead-b884-54748bcf111b admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:52:31.456226 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227d9619-238c-4ead-b884-54748bcf111b admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:52:31.456873 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227d9619-238c-4ead-b884-54748bcf111b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:52:31.458475 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227d9619-238c-4ead-b884-54748bcf111b admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:52:31.473878 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 642/1273] 10.222.0.65 () {58 vars in 1122 bytes} [Thu Oct 27 09:52:31 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 09:52:31.474857 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227d9619-238c-4ead-b884-54748bcf111b admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:52:31.476618 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a727d8a8-f6d0-441a-bbad-d052091c1d08 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c73ae81918c3463e9b4cf6f091037314, user_id=145999414cdd48ebb29f5f206dcf0bc5, role_id=43543ce1450245af9661cb017bac17bd)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:52:31.479986 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a727d8a8-f6d0-441a-bbad-d052091c1d08 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:52:31.484839 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227d9619-238c-4ead-b884-54748bcf111b admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:52:31.490041 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843aee7c-5eb9-49de-be77-ac2492ed246e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:52:31.492191 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843aee7c-5eb9-49de-be77-ac2492ed246e admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:52:31.492191 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843aee7c-5eb9-49de-be77-ac2492ed246e admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:52:31.492191 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843aee7c-5eb9-49de-be77-ac2492ed246e admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:52:31.492191 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843aee7c-5eb9-49de-be77-ac2492ed246e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:52:31.493411 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843aee7c-5eb9-49de-be77-ac2492ed246e admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:52:31.504100 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 643/1274] 10.222.0.65 () {58 vars in 1122 bytes} [Thu Oct 27 09:52:31 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 09:52:31.504763 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843aee7c-5eb9-49de-be77-ac2492ed246e admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:52:31.514789 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843aee7c-5eb9-49de-be77-ac2492ed246e admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:52:31.519460 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8238bf55-e959-48db-862b-ac6c8fdc3f27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:52:31.520045 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8238bf55-e959-48db-862b-ac6c8fdc3f27 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:52:31.520742 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8238bf55-e959-48db-862b-ac6c8fdc3f27 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:52:31.520742 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8238bf55-e959-48db-862b-ac6c8fdc3f27 admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:52:31.521206 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8238bf55-e959-48db-862b-ac6c8fdc3f27 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:52:31.522828 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8238bf55-e959-48db-862b-ac6c8fdc3f27 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:52:31.533792 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 644/1275] 10.222.0.65 () {58 vars in 1122 bytes} [Thu Oct 27 09:52:31 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 09:52:31.534603 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8238bf55-e959-48db-862b-ac6c8fdc3f27 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:52:31.544995 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8238bf55-e959-48db-862b-ac6c8fdc3f27 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:52:31.549609 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aaee4db-906c-45c0-9a6d-911c2275be15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:52:31.550429 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aaee4db-906c-45c0-9a6d-911c2275be15 admin admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:52:31.550739 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aaee4db-906c-45c0-9a6d-911c2275be15 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:52:31.551012 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aaee4db-906c-45c0-9a6d-911c2275be15 admin admin] PATH_INFO: `/v3/projects/1036fe3c8c884e75809166a5e899610b/users/af320040547a4ed48db56a0c8f0ff0b0/roles/43543ce1450245af9661cb017bac17bd` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:52:31.567776 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aaee4db-906c-45c0-9a6d-911c2275be15 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1036fe3c8c884e75809166a5e899610b, user_id=af320040547a4ed48db56a0c8f0ff0b0, role_id=43543ce1450245af9661cb017bac17bd)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:52:31.574413 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aaee4db-906c-45c0-9a6d-911c2275be15 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:52:31.592207 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 632/1276] 10.222.0.65 () {60 vars in 1483 bytes} [Thu Oct 27 09:52:31 2022] PUT /identity/v3/projects/c73ae81918c3463e9b4cf6f091037314/users/145999414cdd48ebb29f5f206dcf0bc5/roles/43543ce1450245af9661cb017bac17bd => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 09:52:31.593127 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a727d8a8-f6d0-441a-bbad-d052091c1d08 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:52:31.671196 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a727d8a8-f6d0-441a-bbad-d052091c1d08 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:52:31.677480 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 645/1277] 10.222.0.65 () {60 vars in 1483 bytes} [Thu Oct 27 09:52:31 2022] PUT /identity/v3/projects/1036fe3c8c884e75809166a5e899610b/users/af320040547a4ed48db56a0c8f0ff0b0/roles/43543ce1450245af9661cb017bac17bd => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 09:52:31.677480 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc4d6af-6e4f-4ff6-8eff-10ef6a50bbe5 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:52:31.677480 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc4d6af-6e4f-4ff6-8eff-10ef6a50bbe5 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:52:31.677480 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc4d6af-6e4f-4ff6-8eff-10ef6a50bbe5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:52:31.693018 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:52:31.696685 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-abc4d6af-6e4f-4ff6-8eff-10ef6a50bbe5 None None] MFA Rules not processed for user `b5065084bf664b99bdeac46067cb0f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:52:31.698752 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-abc4d6af-6e4f-4ff6-8eff-10ef6a50bbe5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:52:31.753035 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e2dc54-d303-492e-9ec0-ca9542628a0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:52:31.754074 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e2dc54-d303-492e-9ec0-ca9542628a0c admin admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:52:31.754412 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e2dc54-d303-492e-9ec0-ca9542628a0c admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:52:31.755177 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e2dc54-d303-492e-9ec0-ca9542628a0c admin admin] PATH_INFO: `/v3/projects/262466090af24738b10a5a744ed5055c/users/15b5a9cc367d490cb4de4b6a2759144a/roles/43543ce1450245af9661cb017bac17bd` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:52:31.773875 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 646/1278] 10.222.0.65 () {58 vars in 958 bytes} [Thu Oct 27 09:52:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 09:52:31.775081 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc4d6af-6e4f-4ff6-8eff-10ef6a50bbe5 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:52:31.784456 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e2dc54-d303-492e-9ec0-ca9542628a0c admin admin] RBAC: Authorizing `identity:create_grant(project_id=262466090af24738b10a5a744ed5055c, user_id=15b5a9cc367d490cb4de4b6a2759144a, role_id=43543ce1450245af9661cb017bac17bd)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:52:31.788118 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e2dc54-d303-492e-9ec0-ca9542628a0c admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:52:31.789094 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc4d6af-6e4f-4ff6-8eff-10ef6a50bbe5 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:52:31.795048 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ad4a15-f40c-42ef-be6f-463d18b714fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:52:31.795909 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ad4a15-f40c-42ef-be6f-463d18b714fc admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:52:31.796337 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ad4a15-f40c-42ef-be6f-463d18b714fc admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:52:31.796758 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ad4a15-f40c-42ef-be6f-463d18b714fc admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:52:31.797499 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ad4a15-f40c-42ef-be6f-463d18b714fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:52:31.799318 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ad4a15-f40c-42ef-be6f-463d18b714fc admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:52:31.814368 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 647/1279] 10.222.0.65 () {58 vars in 1122 bytes} [Thu Oct 27 09:52:31 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 09:52:31.814368 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ad4a15-f40c-42ef-be6f-463d18b714fc admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:52:31.825794 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ad4a15-f40c-42ef-be6f-463d18b714fc admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:52:31.830833 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26388507-658c-4427-85cb-f05c008895a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:52:31.831635 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26388507-658c-4427-85cb-f05c008895a2 admin admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:52:31.832068 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26388507-658c-4427-85cb-f05c008895a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:52:31.832555 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26388507-658c-4427-85cb-f05c008895a2 admin admin] PATH_INFO: `/v3/projects/8cbba5a640c3478daaeae91431680f1e/users/94fd43de1d8343d18e229b6e9429ce66/roles/43543ce1450245af9661cb017bac17bd` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:52:31.855740 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26388507-658c-4427-85cb-f05c008895a2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8cbba5a640c3478daaeae91431680f1e, user_id=94fd43de1d8343d18e229b6e9429ce66, role_id=43543ce1450245af9661cb017bac17bd)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:52:31.858935 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26388507-658c-4427-85cb-f05c008895a2 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:52:31.883517 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 633/1280] 10.222.0.65 () {60 vars in 1483 bytes} [Thu Oct 27 09:52:31 2022] PUT /identity/v3/projects/262466090af24738b10a5a744ed5055c/users/15b5a9cc367d490cb4de4b6a2759144a/roles/43543ce1450245af9661cb017bac17bd => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 09:52:31.884406 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e2dc54-d303-492e-9ec0-ca9542628a0c admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:52:31.951152 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e2dc54-d303-492e-9ec0-ca9542628a0c admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:52:31.957505 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 648/1281] 10.222.0.65 () {60 vars in 1483 bytes} [Thu Oct 27 09:52:31 2022] PUT /identity/v3/projects/8cbba5a640c3478daaeae91431680f1e/users/94fd43de1d8343d18e229b6e9429ce66/roles/43543ce1450245af9661cb017bac17bd => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 09:52:31.959154 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf975d4-1f19-45e2-ad32-4b6dcfb71e9c None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:52:31.959462 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf975d4-1f19-45e2-ad32-4b6dcfb71e9c None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:52:31.962950 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf975d4-1f19-45e2-ad32-4b6dcfb71e9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:52:31.989252 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-bcf975d4-1f19-45e2-ad32-4b6dcfb71e9c None None] MFA Rules not processed for user `145999414cdd48ebb29f5f206dcf0bc5`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:52:31.990912 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-bcf975d4-1f19-45e2-ad32-4b6dcfb71e9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:52:32.032768 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942ed15a-e5af-40d0-8fee-0c55a6eea350 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:52:32.033798 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942ed15a-e5af-40d0-8fee-0c55a6eea350 admin admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:52:32.034171 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942ed15a-e5af-40d0-8fee-0c55a6eea350 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:52:32.034500 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942ed15a-e5af-40d0-8fee-0c55a6eea350 admin admin] PATH_INFO: `/v3/projects/7e66b4c2b24e4597a3d239e50788e8a5/users/d0b24363664d47ebbabf43a0e38b5f80/roles/43543ce1450245af9661cb017bac17bd` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:52:32.049185 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:52:32.058106 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942ed15a-e5af-40d0-8fee-0c55a6eea350 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e66b4c2b24e4597a3d239e50788e8a5, user_id=d0b24363664d47ebbabf43a0e38b5f80, role_id=43543ce1450245af9661cb017bac17bd)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:52:32.062338 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942ed15a-e5af-40d0-8fee-0c55a6eea350 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:52:32.076644 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 649/1282] 10.222.0.65 () {58 vars in 958 bytes} [Thu Oct 27 09:52:31 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 09:52:32.076644 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea36840-69ca-4a5f-beaa-25ec684c1a0c None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:52:32.076644 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea36840-69ca-4a5f-beaa-25ec684c1a0c None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:52:32.076644 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea36840-69ca-4a5f-beaa-25ec684c1a0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:52:32.108956 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-5ea36840-69ca-4a5f-beaa-25ec684c1a0c None None] MFA Rules not processed for user `af320040547a4ed48db56a0c8f0ff0b0`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:52:32.110504 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-5ea36840-69ca-4a5f-beaa-25ec684c1a0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:52:32.178126 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 634/1283] 10.222.0.65 () {60 vars in 1483 bytes} [Thu Oct 27 09:52:31 2022] PUT /identity/v3/projects/7e66b4c2b24e4597a3d239e50788e8a5/users/d0b24363664d47ebbabf43a0e38b5f80/roles/43543ce1450245af9661cb017bac17bd => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 09:52:32.180912 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942ed15a-e5af-40d0-8fee-0c55a6eea350 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:52:32.214634 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 650/1284] 10.222.0.65 () {58 vars in 958 bytes} [Thu Oct 27 09:52:32 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 09:52:32.214634 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea36840-69ca-4a5f-beaa-25ec684c1a0c None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:52:32.224130 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea36840-69ca-4a5f-beaa-25ec684c1a0c None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:52:32.246324 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:52:32.278879 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942ed15a-e5af-40d0-8fee-0c55a6eea350 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:52:32.283926 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09927bf-2702-4327-baae-5f7f8b922da5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6191cc41efa74f46b49022cf387f7a4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc2e3a7a1bcc480891c0b433291c00b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:52:32.284650 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09927bf-2702-4327-baae-5f7f8b922da5 service neutron] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:52:32.284939 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09927bf-2702-4327-baae-5f7f8b922da5 service neutron] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:52:32.285482 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09927bf-2702-4327-baae-5f7f8b922da5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:52:32.311457 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bd2552-7131-4c66-a5ec-65c51c6240cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:52:32.312911 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bd2552-7131-4c66-a5ec-65c51c6240cd admin admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:52:32.314044 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bd2552-7131-4c66-a5ec-65c51c6240cd admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:52:32.314553 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bd2552-7131-4c66-a5ec-65c51c6240cd admin admin] PATH_INFO: `/v3/projects/2f875efc6bb84d0fbf57ce3cf68a6ce8/users/622419e7b1a54c5caba91e1b68faa8b9/roles/43543ce1450245af9661cb017bac17bd` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:52:32.333034 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2bd2552-7131-4c66-a5ec-65c51c6240cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=2f875efc6bb84d0fbf57ce3cf68a6ce8, user_id=622419e7b1a54c5caba91e1b68faa8b9, role_id=43543ce1450245af9661cb017bac17bd)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:52:32.336513 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2bd2552-7131-4c66-a5ec-65c51c6240cd admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:52:32.368336 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09927bf-2702-4327-baae-5f7f8b922da5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:52:32.369794 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09927bf-2702-4327-baae-5f7f8b922da5 service neutron] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:52:32.379902 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 635/1285] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Oct 27 09:52:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 09:52:32.384184 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afaf45fa-0ae9-4a0c-964d-ca8fa396233c None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:52:32.386473 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afaf45fa-0ae9-4a0c-964d-ca8fa396233c None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:52:32.386473 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afaf45fa-0ae9-4a0c-964d-ca8fa396233c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:52:32.408007 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-afaf45fa-0ae9-4a0c-964d-ca8fa396233c None None] MFA Rules not processed for user `b5065084bf664b99bdeac46067cb0f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:52:32.409056 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-afaf45fa-0ae9-4a0c-964d-ca8fa396233c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:52:32.418504 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 636/1286] 10.222.0.65 () {58 vars in 958 bytes} [Thu Oct 27 09:52:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 09:52:32.420069 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519a445f-7068-497d-ba25-bfcaad050033 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:52:32.420356 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519a445f-7068-497d-ba25-bfcaad050033 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:52:32.420639 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519a445f-7068-497d-ba25-bfcaad050033 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:52:32.442210 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-519a445f-7068-497d-ba25-bfcaad050033 None None] MFA Rules not processed for user `b5065084bf664b99bdeac46067cb0f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:52:32.442983 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-519a445f-7068-497d-ba25-bfcaad050033 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:52:32.454025 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 637/1287] 10.222.0.65 () {58 vars in 958 bytes} [Thu Oct 27 09:52:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 09:52:32.455641 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9e22d6-a7c2-47f4-a897-e53ec60a7a32 None None] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:52:32.455947 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9e22d6-a7c2-47f4-a897-e53ec60a7a32 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:52:32.456219 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9e22d6-a7c2-47f4-a897-e53ec60a7a32 None None] PATH_INFO: `/` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:52:32.464282 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 638/1288] 10.222.0.65 () {54 vars in 961 bytes} [Thu Oct 27 09:52:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 09:52:32.464282 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56353623-6dc7-4de3-ac5f-3e70efc7595d None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:52:32.464282 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56353623-6dc7-4de3-ac5f-3e70efc7595d None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:52:32.464282 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56353623-6dc7-4de3-ac5f-3e70efc7595d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:52:32.508481 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-56353623-6dc7-4de3-ac5f-3e70efc7595d None None] MFA Rules not processed for user `d0b24363664d47ebbabf43a0e38b5f80`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:52:32.508481 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-56353623-6dc7-4de3-ac5f-3e70efc7595d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:52:32.567704 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 651/1289] 10.222.0.65 () {60 vars in 1483 bytes} [Thu Oct 27 09:52:32 2022] PUT /identity/v3/projects/2f875efc6bb84d0fbf57ce3cf68a6ce8/users/622419e7b1a54c5caba91e1b68faa8b9/roles/43543ce1450245af9661cb017bac17bd => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 09:52:32.569541 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c2555a-548b-40a5-b00f-b541c1d947a2 None None] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:52:32.569693 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c2555a-548b-40a5-b00f-b541c1d947a2 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:52:32.570018 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c2555a-548b-40a5-b00f-b541c1d947a2 None None] PATH_INFO: `/` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:52:32.572707 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 652/1290] 10.222.0.65 () {54 vars in 961 bytes} [Thu Oct 27 09:52:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 09:52:32.573589 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c2555a-548b-40a5-b00f-b541c1d947a2 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:52:32.585698 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 639/1291] 10.222.0.65 () {58 vars in 958 bytes} [Thu Oct 27 09:52:32 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 09:52:32.588819 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c240c0eb-db8f-423b-aac3-4df0cc2140cf None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:52:32.589110 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c240c0eb-db8f-423b-aac3-4df0cc2140cf None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:52:32.589381 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c240c0eb-db8f-423b-aac3-4df0cc2140cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:52:32.637652 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-c240c0eb-db8f-423b-aac3-4df0cc2140cf None None] MFA Rules not processed for user `fd0d23ef039d4f1591a589d302ef165f`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:52:32.640280 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-c240c0eb-db8f-423b-aac3-4df0cc2140cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:52:32.805959 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c2555a-548b-40a5-b00f-b541c1d947a2 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:52:32.816652 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 640/1292] 10.222.0.65 () {58 vars in 1058 bytes} [Thu Oct 27 09:52:32 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 09:52:32.820725 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c240c0eb-db8f-423b-aac3-4df0cc2140cf None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:52:32.829882 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8db8c90-1b0b-4164-b3c2-6183c2c4c999 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6191cc41efa74f46b49022cf387f7a4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc2e3a7a1bcc480891c0b433291c00b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:52:32.831865 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8db8c90-1b0b-4164-b3c2-6183c2c4c999 service neutron] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:52:32.831865 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8db8c90-1b0b-4164-b3c2-6183c2c4c999 service neutron] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:52:32.831865 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8db8c90-1b0b-4164-b3c2-6183c2c4c999 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:52:32.833189 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c240c0eb-db8f-423b-aac3-4df0cc2140cf None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:52:32.840833 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559e739a-599f-4f37-8203-2e004a509ee2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6191cc41efa74f46b49022cf387f7a4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc2e3a7a1bcc480891c0b433291c00b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:52:32.841521 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559e739a-599f-4f37-8203-2e004a509ee2 service neutron] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:52:32.842093 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559e739a-599f-4f37-8203-2e004a509ee2 service neutron] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:52:32.842247 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559e739a-599f-4f37-8203-2e004a509ee2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:52:32.865102 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:52:32.971531 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8db8c90-1b0b-4164-b3c2-6183c2c4c999 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:52:32.973782 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8db8c90-1b0b-4164-b3c2-6183c2c4c999 service neutron] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:52:32.988783 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 653/1293] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Oct 27 09:52:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 09:52:32.990259 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb76ee4-a571-4f74-b6bb-0fb32b8139d9 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:52:32.990989 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb76ee4-a571-4f74-b6bb-0fb32b8139d9 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:52:32.992482 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb76ee4-a571-4f74-b6bb-0fb32b8139d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:52:33.002902 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559e739a-599f-4f37-8203-2e004a509ee2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:52:33.004374 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559e739a-599f-4f37-8203-2e004a509ee2 service neutron] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:52:33.020068 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-afb76ee4-a571-4f74-b6bb-0fb32b8139d9 None None] MFA Rules not processed for user `b5065084bf664b99bdeac46067cb0f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:52:33.022251 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-afb76ee4-a571-4f74-b6bb-0fb32b8139d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:52:33.028132 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 641/1294] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Oct 27 09:52:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 09:52:33.029428 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036da9e4-aa3d-4a97-b506-07c7fde91136 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:52:33.029782 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036da9e4-aa3d-4a97-b506-07c7fde91136 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:52:33.029997 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036da9e4-aa3d-4a97-b506-07c7fde91136 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:52:33.036508 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 654/1295] 10.222.0.65 () {58 vars in 958 bytes} [Thu Oct 27 09:52:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 09:52:33.036508 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb76ee4-a571-4f74-b6bb-0fb32b8139d9 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:52:33.044383 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:52:33.048120 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb76ee4-a571-4f74-b6bb-0fb32b8139d9 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:52:33.054728 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b17c0b9-30ed-46c4-be3c-5ebf2168d77f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:52:33.055930 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b17c0b9-30ed-46c4-be3c-5ebf2168d77f admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:52:33.056083 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b17c0b9-30ed-46c4-be3c-5ebf2168d77f admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:52:33.056981 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b17c0b9-30ed-46c4-be3c-5ebf2168d77f admin admin] PATH_INFO: `/v3/projects` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:52:33.058103 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b17c0b9-30ed-46c4-be3c-5ebf2168d77f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:52:33.076373 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b17c0b9-30ed-46c4-be3c-5ebf2168d77f admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:52:33.088907 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-036da9e4-aa3d-4a97-b506-07c7fde91136 None None] MFA Rules not processed for user `fd0d23ef039d4f1591a589d302ef165f`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:52:33.090261 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-036da9e4-aa3d-4a97-b506-07c7fde91136 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:52:33.114666 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 642/1296] 10.222.0.65 () {58 vars in 1058 bytes} [Thu Oct 27 09:52:33 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 09:52:33.116200 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036da9e4-aa3d-4a97-b506-07c7fde91136 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:52:33.135616 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036da9e4-aa3d-4a97-b506-07c7fde91136 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:52:33.145169 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64954c0-ba99-4e67-b24a-33962725bf4e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd0d23ef039d4f1591a589d302ef165f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc2e3a7a1bcc480891c0b433291c00b1', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:52:33.146022 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64954c0-ba99-4e67-b24a-33962725bf4e service nova] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:52:33.147796 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64954c0-ba99-4e67-b24a-33962725bf4e service nova] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:52:33.148081 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64954c0-ba99-4e67-b24a-33962725bf4e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:52:33.175536 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 655/1297] 10.222.0.65 () {60 vars in 1153 bytes} [Thu Oct 27 09:52:33 2022] POST /identity/v3/projects => generated 365 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 09:52:33.177201 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b17c0b9-30ed-46c4-be3c-5ebf2168d77f admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:52:33.184031 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-0b17c0b9-30ed-46c4-be3c-5ebf2168d77f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:52:33.247698 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64954c0-ba99-4e67-b24a-33962725bf4e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:52:33.250224 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64954c0-ba99-4e67-b24a-33962725bf4e service nova] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:52:33.277549 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 643/1298] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Oct 27 09:52:33 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 09:52:33.278600 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64954c0-ba99-4e67-b24a-33962725bf4e service nova] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:52:33.299889 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64954c0-ba99-4e67-b24a-33962725bf4e service nova] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:52:33.395390 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b17c0b9-30ed-46c4-be3c-5ebf2168d77f admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:52:33.408045 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b652728a-56b2-471f-945d-c4864bbb462b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6191cc41efa74f46b49022cf387f7a4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc2e3a7a1bcc480891c0b433291c00b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:52:33.409345 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b652728a-56b2-471f-945d-c4864bbb462b service neutron] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:52:33.409731 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b652728a-56b2-471f-945d-c4864bbb462b service neutron] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:52:33.410473 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b652728a-56b2-471f-945d-c4864bbb462b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:52:33.418244 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:52:33.445124 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77f40b3-73b5-4d66-9a4a-2a00cd915ae4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd0d23ef039d4f1591a589d302ef165f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc2e3a7a1bcc480891c0b433291c00b1', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:52:33.455046 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77f40b3-73b5-4d66-9a4a-2a00cd915ae4 service nova] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:52:33.455786 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77f40b3-73b5-4d66-9a4a-2a00cd915ae4 service nova] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:52:33.456120 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77f40b3-73b5-4d66-9a4a-2a00cd915ae4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:52:33.559786 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77f40b3-73b5-4d66-9a4a-2a00cd915ae4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:52:33.563601 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b652728a-56b2-471f-945d-c4864bbb462b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:52:33.568203 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77f40b3-73b5-4d66-9a4a-2a00cd915ae4 service nova] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:52:33.581225 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b652728a-56b2-471f-945d-c4864bbb462b service neutron] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:52:33.596238 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 644/1299] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Oct 27 09:52:33 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 09:52:33.602665 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77f40b3-73b5-4d66-9a4a-2a00cd915ae4 service nova] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:52:33.607878 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 656/1300] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Oct 27 09:52:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 432 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 09:52:33.621116 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77f40b3-73b5-4d66-9a4a-2a00cd915ae4 service nova] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:52:33.636601 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f418ab6-d21d-4336-bbc8-8a3ba297b6ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:52:33.637231 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f418ab6-d21d-4336-bbc8-8a3ba297b6ba admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:52:33.637511 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f418ab6-d21d-4336-bbc8-8a3ba297b6ba admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:52:33.637788 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f418ab6-d21d-4336-bbc8-8a3ba297b6ba admin admin] PATH_INFO: `/v3/users` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:52:33.639011 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f418ab6-d21d-4336-bbc8-8a3ba297b6ba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:52:33.640959 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f418ab6-d21d-4336-bbc8-8a3ba297b6ba admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:52:33.715766 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dc142b-7f32-4203-96ae-1e1a2a17b28a None None] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:52:33.716765 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dc142b-7f32-4203-96ae-1e1a2a17b28a None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:52:33.717292 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dc142b-7f32-4203-96ae-1e1a2a17b28a None None] PATH_INFO: `/` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:52:33.718952 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 657/1301] 10.222.0.65 () {54 vars in 912 bytes} [Thu Oct 27 09:52:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 27 09:52:33.725747 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2516012-d3c6-4528-ad3d-e70f378ebbe2 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:52:33.726843 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2516012-d3c6-4528-ad3d-e70f378ebbe2 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:52:33.733202 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2516012-d3c6-4528-ad3d-e70f378ebbe2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:52:33.770892 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-f2516012-d3c6-4528-ad3d-e70f378ebbe2 None None] MFA Rules not processed for user `fd0d23ef039d4f1591a589d302ef165f`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:52:33.774930 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-f2516012-d3c6-4528-ad3d-e70f378ebbe2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:52:33.787720 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 645/1302] 10.222.0.65 () {60 vars in 1144 bytes} [Thu Oct 27 09:52:33 2022] POST /identity/v3/users => generated 289 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 09:52:33.791600 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f418ab6-d21d-4336-bbc8-8a3ba297b6ba admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:52:33.803961 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 658/1303] 10.222.0.65 () {58 vars in 1009 bytes} [Thu Oct 27 09:52:33 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 09:52:33.814928 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f418ab6-d21d-4336-bbc8-8a3ba297b6ba admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:52:33.818916 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2516012-d3c6-4528-ad3d-e70f378ebbe2 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:52:33.828957 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06b5507-1a06-4920-b0c5-e7b16673ce8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:52:33.829586 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06b5507-1a06-4920-b0c5-e7b16673ce8d admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:52:33.829862 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06b5507-1a06-4920-b0c5-e7b16673ce8d admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:52:33.830789 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06b5507-1a06-4920-b0c5-e7b16673ce8d admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:52:33.830789 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06b5507-1a06-4920-b0c5-e7b16673ce8d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:52:33.832575 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06b5507-1a06-4920-b0c5-e7b16673ce8d admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:52:33.871576 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 646/1304] 10.222.0.65 () {58 vars in 1122 bytes} [Thu Oct 27 09:52:33 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 09:52:33.879044 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06b5507-1a06-4920-b0c5-e7b16673ce8d admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:52:33.890153 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:52:33.900571 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06b5507-1a06-4920-b0c5-e7b16673ce8d admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:52:33.918012 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2769bba-2ddc-461f-9d80-f99d7f28cd3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:52:33.918726 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2769bba-2ddc-461f-9d80-f99d7f28cd3e admin admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:52:33.919011 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2769bba-2ddc-461f-9d80-f99d7f28cd3e admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:52:33.919302 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2769bba-2ddc-461f-9d80-f99d7f28cd3e admin admin] PATH_INFO: `/v3/projects/45fdd8b573d34dd4a66050843b6cbef1/users/4f2f084dbb2a495da1a68091e713a774/roles/6ad17b9f9dea4b66ab2da3677d7e715d` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:52:33.955655 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2769bba-2ddc-461f-9d80-f99d7f28cd3e admin admin] RBAC: Authorizing `identity:create_grant(project_id=45fdd8b573d34dd4a66050843b6cbef1, user_id=4f2f084dbb2a495da1a68091e713a774, role_id=6ad17b9f9dea4b66ab2da3677d7e715d)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:52:33.962028 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2769bba-2ddc-461f-9d80-f99d7f28cd3e admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:52:33.969058 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2516012-d3c6-4528-ad3d-e70f378ebbe2 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:52:33.979577 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2597f47-a02c-409e-927d-b3904f070128 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8e5d5f04c4741bb86ca4a0f667d4ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc2e3a7a1bcc480891c0b433291c00b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:52:33.980636 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2597f47-a02c-409e-927d-b3904f070128 service cinder] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:52:33.981882 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2597f47-a02c-409e-927d-b3904f070128 service cinder] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:52:33.982312 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2597f47-a02c-409e-927d-b3904f070128 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:52:34.008959 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2597f47-a02c-409e-927d-b3904f070128 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:52:34.011848 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2597f47-a02c-409e-927d-b3904f070128 service cinder] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:52:34.033716 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 659/1305] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Oct 27 09:52:33 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 09:52:34.045000 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 647/1306] 10.222.0.65 () {60 vars in 1483 bytes} [Thu Oct 27 09:52:33 2022] PUT /identity/v3/projects/45fdd8b573d34dd4a66050843b6cbef1/users/4f2f084dbb2a495da1a68091e713a774/roles/6ad17b9f9dea4b66ab2da3677d7e715d => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 09:52:34.049602 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2597f47-a02c-409e-927d-b3904f070128 service cinder] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:52:34.066868 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2597f47-a02c-409e-927d-b3904f070128 service cinder] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:52:34.217816 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c36cfd-c13f-4f09-85c9-93e92d5f9d4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:52:34.222252 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5b8bb3-d172-41b4-b505-a5eab9d67e0b None None] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:52:34.225365 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5b8bb3-d172-41b4-b505-a5eab9d67e0b None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:52:34.225365 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5b8bb3-d172-41b4-b505-a5eab9d67e0b None None] PATH_INFO: `/` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:52:34.225365 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 648/1307] 10.222.0.65 () {54 vars in 912 bytes} [Thu Oct 27 09:52:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 09:52:34.225764 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c36cfd-c13f-4f09-85c9-93e92d5f9d4c admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:52:34.225764 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c36cfd-c13f-4f09-85c9-93e92d5f9d4c admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:52:34.225764 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c36cfd-c13f-4f09-85c9-93e92d5f9d4c admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:52:34.226204 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c36cfd-c13f-4f09-85c9-93e92d5f9d4c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:52:34.230510 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c36cfd-c13f-4f09-85c9-93e92d5f9d4c admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:52:34.236574 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a2d7b6-8118-4f90-8d15-6af5d8f9808f None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:52:34.236869 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a2d7b6-8118-4f90-8d15-6af5d8f9808f None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:52:34.237152 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a2d7b6-8118-4f90-8d15-6af5d8f9808f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:52:34.278490 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 660/1308] 10.222.0.65 () {58 vars in 1122 bytes} [Thu Oct 27 09:52:34 2022] GET /identity/v3/roles => generated 1420 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 09:52:34.279771 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c36cfd-c13f-4f09-85c9-93e92d5f9d4c admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:52:34.297547 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-46a2d7b6-8118-4f90-8d15-6af5d8f9808f None None] MFA Rules not processed for user `fd0d23ef039d4f1591a589d302ef165f`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:52:34.300316 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-46a2d7b6-8118-4f90-8d15-6af5d8f9808f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:52:34.303867 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c36cfd-c13f-4f09-85c9-93e92d5f9d4c admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:52:34.318465 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebf4118-c739-4f3a-b5eb-8194b8c7112c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:52:34.319572 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebf4118-c739-4f3a-b5eb-8194b8c7112c admin admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:52:34.319930 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebf4118-c739-4f3a-b5eb-8194b8c7112c admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:52:34.321373 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebf4118-c739-4f3a-b5eb-8194b8c7112c admin admin] PATH_INFO: `/v3/projects/45fdd8b573d34dd4a66050843b6cbef1/users/4f2f084dbb2a495da1a68091e713a774/roles/6ad17b9f9dea4b66ab2da3677d7e715d` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:52:34.329814 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebf4118-c739-4f3a-b5eb-8194b8c7112c admin admin] RBAC: Authorizing `identity:create_grant(project_id=45fdd8b573d34dd4a66050843b6cbef1, user_id=4f2f084dbb2a495da1a68091e713a774, role_id=6ad17b9f9dea4b66ab2da3677d7e715d)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:52:34.338577 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebf4118-c739-4f3a-b5eb-8194b8c7112c admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:52:34.377822 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 661/1309] 10.222.0.65 () {60 vars in 1483 bytes} [Thu Oct 27 09:52:34 2022] PUT /identity/v3/projects/45fdd8b573d34dd4a66050843b6cbef1/users/4f2f084dbb2a495da1a68091e713a774/roles/6ad17b9f9dea4b66ab2da3677d7e715d => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 09:52:34.380161 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fb0fa2-f244-4f55-b424-287d7228a5d0 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:52:34.382389 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fb0fa2-f244-4f55-b424-287d7228a5d0 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:52:34.382389 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fb0fa2-f244-4f55-b424-287d7228a5d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:52:34.433748 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 649/1310] 10.222.0.65 () {58 vars in 1009 bytes} [Thu Oct 27 09:52:34 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 09:52:34.449791 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a2d7b6-8118-4f90-8d15-6af5d8f9808f None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:52:34.455091 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-34fb0fa2-f244-4f55-b424-287d7228a5d0 None None] MFA Rules not processed for user `4f2f084dbb2a495da1a68091e713a774`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:52:34.457143 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-34fb0fa2-f244-4f55-b424-287d7228a5d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:52:34.546896 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:52:34.567210 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a2d7b6-8118-4f90-8d15-6af5d8f9808f None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:52:34.589924 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 662/1311] 10.222.0.65 () {58 vars in 958 bytes} [Thu Oct 27 09:52:34 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 09:52:34.652802 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4ec302-ad77-4060-a885-6a07e4d54a12 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8e5d5f04c4741bb86ca4a0f667d4ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc2e3a7a1bcc480891c0b433291c00b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:52:34.654045 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4ec302-ad77-4060-a885-6a07e4d54a12 service cinder] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:52:34.654045 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4ec302-ad77-4060-a885-6a07e4d54a12 service cinder] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:52:34.654045 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4ec302-ad77-4060-a885-6a07e4d54a12 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:52:34.789579 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4ec302-ad77-4060-a885-6a07e4d54a12 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:52:34.793832 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4ec302-ad77-4060-a885-6a07e4d54a12 service cinder] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:52:34.809861 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 650/1312] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Oct 27 09:52:34 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 09:52:34.942552 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fb0fa2-f244-4f55-b424-287d7228a5d0 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:52:34.974870 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fb0fa2-f244-4f55-b424-287d7228a5d0 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:52:34.983710 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8200828-a17f-4bb0-8347-4a9a91a941e3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8e5d5f04c4741bb86ca4a0f667d4ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc2e3a7a1bcc480891c0b433291c00b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:52:34.993285 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8200828-a17f-4bb0-8347-4a9a91a941e3 service cinder] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:52:34.993285 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8200828-a17f-4bb0-8347-4a9a91a941e3 service cinder] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:52:34.993285 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8200828-a17f-4bb0-8347-4a9a91a941e3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:52:35.003096 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8200828-a17f-4bb0-8347-4a9a91a941e3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:52:35.005074 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8200828-a17f-4bb0-8347-4a9a91a941e3 service cinder] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:52:35.022545 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 663/1313] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Oct 27 09:52:34 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 09:52:35.490207 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4ec302-ad77-4060-a885-6a07e4d54a12 service cinder] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:52:35.501610 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8200828-a17f-4bb0-8347-4a9a91a941e3 service cinder] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:52:35.530052 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8200828-a17f-4bb0-8347-4a9a91a941e3 service cinder] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:52:35.542455 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7fce85-4ece-47fc-9038-e6fca6b3dce4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8e5d5f04c4741bb86ca4a0f667d4ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc2e3a7a1bcc480891c0b433291c00b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:52:35.543366 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7fce85-4ece-47fc-9038-e6fca6b3dce4 service cinder] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:52:35.544992 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7fce85-4ece-47fc-9038-e6fca6b3dce4 service cinder] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:52:35.545429 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7fce85-4ece-47fc-9038-e6fca6b3dce4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:52:35.596190 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:52:35.697127 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7fce85-4ece-47fc-9038-e6fca6b3dce4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:52:35.698686 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7fce85-4ece-47fc-9038-e6fca6b3dce4 service cinder] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:52:35.700678 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4ec302-ad77-4060-a885-6a07e4d54a12 service cinder] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:52:35.713145 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2010b85c-1c25-4ce4-92d2-d7f47250c354 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:52:35.716545 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2010b85c-1c25-4ce4-92d2-d7f47250c354 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:52:35.717238 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2010b85c-1c25-4ce4-92d2-d7f47250c354 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:52:35.717911 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2010b85c-1c25-4ce4-92d2-d7f47250c354 admin admin] PATH_INFO: `/v3/users/af320040547a4ed48db56a0c8f0ff0b0` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:52:35.721585 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2010b85c-1c25-4ce4-92d2-d7f47250c354 admin admin] RBAC: Authorizing `identity:delete_user(user_id=af320040547a4ed48db56a0c8f0ff0b0)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:52:35.726057 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2010b85c-1c25-4ce4-92d2-d7f47250c354 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:52:35.732136 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 664/1314] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Oct 27 09:52:35 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 09:52:36.047925 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-2010b85c-1c25-4ce4-92d2-d7f47250c354 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'af320040547a4ed48db56a0c8f0ff0b0'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:52:36.089806 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-2010b85c-1c25-4ce4-92d2-d7f47250c354 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'af320040547a4ed48db56a0c8f0ff0b0'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:52:36.090743 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-2010b85c-1c25-4ce4-92d2-d7f47250c354 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'af320040547a4ed48db56a0c8f0ff0b0'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:52:36.125820 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-2010b85c-1c25-4ce4-92d2-d7f47250c354 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'af320040547a4ed48db56a0c8f0ff0b0'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:52:36.220500 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:52:36.222920 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-2010b85c-1c25-4ce4-92d2-d7f47250c354 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'af320040547a4ed48db56a0c8f0ff0b0'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:52:36.242692 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 651/1315] 10.222.0.65 () {58 vars in 1224 bytes} [Thu Oct 27 09:52:35 2022] DELETE /identity/v3/users/af320040547a4ed48db56a0c8f0ff0b0 => generated 0 bytes in 753 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 09:52:36.250240 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fcc975-c3d8-4cb5-bfda-bc3b5a96d058 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:52:36.250983 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fcc975-c3d8-4cb5-bfda-bc3b5a96d058 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:52:36.251524 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fcc975-c3d8-4cb5-bfda-bc3b5a96d058 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:52:36.323258 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-50fcc975-c3d8-4cb5-bfda-bc3b5a96d058 None None] MFA Rules not processed for user `b5065084bf664b99bdeac46067cb0f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:52:36.325964 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-50fcc975-c3d8-4cb5-bfda-bc3b5a96d058 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:52:36.468592 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 665/1316] 10.222.0.65 () {58 vars in 958 bytes} [Thu Oct 27 09:52:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 09:52:36.483279 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2010b85c-1c25-4ce4-92d2-d7f47250c354 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:52:36.484762 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-2010b85c-1c25-4ce4-92d2-d7f47250c354 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:52:36.664249 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2010b85c-1c25-4ce4-92d2-d7f47250c354 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:52:36.677871 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51531420-1cb3-47ce-8a97-8198272c66fe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6191cc41efa74f46b49022cf387f7a4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc2e3a7a1bcc480891c0b433291c00b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:52:36.678678 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51531420-1cb3-47ce-8a97-8198272c66fe service neutron] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:52:36.679061 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51531420-1cb3-47ce-8a97-8198272c66fe service neutron] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:52:36.679438 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51531420-1cb3-47ce-8a97-8198272c66fe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:52:36.689823 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51531420-1cb3-47ce-8a97-8198272c66fe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:52:36.691541 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51531420-1cb3-47ce-8a97-8198272c66fe service neutron] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:52:36.703744 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 652/1317] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Oct 27 09:52:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 09:52:38.131610 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fcc975-c3d8-4cb5-bfda-bc3b5a96d058 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:52:38.133164 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-50fcc975-c3d8-4cb5-bfda-bc3b5a96d058 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:52:38.172658 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fcc975-c3d8-4cb5-bfda-bc3b5a96d058 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:52:38.189022 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cded0a6-115f-49a9-bdf2-0556e5ca155e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:52:38.190046 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cded0a6-115f-49a9-bdf2-0556e5ca155e admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:52:38.190492 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cded0a6-115f-49a9-bdf2-0556e5ca155e admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:52:38.190968 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cded0a6-115f-49a9-bdf2-0556e5ca155e admin admin] PATH_INFO: `/v3/projects/1036fe3c8c884e75809166a5e899610b` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:52:38.199688 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cded0a6-115f-49a9-bdf2-0556e5ca155e admin admin] RBAC: Authorizing `identity:delete_project(project_id=1036fe3c8c884e75809166a5e899610b)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:52:38.205819 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cded0a6-115f-49a9-bdf2-0556e5ca155e admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:52:38.393700 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-2cded0a6-115f-49a9-bdf2-0556e5ca155e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1036fe3c8c884e75809166a5e899610b', 'request_id': 'req-2cded0a6-115f-49a9-bdf2-0556e5ca155e'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:52:38.405330 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-2cded0a6-115f-49a9-bdf2-0556e5ca155e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1036fe3c8c884e75809166a5e899610b', 'request_id': 'req-2cded0a6-115f-49a9-bdf2-0556e5ca155e'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:52:38.523066 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-2cded0a6-115f-49a9-bdf2-0556e5ca155e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1036fe3c8c884e75809166a5e899610b', 'request_id': 'req-2cded0a6-115f-49a9-bdf2-0556e5ca155e'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:52:38.560623 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-2cded0a6-115f-49a9-bdf2-0556e5ca155e admin admin] The token cache is being invalidate because project 1036fe3c8c884e75809166a5e899610b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 09:52:38.561123 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-2cded0a6-115f-49a9-bdf2-0556e5ca155e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:52:38.563847 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-2cded0a6-115f-49a9-bdf2-0556e5ca155e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:52:38.568958 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 666/1318] 10.222.0.65 () {58 vars in 1233 bytes} [Thu Oct 27 09:52:38 2022] DELETE /identity/v3/projects/1036fe3c8c884e75809166a5e899610b => generated 0 bytes in 438 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 09:52:38.574446 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520eb35f-e9dc-4ced-a6c9-48c94719d5c7 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:52:38.575042 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520eb35f-e9dc-4ced-a6c9-48c94719d5c7 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:52:38.575339 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520eb35f-e9dc-4ced-a6c9-48c94719d5c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:52:38.643673 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-520eb35f-e9dc-4ced-a6c9-48c94719d5c7 None None] MFA Rules not processed for user `b5065084bf664b99bdeac46067cb0f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:52:38.647013 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-520eb35f-e9dc-4ced-a6c9-48c94719d5c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:52:38.874574 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 653/1319] 10.222.0.65 () {58 vars in 958 bytes} [Thu Oct 27 09:52:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 297 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 09:52:38.877942 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd3f615-8a91-4c7a-8ec2-e4f177a1191a None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:52:38.878238 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd3f615-8a91-4c7a-8ec2-e4f177a1191a None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:52:38.878597 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd3f615-8a91-4c7a-8ec2-e4f177a1191a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:52:38.935890 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-ebd3f615-8a91-4c7a-8ec2-e4f177a1191a None None] MFA Rules not processed for user `b5065084bf664b99bdeac46067cb0f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:52:38.937173 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-ebd3f615-8a91-4c7a-8ec2-e4f177a1191a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:52:38.981446 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 667/1320] 10.222.0.65 () {58 vars in 958 bytes} [Thu Oct 27 09:52:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 09:52:38.984260 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520eb35f-e9dc-4ced-a6c9-48c94719d5c7 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:52:39.002082 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520eb35f-e9dc-4ced-a6c9-48c94719d5c7 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:52:39.018587 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ec703d-42ca-460d-bd41-8302631c5c05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:52:39.019284 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ec703d-42ca-460d-bd41-8302631c5c05 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:52:39.020062 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ec703d-42ca-460d-bd41-8302631c5c05 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:52:39.020329 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ec703d-42ca-460d-bd41-8302631c5c05 admin admin] PATH_INFO: `/v3/domains` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:52:39.022596 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ec703d-42ca-460d-bd41-8302631c5c05 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 09:52:39.022947 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ec703d-42ca-460d-bd41-8302631c5c05 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:52:39.027459 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ec703d-42ca-460d-bd41-8302631c5c05 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:52:39.064119 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 654/1321] 10.222.0.65 () {58 vars in 1153 bytes} [Thu Oct 27 09:52:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 09:52:39.065446 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd3f615-8a91-4c7a-8ec2-e4f177a1191a None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:52:39.080047 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd3f615-8a91-4c7a-8ec2-e4f177a1191a None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:52:39.102702 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a10f928-0c83-4911-aa01-a0d254dda94b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:52:39.104431 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a10f928-0c83-4911-aa01-a0d254dda94b admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:52:39.104774 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a10f928-0c83-4911-aa01-a0d254dda94b admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:52:39.105054 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a10f928-0c83-4911-aa01-a0d254dda94b admin admin] PATH_INFO: `/v3/projects` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:52:39.105717 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a10f928-0c83-4911-aa01-a0d254dda94b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:52:39.107760 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a10f928-0c83-4911-aa01-a0d254dda94b admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:52:39.290165 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 668/1322] 10.222.0.65 () {60 vars in 1153 bytes} [Thu Oct 27 09:52:39 2022] POST /identity/v3/projects => generated 373 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 09:52:39.295208 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ec703d-42ca-460d-bd41-8302631c5c05 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:52:39.346160 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ec703d-42ca-460d-bd41-8302631c5c05 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:52:39.441194 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:52:39.467824 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a1a7fd-57ae-4d80-bde9-996a497e34c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:52:39.469653 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a1a7fd-57ae-4d80-bde9-996a497e34c9 admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:52:39.471590 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a1a7fd-57ae-4d80-bde9-996a497e34c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:52:39.472042 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a1a7fd-57ae-4d80-bde9-996a497e34c9 admin admin] PATH_INFO: `/v3/users` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:52:39.472886 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a1a7fd-57ae-4d80-bde9-996a497e34c9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:52:39.477167 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a1a7fd-57ae-4d80-bde9-996a497e34c9 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:52:39.752350 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 655/1323] 10.222.0.65 () {60 vars in 1144 bytes} [Thu Oct 27 09:52:39 2022] POST /identity/v3/users => generated 287 bytes in 457 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 09:52:39.756613 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a10f928-0c83-4911-aa01-a0d254dda94b admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:52:39.797279 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a10f928-0c83-4911-aa01-a0d254dda94b admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:52:39.803048 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d70740a-c1a8-4fe6-a1eb-d435ae8e858d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:52:39.804601 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d70740a-c1a8-4fe6-a1eb-d435ae8e858d admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:52:39.804988 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d70740a-c1a8-4fe6-a1eb-d435ae8e858d admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:52:39.806480 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d70740a-c1a8-4fe6-a1eb-d435ae8e858d admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:52:39.811794 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d70740a-c1a8-4fe6-a1eb-d435ae8e858d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:52:39.827906 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d70740a-c1a8-4fe6-a1eb-d435ae8e858d admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:52:39.858439 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 669/1324] 10.222.0.65 () {58 vars in 1122 bytes} [Thu Oct 27 09:52:39 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 09:52:39.862548 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a1a7fd-57ae-4d80-bde9-996a497e34c9 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:52:39.879573 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a1a7fd-57ae-4d80-bde9-996a497e34c9 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:52:39.893427 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4981e75-5870-493a-86f3-d1f673e7b342 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:52:39.894386 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4981e75-5870-493a-86f3-d1f673e7b342 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:52:39.894843 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4981e75-5870-493a-86f3-d1f673e7b342 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:52:39.895300 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4981e75-5870-493a-86f3-d1f673e7b342 admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:52:39.896126 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4981e75-5870-493a-86f3-d1f673e7b342 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:52:39.908858 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4981e75-5870-493a-86f3-d1f673e7b342 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:52:39.926259 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 656/1325] 10.222.0.65 () {58 vars in 1122 bytes} [Thu Oct 27 09:52:39 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 09:52:39.932482 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d70740a-c1a8-4fe6-a1eb-d435ae8e858d admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:52:39.938660 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:52:39.944960 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d70740a-c1a8-4fe6-a1eb-d435ae8e858d admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:52:39.952057 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c581110-be3b-452b-9818-c1ebd251a959 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:52:39.952361 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c581110-be3b-452b-9818-c1ebd251a959 admin admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:52:39.952747 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c581110-be3b-452b-9818-c1ebd251a959 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:52:39.953180 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c581110-be3b-452b-9818-c1ebd251a959 admin admin] PATH_INFO: `/v3/projects/3ae90ba0930d47ad8be7eeb823a4e1e0/users/dfe74f6bdb5f45b98793997987663c30/roles/43543ce1450245af9661cb017bac17bd` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:52:39.975672 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c581110-be3b-452b-9818-c1ebd251a959 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3ae90ba0930d47ad8be7eeb823a4e1e0, user_id=dfe74f6bdb5f45b98793997987663c30, role_id=43543ce1450245af9661cb017bac17bd)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:52:39.981017 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c581110-be3b-452b-9818-c1ebd251a959 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:52:40.166888 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81b2301-0c54-4016-b8ac-df38f157633c None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:52:40.167557 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81b2301-0c54-4016-b8ac-df38f157633c None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:52:40.168099 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81b2301-0c54-4016-b8ac-df38f157633c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:52:40.178673 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 670/1326] 10.222.0.65 () {60 vars in 1483 bytes} [Thu Oct 27 09:52:39 2022] PUT /identity/v3/projects/3ae90ba0930d47ad8be7eeb823a4e1e0/users/dfe74f6bdb5f45b98793997987663c30/roles/43543ce1450245af9661cb017bac17bd => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 09:52:40.232712 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-f81b2301-0c54-4016-b8ac-df38f157633c None None] MFA Rules not processed for user `dfe74f6bdb5f45b98793997987663c30`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:52:40.233968 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-f81b2301-0c54-4016-b8ac-df38f157633c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:52:40.446341 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 657/1327] 10.222.0.65 () {58 vars in 958 bytes} [Thu Oct 27 09:52:40 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 09:52:40.450459 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c581110-be3b-452b-9818-c1ebd251a959 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:52:40.666756 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c581110-be3b-452b-9818-c1ebd251a959 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:52:40.697478 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a93882-86d5-4ae8-a889-e94d545da4ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:52:40.698381 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a93882-86d5-4ae8-a889-e94d545da4ce admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:52:40.698883 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a93882-86d5-4ae8-a889-e94d545da4ce admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:52:40.701644 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a93882-86d5-4ae8-a889-e94d545da4ce admin admin] PATH_INFO: `/v3/projects` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:52:40.702294 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a93882-86d5-4ae8-a889-e94d545da4ce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:52:40.716461 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a93882-86d5-4ae8-a889-e94d545da4ce admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:52:40.924798 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 671/1328] 10.222.0.65 () {60 vars in 1153 bytes} [Thu Oct 27 09:52:40 2022] POST /identity/v3/projects => generated 371 bytes in 475 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 09:52:40.928845 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81b2301-0c54-4016-b8ac-df38f157633c None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:52:40.943853 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81b2301-0c54-4016-b8ac-df38f157633c None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:52:40.978350 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a93882-86d5-4ae8-a889-e94d545da4ce admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:52:40.980291 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-b8a93882-86d5-4ae8-a889-e94d545da4ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:52:41.038307 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2fcbf0-4c3a-41a5-8fc7-e57f4c5d61c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:52:41.039259 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2fcbf0-4c3a-41a5-8fc7-e57f4c5d61c9 admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:52:41.039706 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2fcbf0-4c3a-41a5-8fc7-e57f4c5d61c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:52:41.040321 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2fcbf0-4c3a-41a5-8fc7-e57f4c5d61c9 admin admin] PATH_INFO: `/v3/users` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:52:41.041375 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2fcbf0-4c3a-41a5-8fc7-e57f4c5d61c9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:52:41.044291 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2fcbf0-4c3a-41a5-8fc7-e57f4c5d61c9 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:52:41.148078 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a93882-86d5-4ae8-a889-e94d545da4ce admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:52:41.177141 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afeff03-7d18-4b05-bf05-d35ff7a65e10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:52:41.177141 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afeff03-7d18-4b05-bf05-d35ff7a65e10 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:52:41.177141 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afeff03-7d18-4b05-bf05-d35ff7a65e10 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:52:41.177482 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afeff03-7d18-4b05-bf05-d35ff7a65e10 admin admin] PATH_INFO: `/v3/users/d0b24363664d47ebbabf43a0e38b5f80` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:52:41.178104 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 658/1329] 10.222.0.65 () {60 vars in 1144 bytes} [Thu Oct 27 09:52:40 2022] POST /identity/v3/users => generated 292 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 09:52:41.179108 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2fcbf0-4c3a-41a5-8fc7-e57f4c5d61c9 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:52:41.180905 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0afeff03-7d18-4b05-bf05-d35ff7a65e10 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d0b24363664d47ebbabf43a0e38b5f80)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:52:41.186789 dv-cinder-797970-7-smb devstack@keystone.service[88311]: WARNING py.warnings [None req-0afeff03-7d18-4b05-bf05-d35ff7a65e10 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 27 09:52:41.186789 dv-cinder-797970-7-smb devstack@keystone.service[88311]: warnings.warn(msg) Oct 27 09:52:41.186789 dv-cinder-797970-7-smb devstack@keystone.service[88311]: Oct 27 09:52:41.186789 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0afeff03-7d18-4b05-bf05-d35ff7a65e10 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:52:41.203906 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2fcbf0-4c3a-41a5-8fc7-e57f4c5d61c9 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:52:41.216174 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910a98f3-b732-4b83-b3df-a1e18579d78b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:52:41.216806 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910a98f3-b732-4b83-b3df-a1e18579d78b admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:52:41.217088 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910a98f3-b732-4b83-b3df-a1e18579d78b admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:52:41.217369 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910a98f3-b732-4b83-b3df-a1e18579d78b admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:52:41.220310 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910a98f3-b732-4b83-b3df-a1e18579d78b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:52:41.222208 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910a98f3-b732-4b83-b3df-a1e18579d78b admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:52:41.256521 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 659/1330] 10.222.0.65 () {58 vars in 1122 bytes} [Thu Oct 27 09:52:41 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 09:52:41.257515 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910a98f3-b732-4b83-b3df-a1e18579d78b admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:52:41.283421 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910a98f3-b732-4b83-b3df-a1e18579d78b admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:52:41.293344 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6340a48-4da4-4726-9fb4-57d60ff6e685 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:52:41.294281 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6340a48-4da4-4726-9fb4-57d60ff6e685 admin admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:52:41.294756 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6340a48-4da4-4726-9fb4-57d60ff6e685 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:52:41.295180 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6340a48-4da4-4726-9fb4-57d60ff6e685 admin admin] PATH_INFO: `/v3/projects/fb192b55812a461ca4dc5f6d5728387c/users/d6c65f16f77842c39b574d61734800cb/roles/6ad17b9f9dea4b66ab2da3677d7e715d` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:52:41.325513 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6340a48-4da4-4726-9fb4-57d60ff6e685 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fb192b55812a461ca4dc5f6d5728387c, user_id=d6c65f16f77842c39b574d61734800cb, role_id=6ad17b9f9dea4b66ab2da3677d7e715d)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:52:41.329480 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6340a48-4da4-4726-9fb4-57d60ff6e685 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:52:41.646057 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 660/1331] 10.222.0.65 () {60 vars in 1483 bytes} [Thu Oct 27 09:52:41 2022] PUT /identity/v3/projects/fb192b55812a461ca4dc5f6d5728387c/users/d6c65f16f77842c39b574d61734800cb/roles/6ad17b9f9dea4b66ab2da3677d7e715d => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 09:52:41.651835 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6340a48-4da4-4726-9fb4-57d60ff6e685 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:52:41.690902 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-0afeff03-7d18-4b05-bf05-d35ff7a65e10 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd0b24363664d47ebbabf43a0e38b5f80'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:52:41.693330 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-0afeff03-7d18-4b05-bf05-d35ff7a65e10 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd0b24363664d47ebbabf43a0e38b5f80'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:52:41.730187 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-0afeff03-7d18-4b05-bf05-d35ff7a65e10 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd0b24363664d47ebbabf43a0e38b5f80'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:52:41.732203 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-0afeff03-7d18-4b05-bf05-d35ff7a65e10 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd0b24363664d47ebbabf43a0e38b5f80'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:52:41.783626 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-0afeff03-7d18-4b05-bf05-d35ff7a65e10 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd0b24363664d47ebbabf43a0e38b5f80'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:52:41.866605 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6340a48-4da4-4726-9fb4-57d60ff6e685 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:52:41.875972 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d04ffbd-e747-4ae5-a337-5c9291f35ad5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:52:41.876611 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d04ffbd-e747-4ae5-a337-5c9291f35ad5 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:52:41.876894 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d04ffbd-e747-4ae5-a337-5c9291f35ad5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:52:41.877164 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d04ffbd-e747-4ae5-a337-5c9291f35ad5 admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:52:41.878010 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d04ffbd-e747-4ae5-a337-5c9291f35ad5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:52:41.880323 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d04ffbd-e747-4ae5-a337-5c9291f35ad5 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:52:41.905217 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 661/1332] 10.222.0.65 () {58 vars in 1122 bytes} [Thu Oct 27 09:52:41 2022] GET /identity/v3/roles => generated 1420 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 09:52:41.912764 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d04ffbd-e747-4ae5-a337-5c9291f35ad5 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:52:41.927938 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-2d04ffbd-e747-4ae5-a337-5c9291f35ad5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:52:41.932601 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 672/1333] 10.222.0.65 () {58 vars in 1224 bytes} [Thu Oct 27 09:52:40 2022] DELETE /identity/v3/users/d0b24363664d47ebbabf43a0e38b5f80 => generated 0 bytes in 952 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 09:52:41.935283 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a8b367-0214-43b2-8b62-41b09c31b687 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:52:41.935629 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a8b367-0214-43b2-8b62-41b09c31b687 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:52:41.935921 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a8b367-0214-43b2-8b62-41b09c31b687 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:52:41.971429 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d04ffbd-e747-4ae5-a337-5c9291f35ad5 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:52:42.005052 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-85a8b367-0214-43b2-8b62-41b09c31b687 None None] MFA Rules not processed for user `b5065084bf664b99bdeac46067cb0f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:52:42.007206 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-85a8b367-0214-43b2-8b62-41b09c31b687 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:52:42.031498 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:52:42.122392 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6559fcfd-44e0-46ae-896b-0d0debe593aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:52:42.123382 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6559fcfd-44e0-46ae-896b-0d0debe593aa admin admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:52:42.124454 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6559fcfd-44e0-46ae-896b-0d0debe593aa admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:52:42.124973 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6559fcfd-44e0-46ae-896b-0d0debe593aa admin admin] PATH_INFO: `/v3/projects/fb192b55812a461ca4dc5f6d5728387c/users/d6c65f16f77842c39b574d61734800cb/roles/6ad17b9f9dea4b66ab2da3677d7e715d` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:52:42.127293 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6559fcfd-44e0-46ae-896b-0d0debe593aa admin admin] RBAC: Authorizing `identity:create_grant(project_id=fb192b55812a461ca4dc5f6d5728387c, user_id=d6c65f16f77842c39b574d61734800cb, role_id=6ad17b9f9dea4b66ab2da3677d7e715d)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:52:42.132697 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6559fcfd-44e0-46ae-896b-0d0debe593aa admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:52:42.148637 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 662/1334] 10.222.0.65 () {60 vars in 1483 bytes} [Thu Oct 27 09:52:41 2022] PUT /identity/v3/projects/fb192b55812a461ca4dc5f6d5728387c/users/d6c65f16f77842c39b574d61734800cb/roles/6ad17b9f9dea4b66ab2da3677d7e715d => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 09:52:42.169020 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:52:42.176543 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d6f886-9e08-42d5-b8e6-bb490cb2a663 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:52:42.188959 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d6f886-9e08-42d5-b8e6-bb490cb2a663 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:52:42.188959 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d6f886-9e08-42d5-b8e6-bb490cb2a663 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:52:42.189909 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 673/1335] 10.222.0.65 () {58 vars in 958 bytes} [Thu Oct 27 09:52:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 09:52:42.249876 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a8b367-0214-43b2-8b62-41b09c31b687 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:52:42.251403 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-85a8b367-0214-43b2-8b62-41b09c31b687 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:52:42.253545 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-d1d6f886-9e08-42d5-b8e6-bb490cb2a663 None None] MFA Rules not processed for user `d6c65f16f77842c39b574d61734800cb`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:52:42.254872 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-d1d6f886-9e08-42d5-b8e6-bb490cb2a663 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:52:42.443732 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a8b367-0214-43b2-8b62-41b09c31b687 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:52:42.575698 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 663/1336] 10.222.0.65 () {58 vars in 958 bytes} [Thu Oct 27 09:52:42 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 403 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 09:52:42.589402 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d6f886-9e08-42d5-b8e6-bb490cb2a663 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:52:42.590885 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-d1d6f886-9e08-42d5-b8e6-bb490cb2a663 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:52:42.675752 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cb8ab7-9801-4539-82cf-781ae7ac9a3e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6191cc41efa74f46b49022cf387f7a4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc2e3a7a1bcc480891c0b433291c00b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:52:42.679805 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cb8ab7-9801-4539-82cf-781ae7ac9a3e service neutron] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:52:42.680926 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cb8ab7-9801-4539-82cf-781ae7ac9a3e service neutron] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:52:42.683829 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cb8ab7-9801-4539-82cf-781ae7ac9a3e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:52:42.721179 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d6f886-9e08-42d5-b8e6-bb490cb2a663 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:52:42.731531 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2451794-7470-46c9-a317-bf17ecf08843 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8e5d5f04c4741bb86ca4a0f667d4ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc2e3a7a1bcc480891c0b433291c00b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:52:42.732334 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2451794-7470-46c9-a317-bf17ecf08843 service cinder] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:52:42.733365 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2451794-7470-46c9-a317-bf17ecf08843 service cinder] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:52:42.734692 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2451794-7470-46c9-a317-bf17ecf08843 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:52:42.761426 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:52:42.764960 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2451794-7470-46c9-a317-bf17ecf08843 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:52:42.766886 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2451794-7470-46c9-a317-bf17ecf08843 service cinder] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:52:42.816388 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 664/1337] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Oct 27 09:52:42 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 09:52:42.848331 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21cb8ab7-9801-4539-82cf-781ae7ac9a3e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:52:42.850263 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21cb8ab7-9801-4539-82cf-781ae7ac9a3e service neutron] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:52:42.874465 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 674/1338] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Oct 27 09:52:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 625 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 09:52:43.470939 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:52:43.561431 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed64989-cf85-43f5-8164-9903b661b078 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:52:43.561431 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed64989-cf85-43f5-8164-9903b661b078 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:52:43.561431 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed64989-cf85-43f5-8164-9903b661b078 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:52:43.626806 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-0ed64989-cf85-43f5-8164-9903b661b078 None None] MFA Rules not processed for user `2acf9b6c3a394be389cd17d7fade3cf4`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:52:43.626806 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-0ed64989-cf85-43f5-8164-9903b661b078 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:52:43.817580 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cb8ab7-9801-4539-82cf-781ae7ac9a3e service neutron] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:52:43.819368 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-21cb8ab7-9801-4539-82cf-781ae7ac9a3e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:52:43.842342 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cb8ab7-9801-4539-82cf-781ae7ac9a3e service neutron] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:52:43.857002 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6d89a3-e691-4e9f-b669-035608dd1bd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:52:43.859226 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6d89a3-e691-4e9f-b669-035608dd1bd5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:52:43.859802 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6d89a3-e691-4e9f-b669-035608dd1bd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:52:43.860453 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6d89a3-e691-4e9f-b669-035608dd1bd5 admin admin] PATH_INFO: `/v3/users/145999414cdd48ebb29f5f206dcf0bc5` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:52:43.862756 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6d89a3-e691-4e9f-b669-035608dd1bd5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=145999414cdd48ebb29f5f206dcf0bc5)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:52:43.868136 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6d89a3-e691-4e9f-b669-035608dd1bd5 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:52:43.921723 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 665/1339] 10.222.0.65 () {58 vars in 958 bytes} [Thu Oct 27 09:52:43 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 362 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 09:52:43.936903 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed64989-cf85-43f5-8164-9903b661b078 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:52:43.940303 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-0ed64989-cf85-43f5-8164-9903b661b078 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:52:44.164936 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed64989-cf85-43f5-8164-9903b661b078 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:52:44.171954 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-fa6d89a3-e691-4e9f-b669-035608dd1bd5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '145999414cdd48ebb29f5f206dcf0bc5'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:52:44.174027 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-fa6d89a3-e691-4e9f-b669-035608dd1bd5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '145999414cdd48ebb29f5f206dcf0bc5'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:52:44.187880 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95dfcf31-8f55-4536-a441-6ac867f21f56 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd0d23ef039d4f1591a589d302ef165f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc2e3a7a1bcc480891c0b433291c00b1', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:52:44.188693 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dfcf31-8f55-4536-a441-6ac867f21f56 service nova] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:52:44.188984 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dfcf31-8f55-4536-a441-6ac867f21f56 service nova] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:52:44.191545 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dfcf31-8f55-4536-a441-6ac867f21f56 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:52:44.198099 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-fa6d89a3-e691-4e9f-b669-035608dd1bd5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '145999414cdd48ebb29f5f206dcf0bc5'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:52:44.200459 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-fa6d89a3-e691-4e9f-b669-035608dd1bd5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '145999414cdd48ebb29f5f206dcf0bc5'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:52:44.221464 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95dfcf31-8f55-4536-a441-6ac867f21f56 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:52:44.224698 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95dfcf31-8f55-4536-a441-6ac867f21f56 service nova] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:52:44.242581 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-fa6d89a3-e691-4e9f-b669-035608dd1bd5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '145999414cdd48ebb29f5f206dcf0bc5'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:52:44.252612 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 666/1340] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Oct 27 09:52:43 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 09:52:44.383597 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 675/1341] 10.222.0.65 () {58 vars in 1224 bytes} [Thu Oct 27 09:52:43 2022] DELETE /identity/v3/users/145999414cdd48ebb29f5f206dcf0bc5 => generated 0 bytes in 566 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 09:52:44.391637 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d478254a-fb79-4d81-9f77-22b2f57450f8 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:52:44.392000 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d478254a-fb79-4d81-9f77-22b2f57450f8 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:52:44.392347 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d478254a-fb79-4d81-9f77-22b2f57450f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:52:44.420797 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6d89a3-e691-4e9f-b669-035608dd1bd5 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:52:44.423121 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-fa6d89a3-e691-4e9f-b669-035608dd1bd5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:52:44.435700 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-d478254a-fb79-4d81-9f77-22b2f57450f8 None None] MFA Rules not processed for user `b5065084bf664b99bdeac46067cb0f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:52:44.438743 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-d478254a-fb79-4d81-9f77-22b2f57450f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:52:44.527072 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:52:44.570474 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6d89a3-e691-4e9f-b669-035608dd1bd5 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:52:44.583225 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e54c9f3-2280-481e-ab99-743ba0f8d179 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:52:44.584353 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e54c9f3-2280-481e-ab99-743ba0f8d179 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:52:44.584843 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e54c9f3-2280-481e-ab99-743ba0f8d179 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:52:44.585323 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e54c9f3-2280-481e-ab99-743ba0f8d179 admin admin] PATH_INFO: `/v3/users/dfe74f6bdb5f45b98793997987663c30` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:52:44.588810 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e54c9f3-2280-481e-ab99-743ba0f8d179 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dfe74f6bdb5f45b98793997987663c30)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:52:44.591216 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e54c9f3-2280-481e-ab99-743ba0f8d179 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:52:44.600068 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 667/1342] 10.222.0.65 () {58 vars in 958 bytes} [Thu Oct 27 09:52:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 09:52:44.616030 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d478254a-fb79-4d81-9f77-22b2f57450f8 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:52:44.618686 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-d478254a-fb79-4d81-9f77-22b2f57450f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:52:44.779765 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d478254a-fb79-4d81-9f77-22b2f57450f8 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:52:44.784013 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f561f4cb-a95b-466d-ac60-8d21f7601fca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6191cc41efa74f46b49022cf387f7a4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc2e3a7a1bcc480891c0b433291c00b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:52:44.784943 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f561f4cb-a95b-466d-ac60-8d21f7601fca service neutron] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:52:44.785190 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f561f4cb-a95b-466d-ac60-8d21f7601fca service neutron] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:52:44.785546 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f561f4cb-a95b-466d-ac60-8d21f7601fca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:52:44.808822 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f561f4cb-a95b-466d-ac60-8d21f7601fca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:52:44.810287 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f561f4cb-a95b-466d-ac60-8d21f7601fca service neutron] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:52:44.836602 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 668/1343] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Oct 27 09:52:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 09:52:44.899063 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-2e54c9f3-2280-481e-ab99-743ba0f8d179 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dfe74f6bdb5f45b98793997987663c30'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:52:44.904946 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-2e54c9f3-2280-481e-ab99-743ba0f8d179 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dfe74f6bdb5f45b98793997987663c30'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:52:44.919541 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-2e54c9f3-2280-481e-ab99-743ba0f8d179 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dfe74f6bdb5f45b98793997987663c30'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:52:44.922070 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-2e54c9f3-2280-481e-ab99-743ba0f8d179 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dfe74f6bdb5f45b98793997987663c30'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:52:44.949388 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-2e54c9f3-2280-481e-ab99-743ba0f8d179 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dfe74f6bdb5f45b98793997987663c30'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:52:44.994127 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f561f4cb-a95b-466d-ac60-8d21f7601fca service neutron] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:52:44.995732 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-f561f4cb-a95b-466d-ac60-8d21f7601fca service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:52:45.036532 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f561f4cb-a95b-466d-ac60-8d21f7601fca service neutron] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:52:45.068808 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 676/1344] 10.222.0.65 () {58 vars in 1224 bytes} [Thu Oct 27 09:52:44 2022] DELETE /identity/v3/users/dfe74f6bdb5f45b98793997987663c30 => generated 0 bytes in 648 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 09:52:45.083629 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbcda2b-ee5d-466e-8ee3-739c387d5872 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:52:45.085361 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbcda2b-ee5d-466e-8ee3-739c387d5872 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:52:45.091515 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbcda2b-ee5d-466e-8ee3-739c387d5872 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:52:45.102215 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e167313-36f5-49c9-8fea-15ddd429ccc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:52:45.108731 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e167313-36f5-49c9-8fea-15ddd429ccc2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:52:45.109023 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e167313-36f5-49c9-8fea-15ddd429ccc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:52:45.112572 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e167313-36f5-49c9-8fea-15ddd429ccc2 admin admin] PATH_INFO: `/v3/projects/7e66b4c2b24e4597a3d239e50788e8a5` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:52:45.117391 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e167313-36f5-49c9-8fea-15ddd429ccc2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7e66b4c2b24e4597a3d239e50788e8a5)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:52:45.123653 dv-cinder-797970-7-smb devstack@keystone.service[88312]: WARNING py.warnings [None req-9e167313-36f5-49c9-8fea-15ddd429ccc2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 27 09:52:45.123653 dv-cinder-797970-7-smb devstack@keystone.service[88312]: warnings.warn(msg) Oct 27 09:52:45.123653 dv-cinder-797970-7-smb devstack@keystone.service[88312]: Oct 27 09:52:45.130449 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e167313-36f5-49c9-8fea-15ddd429ccc2 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:52:45.174622 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-2fbcda2b-ee5d-466e-8ee3-739c387d5872 None None] MFA Rules not processed for user `b5065084bf664b99bdeac46067cb0f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:52:45.179814 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-2fbcda2b-ee5d-466e-8ee3-739c387d5872 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:52:45.361825 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 677/1345] 10.222.0.65 () {58 vars in 958 bytes} [Thu Oct 27 09:52:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 286 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 09:52:45.382900 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-9e167313-36f5-49c9-8fea-15ddd429ccc2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7e66b4c2b24e4597a3d239e50788e8a5', 'request_id': 'req-9e167313-36f5-49c9-8fea-15ddd429ccc2'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:52:45.440661 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbcda2b-ee5d-466e-8ee3-739c387d5872 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:52:45.442099 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-2fbcda2b-ee5d-466e-8ee3-739c387d5872 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:52:45.495232 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-9e167313-36f5-49c9-8fea-15ddd429ccc2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7e66b4c2b24e4597a3d239e50788e8a5', 'request_id': 'req-9e167313-36f5-49c9-8fea-15ddd429ccc2'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:52:45.504439 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-9e167313-36f5-49c9-8fea-15ddd429ccc2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7e66b4c2b24e4597a3d239e50788e8a5', 'request_id': 'req-9e167313-36f5-49c9-8fea-15ddd429ccc2'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:52:45.573051 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-9e167313-36f5-49c9-8fea-15ddd429ccc2 admin admin] The token cache is being invalidate because project 7e66b4c2b24e4597a3d239e50788e8a5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 09:52:45.574083 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-9e167313-36f5-49c9-8fea-15ddd429ccc2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:52:45.576026 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-9e167313-36f5-49c9-8fea-15ddd429ccc2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:52:45.581468 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 669/1346] 10.222.0.65 () {58 vars in 1233 bytes} [Thu Oct 27 09:52:44 2022] DELETE /identity/v3/projects/7e66b4c2b24e4597a3d239e50788e8a5 => generated 0 bytes in 587 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 09:52:45.584272 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e167313-36f5-49c9-8fea-15ddd429ccc2 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:52:45.586933 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-9e167313-36f5-49c9-8fea-15ddd429ccc2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:52:45.638710 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbcda2b-ee5d-466e-8ee3-739c387d5872 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:52:45.758088 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e167313-36f5-49c9-8fea-15ddd429ccc2 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:52:45.778262 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737f8b31-f2a9-4141-a768-4b8116d43ee1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:52:45.778955 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737f8b31-f2a9-4141-a768-4b8116d43ee1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:52:45.779243 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737f8b31-f2a9-4141-a768-4b8116d43ee1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:52:45.779517 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737f8b31-f2a9-4141-a768-4b8116d43ee1 admin admin] PATH_INFO: `/v3/users/4f2f084dbb2a495da1a68091e713a774` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:52:45.783765 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737f8b31-f2a9-4141-a768-4b8116d43ee1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4f2f084dbb2a495da1a68091e713a774)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:52:45.787251 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737f8b31-f2a9-4141-a768-4b8116d43ee1 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:52:45.788789 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892f5ad3-b7b6-4578-b4ad-ecba6609f19a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6191cc41efa74f46b49022cf387f7a4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc2e3a7a1bcc480891c0b433291c00b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:52:45.794023 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892f5ad3-b7b6-4578-b4ad-ecba6609f19a service neutron] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:52:45.794023 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892f5ad3-b7b6-4578-b4ad-ecba6609f19a service neutron] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:52:45.794023 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892f5ad3-b7b6-4578-b4ad-ecba6609f19a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:52:45.797364 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-892f5ad3-b7b6-4578-b4ad-ecba6609f19a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:52:45.802381 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:52:45.820677 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892f5ad3-b7b6-4578-b4ad-ecba6609f19a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:52:45.825252 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=81,keystone:DELETE=18,keystone:INSERT=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:52:45.827221 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892f5ad3-b7b6-4578-b4ad-ecba6609f19a service neutron] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:52:45.844589 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 678/1347] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Oct 27 09:52:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 09:52:46.109251 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-737f8b31-f2a9-4141-a768-4b8116d43ee1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4f2f084dbb2a495da1a68091e713a774'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:52:46.138034 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-737f8b31-f2a9-4141-a768-4b8116d43ee1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4f2f084dbb2a495da1a68091e713a774'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:52:46.138973 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-737f8b31-f2a9-4141-a768-4b8116d43ee1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4f2f084dbb2a495da1a68091e713a774'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:52:46.151645 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-737f8b31-f2a9-4141-a768-4b8116d43ee1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4f2f084dbb2a495da1a68091e713a774'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:52:46.237681 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-737f8b31-f2a9-4141-a768-4b8116d43ee1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4f2f084dbb2a495da1a68091e713a774'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:52:46.255858 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 670/1348] 10.222.0.65 () {58 vars in 1224 bytes} [Thu Oct 27 09:52:45 2022] DELETE /identity/v3/users/4f2f084dbb2a495da1a68091e713a774 => generated 0 bytes in 672 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 09:52:47.179398 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892f5ad3-b7b6-4578-b4ad-ecba6609f19a service neutron] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:52:47.181478 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-892f5ad3-b7b6-4578-b4ad-ecba6609f19a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:52:47.206182 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892f5ad3-b7b6-4578-b4ad-ecba6609f19a service neutron] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:52:47.378991 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b57a305-47c5-42ca-bc34-c6cb25b7648d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:52:47.379654 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b57a305-47c5-42ca-bc34-c6cb25b7648d admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:52:47.379934 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b57a305-47c5-42ca-bc34-c6cb25b7648d admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:52:47.380271 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b57a305-47c5-42ca-bc34-c6cb25b7648d admin admin] PATH_INFO: `/v3/projects/c73ae81918c3463e9b4cf6f091037314` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:52:47.381824 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b57a305-47c5-42ca-bc34-c6cb25b7648d admin admin] RBAC: Authorizing `identity:delete_project(project_id=c73ae81918c3463e9b4cf6f091037314)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:52:47.391234 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b57a305-47c5-42ca-bc34-c6cb25b7648d admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:52:47.645577 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-1b57a305-47c5-42ca-bc34-c6cb25b7648d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c73ae81918c3463e9b4cf6f091037314', 'request_id': 'req-1b57a305-47c5-42ca-bc34-c6cb25b7648d'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:52:47.655148 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-1b57a305-47c5-42ca-bc34-c6cb25b7648d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c73ae81918c3463e9b4cf6f091037314', 'request_id': 'req-1b57a305-47c5-42ca-bc34-c6cb25b7648d'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:52:47.719862 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737f8b31-f2a9-4141-a768-4b8116d43ee1 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:52:47.721849 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-737f8b31-f2a9-4141-a768-4b8116d43ee1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:52:47.734602 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-1b57a305-47c5-42ca-bc34-c6cb25b7648d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c73ae81918c3463e9b4cf6f091037314', 'request_id': 'req-1b57a305-47c5-42ca-bc34-c6cb25b7648d'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:52:47.743967 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737f8b31-f2a9-4141-a768-4b8116d43ee1 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:52:47.750340 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-1b57a305-47c5-42ca-bc34-c6cb25b7648d admin admin] The token cache is being invalidate because project c73ae81918c3463e9b4cf6f091037314 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 09:52:47.752205 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-1b57a305-47c5-42ca-bc34-c6cb25b7648d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:52:47.759866 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-1b57a305-47c5-42ca-bc34-c6cb25b7648d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:52:47.768117 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 679/1349] 10.222.0.65 () {58 vars in 1233 bytes} [Thu Oct 27 09:52:47 2022] DELETE /identity/v3/projects/c73ae81918c3463e9b4cf6f091037314 => generated 0 bytes in 585 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 09:52:47.771079 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e10006d-39c9-4f64-afe0-b290c4da000f None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:52:47.771369 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e10006d-39c9-4f64-afe0-b290c4da000f None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:52:47.771648 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e10006d-39c9-4f64-afe0-b290c4da000f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:52:47.842904 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-5e10006d-39c9-4f64-afe0-b290c4da000f None None] MFA Rules not processed for user `b5065084bf664b99bdeac46067cb0f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:52:47.849474 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-5e10006d-39c9-4f64-afe0-b290c4da000f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:52:47.955958 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056cd536-dee9-410c-bd10-8a4fdb8dc86f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:52:47.963482 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056cd536-dee9-410c-bd10-8a4fdb8dc86f admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:52:47.963951 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056cd536-dee9-410c-bd10-8a4fdb8dc86f admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:52:47.965390 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056cd536-dee9-410c-bd10-8a4fdb8dc86f admin admin] PATH_INFO: `/v3/projects/45fdd8b573d34dd4a66050843b6cbef1` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:52:47.968073 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056cd536-dee9-410c-bd10-8a4fdb8dc86f admin admin] RBAC: Authorizing `identity:delete_project(project_id=45fdd8b573d34dd4a66050843b6cbef1)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:52:47.972054 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056cd536-dee9-410c-bd10-8a4fdb8dc86f admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:52:47.996215 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 680/1350] 10.222.0.65 () {58 vars in 958 bytes} [Thu Oct 27 09:52:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 09:52:48.014951 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9d5f1a-88f9-44f0-9cd8-b3c4a29ed382 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:52:48.015284 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9d5f1a-88f9-44f0-9cd8-b3c4a29ed382 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:52:48.015643 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9d5f1a-88f9-44f0-9cd8-b3c4a29ed382 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:52:48.048470 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-0b9d5f1a-88f9-44f0-9cd8-b3c4a29ed382 None None] MFA Rules not processed for user `b5065084bf664b99bdeac46067cb0f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:52:48.051883 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-0b9d5f1a-88f9-44f0-9cd8-b3c4a29ed382 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:52:48.065502 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 681/1351] 10.222.0.65 () {58 vars in 958 bytes} [Thu Oct 27 09:52:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 09:52:48.067861 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9d5f1a-88f9-44f0-9cd8-b3c4a29ed382 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:52:48.089688 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9d5f1a-88f9-44f0-9cd8-b3c4a29ed382 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:52:48.104695 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcc5736-21e9-4848-9ae3-8693ab27af8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:52:48.110306 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcc5736-21e9-4848-9ae3-8693ab27af8f admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:52:48.110626 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcc5736-21e9-4848-9ae3-8693ab27af8f admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:52:48.110904 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcc5736-21e9-4848-9ae3-8693ab27af8f admin admin] PATH_INFO: `/v3/domains` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:52:48.111593 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bcc5736-21e9-4848-9ae3-8693ab27af8f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 09:52:48.111899 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bcc5736-21e9-4848-9ae3-8693ab27af8f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:52:48.117073 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bcc5736-21e9-4848-9ae3-8693ab27af8f admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:52:48.137847 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-056cd536-dee9-410c-bd10-8a4fdb8dc86f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '45fdd8b573d34dd4a66050843b6cbef1', 'request_id': 'req-056cd536-dee9-410c-bd10-8a4fdb8dc86f'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:52:48.156578 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 682/1352] 10.222.0.65 () {58 vars in 1153 bytes} [Thu Oct 27 09:52:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 09:52:48.160809 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcc5736-21e9-4848-9ae3-8693ab27af8f admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:52:48.184315 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcc5736-21e9-4848-9ae3-8693ab27af8f admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:52:48.219855 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-056cd536-dee9-410c-bd10-8a4fdb8dc86f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '45fdd8b573d34dd4a66050843b6cbef1', 'request_id': 'req-056cd536-dee9-410c-bd10-8a4fdb8dc86f'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:52:48.226590 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-056cd536-dee9-410c-bd10-8a4fdb8dc86f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '45fdd8b573d34dd4a66050843b6cbef1', 'request_id': 'req-056cd536-dee9-410c-bd10-8a4fdb8dc86f'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:52:48.261140 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-056cd536-dee9-410c-bd10-8a4fdb8dc86f admin admin] The token cache is being invalidate because project 45fdd8b573d34dd4a66050843b6cbef1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 09:52:48.261437 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-056cd536-dee9-410c-bd10-8a4fdb8dc86f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:52:48.264349 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-056cd536-dee9-410c-bd10-8a4fdb8dc86f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:52:48.267031 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 671/1353] 10.222.0.65 () {58 vars in 1233 bytes} [Thu Oct 27 09:52:47 2022] DELETE /identity/v3/projects/45fdd8b573d34dd4a66050843b6cbef1 => generated 0 bytes in 548 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 09:52:48.480839 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa023b4-0303-487e-9ccd-a5785b5c5cd7 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:52:48.480839 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa023b4-0303-487e-9ccd-a5785b5c5cd7 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:52:48.480839 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa023b4-0303-487e-9ccd-a5785b5c5cd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:52:48.480839 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-caa023b4-0303-487e-9ccd-a5785b5c5cd7 None None] MFA Rules not processed for user `b5065084bf664b99bdeac46067cb0f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:52:48.480839 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-caa023b4-0303-487e-9ccd-a5785b5c5cd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:52:48.480839 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:52:48.486091 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9899b1-16b9-48ba-b978-dd43c75d82f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:52:48.486091 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9899b1-16b9-48ba-b978-dd43c75d82f7 admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:52:48.486091 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9899b1-16b9-48ba-b978-dd43c75d82f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:52:48.486091 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9899b1-16b9-48ba-b978-dd43c75d82f7 admin admin] PATH_INFO: `/v3/projects` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:52:48.487385 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9899b1-16b9-48ba-b978-dd43c75d82f7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:52:48.487385 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9899b1-16b9-48ba-b978-dd43c75d82f7 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:52:48.490633 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 672/1354] 10.222.0.65 () {58 vars in 958 bytes} [Thu Oct 27 09:52:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 09:52:48.490633 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa9b9af-83b0-4650-af96-be3ef1141b47 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:52:48.490633 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa9b9af-83b0-4650-af96-be3ef1141b47 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:52:48.490633 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa9b9af-83b0-4650-af96-be3ef1141b47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:52:48.490633 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-3fa9b9af-83b0-4650-af96-be3ef1141b47 None None] MFA Rules not processed for user `b5065084bf664b99bdeac46067cb0f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:52:48.490633 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-3fa9b9af-83b0-4650-af96-be3ef1141b47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:52:48.491435 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 673/1355] 10.222.0.65 () {58 vars in 958 bytes} [Thu Oct 27 09:52:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 09:52:48.491435 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa9b9af-83b0-4650-af96-be3ef1141b47 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:52:48.504821 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa9b9af-83b0-4650-af96-be3ef1141b47 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:52:48.516821 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b96ebc-f0d5-4a3b-a190-a370015a4d57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:52:48.517957 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b96ebc-f0d5-4a3b-a190-a370015a4d57 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:52:48.518255 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b96ebc-f0d5-4a3b-a190-a370015a4d57 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:52:48.518561 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b96ebc-f0d5-4a3b-a190-a370015a4d57 admin admin] PATH_INFO: `/v3/domains` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:52:48.519245 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b96ebc-f0d5-4a3b-a190-a370015a4d57 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 09:52:48.519617 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b96ebc-f0d5-4a3b-a190-a370015a4d57 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:52:48.522119 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b96ebc-f0d5-4a3b-a190-a370015a4d57 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:52:48.547002 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 674/1356] 10.222.0.65 () {58 vars in 1153 bytes} [Thu Oct 27 09:52:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 09:52:48.552422 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b96ebc-f0d5-4a3b-a190-a370015a4d57 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:52:48.554430 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-60b96ebc-f0d5-4a3b-a190-a370015a4d57 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:52:48.583079 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b96ebc-f0d5-4a3b-a190-a370015a4d57 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:52:48.596348 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83977bf-5089-4cae-ba81-b3a84470c4f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:52:48.597863 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83977bf-5089-4cae-ba81-b3a84470c4f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:52:48.604301 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83977bf-5089-4cae-ba81-b3a84470c4f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:52:48.604594 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83977bf-5089-4cae-ba81-b3a84470c4f6 admin admin] PATH_INFO: `/v3/projects/3ae90ba0930d47ad8be7eeb823a4e1e0` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:52:48.607257 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83977bf-5089-4cae-ba81-b3a84470c4f6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3ae90ba0930d47ad8be7eeb823a4e1e0)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:52:48.609281 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83977bf-5089-4cae-ba81-b3a84470c4f6 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:52:48.743585 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 683/1357] 10.222.0.65 () {60 vars in 1153 bytes} [Thu Oct 27 09:52:48 2022] POST /identity/v3/projects => generated 367 bytes in 569 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 09:52:48.743585 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9899b1-16b9-48ba-b978-dd43c75d82f7 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:52:48.813855 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:52:48.897143 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9899b1-16b9-48ba-b978-dd43c75d82f7 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:52:48.921702 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-a83977bf-5089-4cae-ba81-b3a84470c4f6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3ae90ba0930d47ad8be7eeb823a4e1e0', 'request_id': 'req-a83977bf-5089-4cae-ba81-b3a84470c4f6'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:52:49.016785 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e0a1e8-559a-42ed-bdfb-e17e84778959 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:52:49.017071 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e0a1e8-559a-42ed-bdfb-e17e84778959 admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:52:49.017428 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e0a1e8-559a-42ed-bdfb-e17e84778959 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:52:49.018246 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e0a1e8-559a-42ed-bdfb-e17e84778959 admin admin] PATH_INFO: `/v3/projects` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:52:49.018380 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e0a1e8-559a-42ed-bdfb-e17e84778959 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:52:49.021067 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e0a1e8-559a-42ed-bdfb-e17e84778959 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:52:49.042786 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-a83977bf-5089-4cae-ba81-b3a84470c4f6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3ae90ba0930d47ad8be7eeb823a4e1e0', 'request_id': 'req-a83977bf-5089-4cae-ba81-b3a84470c4f6'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:52:49.054676 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-a83977bf-5089-4cae-ba81-b3a84470c4f6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3ae90ba0930d47ad8be7eeb823a4e1e0', 'request_id': 'req-a83977bf-5089-4cae-ba81-b3a84470c4f6'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:52:49.073392 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-a83977bf-5089-4cae-ba81-b3a84470c4f6 admin admin] The token cache is being invalidate because project 3ae90ba0930d47ad8be7eeb823a4e1e0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 09:52:49.073698 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-a83977bf-5089-4cae-ba81-b3a84470c4f6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:52:49.075061 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-a83977bf-5089-4cae-ba81-b3a84470c4f6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:52:49.083909 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 675/1358] 10.222.0.65 () {58 vars in 1233 bytes} [Thu Oct 27 09:52:48 2022] DELETE /identity/v3/projects/3ae90ba0930d47ad8be7eeb823a4e1e0 => generated 0 bytes in 532 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 09:52:49.084759 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83977bf-5089-4cae-ba81-b3a84470c4f6 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:52:49.086375 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-a83977bf-5089-4cae-ba81-b3a84470c4f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:52:49.111517 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83977bf-5089-4cae-ba81-b3a84470c4f6 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:52:49.124268 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b419e39e-fea0-4d1d-8f2a-bf603331918b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:52:49.124911 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b419e39e-fea0-4d1d-8f2a-bf603331918b admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:52:49.125194 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b419e39e-fea0-4d1d-8f2a-bf603331918b admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:52:49.125617 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b419e39e-fea0-4d1d-8f2a-bf603331918b admin admin] PATH_INFO: `/v3/users` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:52:49.126499 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b419e39e-fea0-4d1d-8f2a-bf603331918b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:52:49.128713 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b419e39e-fea0-4d1d-8f2a-bf603331918b admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:52:49.168287 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 684/1359] 10.222.0.65 () {60 vars in 1153 bytes} [Thu Oct 27 09:52:48 2022] POST /identity/v3/projects => generated 387 bytes in 441 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 09:52:49.168558 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e0a1e8-559a-42ed-bdfb-e17e84778959 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:52:49.173467 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-20e0a1e8-559a-42ed-bdfb-e17e84778959 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:52:49.271067 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 676/1360] 10.222.0.65 () {60 vars in 1144 bytes} [Thu Oct 27 09:52:49 2022] POST /identity/v3/users => generated 284 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 09:52:49.272214 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b419e39e-fea0-4d1d-8f2a-bf603331918b admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:52:49.278348 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-b419e39e-fea0-4d1d-8f2a-bf603331918b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:52:49.299177 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e0a1e8-559a-42ed-bdfb-e17e84778959 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:52:49.302211 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b419e39e-fea0-4d1d-8f2a-bf603331918b admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:52:49.312469 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde089a9-ce37-420b-8fde-bbfbd55b5b8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:52:49.312469 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde089a9-ce37-420b-8fde-bbfbd55b5b8e admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:52:49.312469 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde089a9-ce37-420b-8fde-bbfbd55b5b8e admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:52:49.312469 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde089a9-ce37-420b-8fde-bbfbd55b5b8e admin admin] PATH_INFO: `/v3/users/d6c65f16f77842c39b574d61734800cb` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:52:49.312805 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde089a9-ce37-420b-8fde-bbfbd55b5b8e admin admin] RBAC: Authorizing `identity:delete_user(user_id=d6c65f16f77842c39b574d61734800cb)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:52:49.313963 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde089a9-ce37-420b-8fde-bbfbd55b5b8e admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:52:49.324185 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70336b79-23fd-4a64-a137-ccd3eaed1ada admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:52:49.325105 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70336b79-23fd-4a64-a137-ccd3eaed1ada admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:52:49.325585 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70336b79-23fd-4a64-a137-ccd3eaed1ada admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:52:49.326029 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70336b79-23fd-4a64-a137-ccd3eaed1ada admin admin] PATH_INFO: `/v3/users` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:52:49.326962 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70336b79-23fd-4a64-a137-ccd3eaed1ada admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:52:49.329702 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70336b79-23fd-4a64-a137-ccd3eaed1ada admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:52:49.454127 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 677/1361] 10.222.0.65 () {60 vars in 1144 bytes} [Thu Oct 27 09:52:49 2022] POST /identity/v3/users => generated 294 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 09:52:49.454258 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70336b79-23fd-4a64-a137-ccd3eaed1ada admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:52:49.482569 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70336b79-23fd-4a64-a137-ccd3eaed1ada admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:52:49.488410 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e814be0-2c86-4ff2-b3f4-d206b6938c25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:52:49.489039 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e814be0-2c86-4ff2-b3f4-d206b6938c25 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:52:49.489327 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e814be0-2c86-4ff2-b3f4-d206b6938c25 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:52:49.489610 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e814be0-2c86-4ff2-b3f4-d206b6938c25 admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:52:49.490413 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e814be0-2c86-4ff2-b3f4-d206b6938c25 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:52:49.492319 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e814be0-2c86-4ff2-b3f4-d206b6938c25 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:52:49.507985 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 678/1362] 10.222.0.65 () {58 vars in 1122 bytes} [Thu Oct 27 09:52:49 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 09:52:49.509719 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e814be0-2c86-4ff2-b3f4-d206b6938c25 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:52:49.528352 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e814be0-2c86-4ff2-b3f4-d206b6938c25 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:52:49.545412 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36583a20-3a99-4e48-a9dc-01b246df9c5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:52:49.546038 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36583a20-3a99-4e48-a9dc-01b246df9c5a admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:52:49.546479 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36583a20-3a99-4e48-a9dc-01b246df9c5a admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:52:49.546934 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36583a20-3a99-4e48-a9dc-01b246df9c5a admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:52:49.547711 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36583a20-3a99-4e48-a9dc-01b246df9c5a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:52:49.549579 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36583a20-3a99-4e48-a9dc-01b246df9c5a admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:52:49.559778 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-bde089a9-ce37-420b-8fde-bbfbd55b5b8e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd6c65f16f77842c39b574d61734800cb'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:52:49.565198 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 679/1363] 10.222.0.65 () {58 vars in 1122 bytes} [Thu Oct 27 09:52:49 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 09:52:49.565345 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-bde089a9-ce37-420b-8fde-bbfbd55b5b8e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd6c65f16f77842c39b574d61734800cb'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:52:49.566472 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da581497-4419-4931-8208-9a9c9d8090ab None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:52:49.567769 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da581497-4419-4931-8208-9a9c9d8090ab None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:52:49.569727 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da581497-4419-4931-8208-9a9c9d8090ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:52:49.581803 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-bde089a9-ce37-420b-8fde-bbfbd55b5b8e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd6c65f16f77842c39b574d61734800cb'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:52:49.583201 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-bde089a9-ce37-420b-8fde-bbfbd55b5b8e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd6c65f16f77842c39b574d61734800cb'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:52:49.608568 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-bde089a9-ce37-420b-8fde-bbfbd55b5b8e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd6c65f16f77842c39b574d61734800cb'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:52:49.627864 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-da581497-4419-4931-8208-9a9c9d8090ab None None] MFA Rules not processed for user `15b5a9cc367d490cb4de4b6a2759144a`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:52:49.629431 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-da581497-4419-4931-8208-9a9c9d8090ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:52:49.700950 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 685/1364] 10.222.0.65 () {58 vars in 1224 bytes} [Thu Oct 27 09:52:49 2022] DELETE /identity/v3/users/d6c65f16f77842c39b574d61734800cb => generated 0 bytes in 533 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 09:52:49.701863 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde089a9-ce37-420b-8fde-bbfbd55b5b8e admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:52:49.708223 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-bde089a9-ce37-420b-8fde-bbfbd55b5b8e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:52:49.798833 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 680/1365] 10.222.0.65 () {58 vars in 958 bytes} [Thu Oct 27 09:52:49 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 09:52:49.799823 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da581497-4419-4931-8208-9a9c9d8090ab None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:52:49.803422 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-da581497-4419-4931-8208-9a9c9d8090ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:52:49.829134 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da581497-4419-4931-8208-9a9c9d8090ab None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:52:49.866285 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde089a9-ce37-420b-8fde-bbfbd55b5b8e admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:52:49.878573 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0aaf8c0-b709-4a8a-a8c4-656cb0689f79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:52:49.879213 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0aaf8c0-b709-4a8a-a8c4-656cb0689f79 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:52:49.879528 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0aaf8c0-b709-4a8a-a8c4-656cb0689f79 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:52:49.879794 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0aaf8c0-b709-4a8a-a8c4-656cb0689f79 admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:52:49.880732 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0aaf8c0-b709-4a8a-a8c4-656cb0689f79 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:52:49.882080 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0aaf8c0-b709-4a8a-a8c4-656cb0689f79 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:52:49.907862 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 686/1366] 10.222.0.65 () {58 vars in 1122 bytes} [Thu Oct 27 09:52:49 2022] GET /identity/v3/roles => generated 1420 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 09:52:49.907862 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0aaf8c0-b709-4a8a-a8c4-656cb0689f79 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:52:49.921363 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-b0aaf8c0-b709-4a8a-a8c4-656cb0689f79 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:52:50.009933 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5527b4ee-d7bf-47bb-baf8-a7b7798c4743 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:52:50.010932 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5527b4ee-d7bf-47bb-baf8-a7b7798c4743 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:52:50.011040 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5527b4ee-d7bf-47bb-baf8-a7b7798c4743 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:52:50.011309 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5527b4ee-d7bf-47bb-baf8-a7b7798c4743 admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:52:50.013895 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5527b4ee-d7bf-47bb-baf8-a7b7798c4743 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:52:50.016992 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5527b4ee-d7bf-47bb-baf8-a7b7798c4743 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:52:50.029066 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 681/1367] 10.222.0.65 () {58 vars in 1122 bytes} [Thu Oct 27 09:52:49 2022] GET /identity/v3/roles => generated 1420 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 09:52:50.030002 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5527b4ee-d7bf-47bb-baf8-a7b7798c4743 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:52:50.041349 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5527b4ee-d7bf-47bb-baf8-a7b7798c4743 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:52:50.047098 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bf1667-1037-4cf1-abab-ec56d51f59b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:52:50.047360 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bf1667-1037-4cf1-abab-ec56d51f59b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:52:50.047648 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bf1667-1037-4cf1-abab-ec56d51f59b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:52:50.047933 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bf1667-1037-4cf1-abab-ec56d51f59b4 admin admin] PATH_INFO: `/v3/projects/330d76695e844c7eb758b04c728587f1/users/d8e29f213b9f41c18501072b21da2d33/roles/43543ce1450245af9661cb017bac17bd` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:52:50.067689 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92bf1667-1037-4cf1-abab-ec56d51f59b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=330d76695e844c7eb758b04c728587f1, user_id=d8e29f213b9f41c18501072b21da2d33, role_id=43543ce1450245af9661cb017bac17bd)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:52:50.071841 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92bf1667-1037-4cf1-abab-ec56d51f59b4 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:52:50.096371 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0aaf8c0-b709-4a8a-a8c4-656cb0689f79 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:52:50.097077 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d09366c-71cd-4756-b858-2e35e53c6c53 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd0d23ef039d4f1591a589d302ef165f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc2e3a7a1bcc480891c0b433291c00b1', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:52:50.097725 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d09366c-71cd-4756-b858-2e35e53c6c53 service nova] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:52:50.098023 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d09366c-71cd-4756-b858-2e35e53c6c53 service nova] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:52:50.098326 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d09366c-71cd-4756-b858-2e35e53c6c53 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:52:50.166058 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 682/1368] 10.222.0.65 () {60 vars in 1483 bytes} [Thu Oct 27 09:52:50 2022] PUT /identity/v3/projects/330d76695e844c7eb758b04c728587f1/users/d8e29f213b9f41c18501072b21da2d33/roles/43543ce1450245af9661cb017bac17bd => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 09:52:50.181066 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27d28c3-3b4e-4445-8f8d-f7d997c3fe52 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:52:50.181386 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27d28c3-3b4e-4445-8f8d-f7d997c3fe52 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:52:50.181679 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27d28c3-3b4e-4445-8f8d-f7d997c3fe52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:52:50.224485 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d09366c-71cd-4756-b858-2e35e53c6c53 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:52:50.226852 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d09366c-71cd-4756-b858-2e35e53c6c53 service nova] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:52:50.240075 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-f27d28c3-3b4e-4445-8f8d-f7d997c3fe52 None None] MFA Rules not processed for user `622419e7b1a54c5caba91e1b68faa8b9`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:52:50.246222 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-f27d28c3-3b4e-4445-8f8d-f7d997c3fe52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:52:50.257821 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 687/1369] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Oct 27 09:52:49 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 09:52:50.259835 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d09366c-71cd-4756-b858-2e35e53c6c53 service nova] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:52:50.281882 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d09366c-71cd-4756-b858-2e35e53c6c53 service nova] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:52:50.475557 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 683/1370] 10.222.0.65 () {58 vars in 958 bytes} [Thu Oct 27 09:52:50 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 299 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 09:52:50.479679 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b618ef41-267f-4827-a8d7-a3027163ced1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:52:50.480384 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b618ef41-267f-4827-a8d7-a3027163ced1 admin admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:52:50.480673 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b618ef41-267f-4827-a8d7-a3027163ced1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:52:50.480959 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b618ef41-267f-4827-a8d7-a3027163ced1 admin admin] PATH_INFO: `/v3/projects/5090fafe35da4021973773d3614e5687/users/de6865bee3674ab98d990d5727f39403/roles/43543ce1450245af9661cb017bac17bd` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:52:50.481830 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35fdcd6-cbf4-4960-8e20-4243e2c50f21 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:52:50.482156 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35fdcd6-cbf4-4960-8e20-4243e2c50f21 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:52:50.482431 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35fdcd6-cbf4-4960-8e20-4243e2c50f21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:52:50.526123 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b618ef41-267f-4827-a8d7-a3027163ced1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5090fafe35da4021973773d3614e5687, user_id=de6865bee3674ab98d990d5727f39403, role_id=43543ce1450245af9661cb017bac17bd)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:52:50.532668 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b618ef41-267f-4827-a8d7-a3027163ced1 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:52:50.550396 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-d35fdcd6-cbf4-4960-8e20-4243e2c50f21 None None] MFA Rules not processed for user `d8e29f213b9f41c18501072b21da2d33`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:52:50.551957 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-d35fdcd6-cbf4-4960-8e20-4243e2c50f21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:52:50.626792 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 688/1371] 10.222.0.65 () {60 vars in 1483 bytes} [Thu Oct 27 09:52:50 2022] PUT /identity/v3/projects/5090fafe35da4021973773d3614e5687/users/de6865bee3674ab98d990d5727f39403/roles/43543ce1450245af9661cb017bac17bd => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 09:52:50.630265 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e917c6-14fb-431b-8c1e-b9836c58da17 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:52:50.630603 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e917c6-14fb-431b-8c1e-b9836c58da17 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:52:50.630892 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e917c6-14fb-431b-8c1e-b9836c58da17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:52:50.703718 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-09e917c6-14fb-431b-8c1e-b9836c58da17 None None] MFA Rules not processed for user `622419e7b1a54c5caba91e1b68faa8b9`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:52:50.710154 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-09e917c6-14fb-431b-8c1e-b9836c58da17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:52:50.801421 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 684/1372] 10.222.0.65 () {58 vars in 958 bytes} [Thu Oct 27 09:52:50 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 331 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 09:52:50.801421 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555914d3-44e7-4af1-9c13-7c5460b37874 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:52:50.801421 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555914d3-44e7-4af1-9c13-7c5460b37874 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:52:50.801421 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555914d3-44e7-4af1-9c13-7c5460b37874 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:52:50.864556 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-555914d3-44e7-4af1-9c13-7c5460b37874 None None] MFA Rules not processed for user `de6865bee3674ab98d990d5727f39403`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:52:50.866330 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-555914d3-44e7-4af1-9c13-7c5460b37874 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:52:50.912312 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 689/1373] 10.222.0.65 () {58 vars in 958 bytes} [Thu Oct 27 09:52:50 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 284 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 09:52:50.912704 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e917c6-14fb-431b-8c1e-b9836c58da17 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:52:51.031725 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=86,keystone:DELETE=7,keystone:INSERT=7 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:52:51.072198 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e917c6-14fb-431b-8c1e-b9836c58da17 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:52:51.076022 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 685/1374] 10.222.0.65 () {58 vars in 958 bytes} [Thu Oct 27 09:52:50 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 277 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 09:52:51.077305 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555914d3-44e7-4af1-9c13-7c5460b37874 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:52:51.078927 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779cee33-6afa-4325-a523-3c4df80ccd5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:52:51.079068 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-555914d3-44e7-4af1-9c13-7c5460b37874 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:52:51.080391 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779cee33-6afa-4325-a523-3c4df80ccd5b admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:52:51.081102 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779cee33-6afa-4325-a523-3c4df80ccd5b admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:52:51.081487 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779cee33-6afa-4325-a523-3c4df80ccd5b admin admin] PATH_INFO: `/v3/projects` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:52:51.082717 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779cee33-6afa-4325-a523-3c4df80ccd5b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:52:51.085781 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779cee33-6afa-4325-a523-3c4df80ccd5b admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:52:51.096823 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:52:51.232301 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555914d3-44e7-4af1-9c13-7c5460b37874 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:52:51.239914 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 690/1375] 10.222.0.65 () {60 vars in 1153 bytes} [Thu Oct 27 09:52:50 2022] POST /identity/v3/projects => generated 367 bytes in 328 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 09:52:51.247102 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779cee33-6afa-4325-a523-3c4df80ccd5b admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:52:51.247804 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4026cde-81d9-47f9-b265-865f53703d5d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd0d23ef039d4f1591a589d302ef165f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc2e3a7a1bcc480891c0b433291c00b1', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:52:51.249989 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4026cde-81d9-47f9-b265-865f53703d5d service nova] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:52:51.250477 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4026cde-81d9-47f9-b265-865f53703d5d service nova] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:52:51.251895 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4026cde-81d9-47f9-b265-865f53703d5d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:52:51.268903 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4026cde-81d9-47f9-b265-865f53703d5d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:52:51.269622 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4026cde-81d9-47f9-b265-865f53703d5d service nova] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:52:51.292300 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 686/1376] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Oct 27 09:52:51 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 09:52:51.294571 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4026cde-81d9-47f9-b265-865f53703d5d service nova] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:52:51.311363 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4026cde-81d9-47f9-b265-865f53703d5d service nova] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:52:51.448564 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662ac7e2-dd81-46e8-9221-64afa6589b42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:52:51.449204 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662ac7e2-dd81-46e8-9221-64afa6589b42 admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:52:51.449711 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662ac7e2-dd81-46e8-9221-64afa6589b42 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:52:51.450002 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662ac7e2-dd81-46e8-9221-64afa6589b42 admin admin] PATH_INFO: `/v3/users` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:52:51.450689 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662ac7e2-dd81-46e8-9221-64afa6589b42 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:52:51.453648 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662ac7e2-dd81-46e8-9221-64afa6589b42 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:52:51.497163 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779cee33-6afa-4325-a523-3c4df80ccd5b admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:52:51.510710 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70f1f75-e3c0-41e1-8da3-67d502533ffb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:52:51.511626 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70f1f75-e3c0-41e1-8da3-67d502533ffb admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:52:51.512008 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70f1f75-e3c0-41e1-8da3-67d502533ffb admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:52:51.512382 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70f1f75-e3c0-41e1-8da3-67d502533ffb admin admin] PATH_INFO: `/v3/projects` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:52:51.513126 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70f1f75-e3c0-41e1-8da3-67d502533ffb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:52:51.519477 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70f1f75-e3c0-41e1-8da3-67d502533ffb admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:52:51.623862 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 687/1377] 10.222.0.65 () {60 vars in 1144 bytes} [Thu Oct 27 09:52:51 2022] POST /identity/v3/users => generated 290 bytes in 331 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 09:52:51.628115 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662ac7e2-dd81-46e8-9221-64afa6589b42 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:52:51.653228 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662ac7e2-dd81-46e8-9221-64afa6589b42 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:52:51.671346 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7307d080-08e4-4521-ba09-54caed2a60f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:52:51.673038 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7307d080-08e4-4521-ba09-54caed2a60f2 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:52:51.673340 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7307d080-08e4-4521-ba09-54caed2a60f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:52:51.673623 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7307d080-08e4-4521-ba09-54caed2a60f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:52:51.675642 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7307d080-08e4-4521-ba09-54caed2a60f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:52:51.690343 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7307d080-08e4-4521-ba09-54caed2a60f2 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:52:51.714505 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 688/1378] 10.222.0.65 () {58 vars in 1122 bytes} [Thu Oct 27 09:52:51 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 09:52:51.717740 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7307d080-08e4-4521-ba09-54caed2a60f2 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:52:51.721603 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 691/1379] 10.222.0.65 () {60 vars in 1153 bytes} [Thu Oct 27 09:52:51 2022] POST /identity/v3/projects => generated 385 bytes in 476 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 09:52:51.728312 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70f1f75-e3c0-41e1-8da3-67d502533ffb admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:52:51.747079 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7307d080-08e4-4521-ba09-54caed2a60f2 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:52:51.918347 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70f1f75-e3c0-41e1-8da3-67d502533ffb admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:52:51.934868 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c446929-19e9-49bd-9624-c745b79b77be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:52:51.935502 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c446929-19e9-49bd-9624-c745b79b77be admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:52:51.935785 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c446929-19e9-49bd-9624-c745b79b77be admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:52:51.936061 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c446929-19e9-49bd-9624-c745b79b77be admin admin] PATH_INFO: `/v3/users` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:52:51.936662 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d7548b-ee2f-4807-8aec-ef4478fe5e08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:52:51.936778 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c446929-19e9-49bd-9624-c745b79b77be admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:52:51.937416 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d7548b-ee2f-4807-8aec-ef4478fe5e08 admin admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:52:51.937714 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d7548b-ee2f-4807-8aec-ef4478fe5e08 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:52:51.937995 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d7548b-ee2f-4807-8aec-ef4478fe5e08 admin admin] PATH_INFO: `/v3/projects/4088ce8eae0742e385558d32bf3d7664/users/f57567c858454393a2c81780eeb94977/roles/6ad17b9f9dea4b66ab2da3677d7e715d` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:52:51.949886 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c446929-19e9-49bd-9624-c745b79b77be admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:52:51.982860 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d7548b-ee2f-4807-8aec-ef4478fe5e08 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4088ce8eae0742e385558d32bf3d7664, user_id=f57567c858454393a2c81780eeb94977, role_id=6ad17b9f9dea4b66ab2da3677d7e715d)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:52:51.990782 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d7548b-ee2f-4807-8aec-ef4478fe5e08 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:52:52.071798 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 692/1380] 10.222.0.65 () {60 vars in 1144 bytes} [Thu Oct 27 09:52:51 2022] POST /identity/v3/users => generated 293 bytes in 341 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 09:52:52.071798 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d771b517-863f-4bc3-9ca6-8959b39a3198 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:52:52.071798 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d771b517-863f-4bc3-9ca6-8959b39a3198 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:52:52.071798 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d771b517-863f-4bc3-9ca6-8959b39a3198 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:52:52.092327 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 689/1381] 10.222.0.65 () {60 vars in 1483 bytes} [Thu Oct 27 09:52:51 2022] PUT /identity/v3/projects/4088ce8eae0742e385558d32bf3d7664/users/f57567c858454393a2c81780eeb94977/roles/6ad17b9f9dea4b66ab2da3677d7e715d => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 09:52:52.095152 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83c7799-0c99-4d5a-9439-a5c55025bcf5 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:52:52.096605 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83c7799-0c99-4d5a-9439-a5c55025bcf5 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:52:52.097085 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83c7799-0c99-4d5a-9439-a5c55025bcf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:52:52.182506 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-d771b517-863f-4bc3-9ca6-8959b39a3198 None None] MFA Rules not processed for user `94fd43de1d8343d18e229b6e9429ce66`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:52:52.184299 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-d771b517-863f-4bc3-9ca6-8959b39a3198 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:52:52.224502 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-c83c7799-0c99-4d5a-9439-a5c55025bcf5 None None] MFA Rules not processed for user `c46fe9f4b4db4dcb981c5a1a2cc5f463`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:52:52.269432 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-c83c7799-0c99-4d5a-9439-a5c55025bcf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:52:52.325749 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 693/1382] 10.222.0.65 () {58 vars in 958 bytes} [Thu Oct 27 09:52:52 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 09:52:52.326940 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d771b517-863f-4bc3-9ca6-8959b39a3198 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:52:52.344986 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:52:52.455158 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d771b517-863f-4bc3-9ca6-8959b39a3198 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:52:52.471807 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47be8aa-fc6d-4936-b728-7daeb8aeef7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:52:52.472635 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47be8aa-fc6d-4936-b728-7daeb8aeef7d admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:52:52.473625 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47be8aa-fc6d-4936-b728-7daeb8aeef7d admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:52:52.474195 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47be8aa-fc6d-4936-b728-7daeb8aeef7d admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:52:52.475628 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47be8aa-fc6d-4936-b728-7daeb8aeef7d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:52:52.482985 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47be8aa-fc6d-4936-b728-7daeb8aeef7d admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:52:52.506718 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 694/1383] 10.222.0.65 () {58 vars in 1122 bytes} [Thu Oct 27 09:52:52 2022] GET /identity/v3/roles => generated 1420 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 09:52:52.506718 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47be8aa-fc6d-4936-b728-7daeb8aeef7d admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:52:52.518150 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 690/1384] 10.222.0.65 () {58 vars in 958 bytes} [Thu Oct 27 09:52:52 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 425 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 09:52:52.519379 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83c7799-0c99-4d5a-9439-a5c55025bcf5 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:52:52.521937 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-c83c7799-0c99-4d5a-9439-a5c55025bcf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:52:52.529982 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47be8aa-fc6d-4936-b728-7daeb8aeef7d admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:52:52.573465 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb56964-c044-4b08-8e75-fd53db958565 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:52:52.573465 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb56964-c044-4b08-8e75-fd53db958565 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:52:52.573465 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb56964-c044-4b08-8e75-fd53db958565 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:52:52.573465 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb56964-c044-4b08-8e75-fd53db958565 admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:52:52.574161 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb56964-c044-4b08-8e75-fd53db958565 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:52:52.574161 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb56964-c044-4b08-8e75-fd53db958565 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:52:52.574322 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83c7799-0c99-4d5a-9439-a5c55025bcf5 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:52:52.574420 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 695/1385] 10.222.0.65 () {58 vars in 1122 bytes} [Thu Oct 27 09:52:52 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 09:52:52.574420 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6908de-8620-4024-b7cf-aa0cf46757f8 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:52:52.574420 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6908de-8620-4024-b7cf-aa0cf46757f8 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:52:52.574662 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6908de-8620-4024-b7cf-aa0cf46757f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:52:52.579150 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0594babf-bf54-484f-b99c-5973b36b937d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:52:52.579946 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0594babf-bf54-484f-b99c-5973b36b937d admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:52:52.580306 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0594babf-bf54-484f-b99c-5973b36b937d admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:52:52.580687 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0594babf-bf54-484f-b99c-5973b36b937d admin admin] PATH_INFO: `/v3/projects/fb192b55812a461ca4dc5f6d5728387c` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:52:52.583852 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0594babf-bf54-484f-b99c-5973b36b937d admin admin] RBAC: Authorizing `identity:delete_project(project_id=fb192b55812a461ca4dc5f6d5728387c)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:52:52.589823 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0594babf-bf54-484f-b99c-5973b36b937d admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:52:52.626806 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-8a6908de-8620-4024-b7cf-aa0cf46757f8 None None] MFA Rules not processed for user `2acf9b6c3a394be389cd17d7fade3cf4`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:52:52.632873 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-8a6908de-8620-4024-b7cf-aa0cf46757f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:52:52.744312 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 696/1386] 10.222.0.65 () {58 vars in 958 bytes} [Thu Oct 27 09:52:52 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 09:52:52.759814 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4107cb0b-c036-4209-a00d-13c0f70503a7 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:52:52.760781 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4107cb0b-c036-4209-a00d-13c0f70503a7 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:52:52.761661 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4107cb0b-c036-4209-a00d-13c0f70503a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:52:52.789272 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:52:52.804154 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-0594babf-bf54-484f-b99c-5973b36b937d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fb192b55812a461ca4dc5f6d5728387c', 'request_id': 'req-0594babf-bf54-484f-b99c-5973b36b937d'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:52:52.859448 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-4107cb0b-c036-4209-a00d-13c0f70503a7 None None] MFA Rules not processed for user `94fd43de1d8343d18e229b6e9429ce66`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:52:52.861068 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-4107cb0b-c036-4209-a00d-13c0f70503a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:52:52.898974 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-0594babf-bf54-484f-b99c-5973b36b937d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fb192b55812a461ca4dc5f6d5728387c', 'request_id': 'req-0594babf-bf54-484f-b99c-5973b36b937d'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:52:52.907746 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-0594babf-bf54-484f-b99c-5973b36b937d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fb192b55812a461ca4dc5f6d5728387c', 'request_id': 'req-0594babf-bf54-484f-b99c-5973b36b937d'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:52:52.924472 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-0594babf-bf54-484f-b99c-5973b36b937d admin admin] The token cache is being invalidate because project fb192b55812a461ca4dc5f6d5728387c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 09:52:52.925035 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-0594babf-bf54-484f-b99c-5973b36b937d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:52:52.926173 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-0594babf-bf54-484f-b99c-5973b36b937d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:52:52.934929 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 691/1387] 10.222.0.65 () {58 vars in 1233 bytes} [Thu Oct 27 09:52:52 2022] DELETE /identity/v3/projects/fb192b55812a461ca4dc5f6d5728387c => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 09:52:52.937293 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73363be4-8e1d-4653-afa5-309da1ed2766 None None] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:52:52.938005 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73363be4-8e1d-4653-afa5-309da1ed2766 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:52:52.938554 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73363be4-8e1d-4653-afa5-309da1ed2766 None None] PATH_INFO: `/` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:52:52.940490 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 692/1388] 10.222.0.65 () {54 vars in 912 bytes} [Thu Oct 27 09:52:52 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 09:52:52.941435 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73363be4-8e1d-4653-afa5-309da1ed2766 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:52:52.943511 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-73363be4-8e1d-4653-afa5-309da1ed2766 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:52:52.983292 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 697/1389] 10.222.0.65 () {58 vars in 958 bytes} [Thu Oct 27 09:52:52 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 09:52:52.984441 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4107cb0b-c036-4209-a00d-13c0f70503a7 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:52:52.986351 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-4107cb0b-c036-4209-a00d-13c0f70503a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:52:53.046646 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73363be4-8e1d-4653-afa5-309da1ed2766 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:52:53.052362 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de96411-b51c-4ef6-9fca-77d63500355b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:52:53.053732 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de96411-b51c-4ef6-9fca-77d63500355b admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:52:53.053732 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de96411-b51c-4ef6-9fca-77d63500355b admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:52:53.053732 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de96411-b51c-4ef6-9fca-77d63500355b admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:52:53.054151 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de96411-b51c-4ef6-9fca-77d63500355b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:52:53.056370 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de96411-b51c-4ef6-9fca-77d63500355b admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:52:53.067407 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 693/1390] 10.222.0.65 () {58 vars in 1122 bytes} [Thu Oct 27 09:52:52 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 09:52:53.068298 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de96411-b51c-4ef6-9fca-77d63500355b admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:52:53.072336 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-4de96411-b51c-4ef6-9fca-77d63500355b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:52:53.096246 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de96411-b51c-4ef6-9fca-77d63500355b admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:52:53.111674 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a28ce0-3cbd-4bbb-8d2b-a176238ad8f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:52:53.112377 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a28ce0-3cbd-4bbb-8d2b-a176238ad8f9 admin admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:52:53.114366 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a28ce0-3cbd-4bbb-8d2b-a176238ad8f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:52:53.114986 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a28ce0-3cbd-4bbb-8d2b-a176238ad8f9 admin admin] PATH_INFO: `/v3/projects/4088ce8eae0742e385558d32bf3d7664/users/f57567c858454393a2c81780eeb94977/roles/6ad17b9f9dea4b66ab2da3677d7e715d` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:52:53.130776 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4107cb0b-c036-4209-a00d-13c0f70503a7 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:52:53.132099 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a28ce0-3cbd-4bbb-8d2b-a176238ad8f9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4088ce8eae0742e385558d32bf3d7664, user_id=f57567c858454393a2c81780eeb94977, role_id=6ad17b9f9dea4b66ab2da3677d7e715d)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:52:53.137243 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a28ce0-3cbd-4bbb-8d2b-a176238ad8f9 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:52:53.141502 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08228c25-bf77-4ea3-a6f1-0cf23b8fb168 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd0d23ef039d4f1591a589d302ef165f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc2e3a7a1bcc480891c0b433291c00b1', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:52:53.141926 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08228c25-bf77-4ea3-a6f1-0cf23b8fb168 service nova] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:52:53.142221 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08228c25-bf77-4ea3-a6f1-0cf23b8fb168 service nova] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:52:53.142495 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08228c25-bf77-4ea3-a6f1-0cf23b8fb168 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:52:53.156114 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-08228c25-bf77-4ea3-a6f1-0cf23b8fb168 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:52:53.165333 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 694/1391] 10.222.0.65 () {60 vars in 1483 bytes} [Thu Oct 27 09:52:53 2022] PUT /identity/v3/projects/4088ce8eae0742e385558d32bf3d7664/users/f57567c858454393a2c81780eeb94977/roles/6ad17b9f9dea4b66ab2da3677d7e715d => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 09:52:53.170504 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa46fc12-7c1e-4b31-8626-704eff1bd448 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:52:53.170504 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa46fc12-7c1e-4b31-8626-704eff1bd448 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:52:53.170504 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa46fc12-7c1e-4b31-8626-704eff1bd448 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:52:53.241687 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-aa46fc12-7c1e-4b31-8626-704eff1bd448 None None] MFA Rules not processed for user `b5065084bf664b99bdeac46067cb0f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:52:53.244227 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-aa46fc12-7c1e-4b31-8626-704eff1bd448 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:52:53.284772 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08228c25-bf77-4ea3-a6f1-0cf23b8fb168 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:52:53.287294 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08228c25-bf77-4ea3-a6f1-0cf23b8fb168 service nova] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:52:53.319775 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 698/1392] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Oct 27 09:52:52 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 09:52:53.323879 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9d03ac-5353-45d2-8c00-37699c5a9d29 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:52:53.323879 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9d03ac-5353-45d2-8c00-37699c5a9d29 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:52:53.323879 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9d03ac-5353-45d2-8c00-37699c5a9d29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:52:53.382580 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 695/1393] 10.222.0.65 () {58 vars in 958 bytes} [Thu Oct 27 09:52:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 09:52:53.382580 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa46fc12-7c1e-4b31-8626-704eff1bd448 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:52:53.393706 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa46fc12-7c1e-4b31-8626-704eff1bd448 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:52:53.401403 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:52:53.410491 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-8c9d03ac-5353-45d2-8c00-37699c5a9d29 None None] MFA Rules not processed for user `6191cc41efa74f46b49022cf387f7a4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:52:53.412895 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-8c9d03ac-5353-45d2-8c00-37699c5a9d29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:52:53.416400 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1ae380-af85-4163-b313-5bb301699c79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:52:53.416593 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1ae380-af85-4163-b313-5bb301699c79 admin admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:52:53.417129 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1ae380-af85-4163-b313-5bb301699c79 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:52:53.417404 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1ae380-af85-4163-b313-5bb301699c79 admin admin] PATH_INFO: `/v3/projects/f22ea7758cf84775bd772bbe3f622d7f/users/f867eea92f1c48168fc01952fec84084/roles/43543ce1450245af9661cb017bac17bd` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:52:53.473237 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1ae380-af85-4163-b313-5bb301699c79 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f22ea7758cf84775bd772bbe3f622d7f, user_id=f867eea92f1c48168fc01952fec84084, role_id=43543ce1450245af9661cb017bac17bd)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:52:53.487041 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1ae380-af85-4163-b313-5bb301699c79 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:52:53.551123 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 699/1394] 10.222.0.65 () {58 vars in 1009 bytes} [Thu Oct 27 09:52:53 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 09:52:53.553176 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454510f7-24c9-4868-848e-8ab087082c50 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:52:53.553698 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454510f7-24c9-4868-848e-8ab087082c50 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:52:53.554188 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454510f7-24c9-4868-848e-8ab087082c50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:52:53.591341 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 696/1395] 10.222.0.65 () {60 vars in 1483 bytes} [Thu Oct 27 09:52:53 2022] PUT /identity/v3/projects/f22ea7758cf84775bd772bbe3f622d7f/users/f867eea92f1c48168fc01952fec84084/roles/43543ce1450245af9661cb017bac17bd => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 09:52:53.593109 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3516455-3daf-4b1b-93e2-eb180d7338bf None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:52:53.593453 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3516455-3daf-4b1b-93e2-eb180d7338bf None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:52:53.593787 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3516455-3daf-4b1b-93e2-eb180d7338bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:52:53.620921 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-454510f7-24c9-4868-848e-8ab087082c50 None None] MFA Rules not processed for user `f57567c858454393a2c81780eeb94977`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:52:53.622157 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-454510f7-24c9-4868-848e-8ab087082c50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:52:53.626037 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-b3516455-3daf-4b1b-93e2-eb180d7338bf None None] MFA Rules not processed for user `b5065084bf664b99bdeac46067cb0f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:52:53.627805 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-b3516455-3daf-4b1b-93e2-eb180d7338bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:52:53.741353 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 697/1396] 10.222.0.65 () {58 vars in 958 bytes} [Thu Oct 27 09:52:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 09:52:53.743440 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3516455-3daf-4b1b-93e2-eb180d7338bf None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:52:53.745062 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-b3516455-3daf-4b1b-93e2-eb180d7338bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:52:53.864525 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 700/1397] 10.222.0.65 () {58 vars in 958 bytes} [Thu Oct 27 09:52:53 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 312 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 09:52:53.867682 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521d1b42-798c-47c4-8b14-08e210befe7a None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:52:53.868086 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521d1b42-798c-47c4-8b14-08e210befe7a None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:52:53.868727 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521d1b42-798c-47c4-8b14-08e210befe7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:52:53.921867 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3516455-3daf-4b1b-93e2-eb180d7338bf None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:52:53.925901 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b38d1fa-17db-4ab6-96d5-e6026fb26399 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6191cc41efa74f46b49022cf387f7a4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc2e3a7a1bcc480891c0b433291c00b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:52:53.926718 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b38d1fa-17db-4ab6-96d5-e6026fb26399 service neutron] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:52:53.927045 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b38d1fa-17db-4ab6-96d5-e6026fb26399 service neutron] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:52:53.927329 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b38d1fa-17db-4ab6-96d5-e6026fb26399 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:52:53.937484 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b38d1fa-17db-4ab6-96d5-e6026fb26399 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:52:53.939351 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b38d1fa-17db-4ab6-96d5-e6026fb26399 service neutron] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:52:53.949402 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 698/1398] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Oct 27 09:52:53 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 09:52:53.950414 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b38d1fa-17db-4ab6-96d5-e6026fb26399 service neutron] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:52:53.960499 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-521d1b42-798c-47c4-8b14-08e210befe7a None None] MFA Rules not processed for user `f867eea92f1c48168fc01952fec84084`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:52:53.962331 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-521d1b42-798c-47c4-8b14-08e210befe7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:52:53.964454 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b38d1fa-17db-4ab6-96d5-e6026fb26399 service neutron] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:52:53.970039 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49080e0-51fd-4337-8329-e1eaea5b0560 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:52:53.970911 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49080e0-51fd-4337-8329-e1eaea5b0560 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:52:53.971438 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49080e0-51fd-4337-8329-e1eaea5b0560 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:52:53.971790 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49080e0-51fd-4337-8329-e1eaea5b0560 admin admin] PATH_INFO: `/v3/domains` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:52:53.972562 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49080e0-51fd-4337-8329-e1eaea5b0560 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 09:52:53.972952 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49080e0-51fd-4337-8329-e1eaea5b0560 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:52:53.975037 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49080e0-51fd-4337-8329-e1eaea5b0560 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:52:53.992344 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 699/1399] 10.222.0.65 () {58 vars in 1153 bytes} [Thu Oct 27 09:52:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 09:52:53.993156 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49080e0-51fd-4337-8329-e1eaea5b0560 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:52:53.997618 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-a49080e0-51fd-4337-8329-e1eaea5b0560 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:52:54.027815 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:52:54.141543 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 701/1400] 10.222.0.65 () {58 vars in 958 bytes} [Thu Oct 27 09:52:53 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 276 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 09:52:54.148479 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521d1b42-798c-47c4-8b14-08e210befe7a None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:52:54.150825 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49080e0-51fd-4337-8329-e1eaea5b0560 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:52:54.160841 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b620e5-c485-4833-b24b-a0834b8cae09 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8e5d5f04c4741bb86ca4a0f667d4ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc2e3a7a1bcc480891c0b433291c00b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:52:54.161476 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b620e5-c485-4833-b24b-a0834b8cae09 service cinder] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:52:54.161767 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b620e5-c485-4833-b24b-a0834b8cae09 service cinder] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:52:54.162087 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b620e5-c485-4833-b24b-a0834b8cae09 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:52:54.175585 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:52:54.188009 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b620e5-c485-4833-b24b-a0834b8cae09 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:52:54.189785 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b620e5-c485-4833-b24b-a0834b8cae09 service cinder] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:52:54.191079 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521d1b42-798c-47c4-8b14-08e210befe7a None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:52:54.208861 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70161cfb-3b0d-46ad-9134-83ee0b2900fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:52:54.209649 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70161cfb-3b0d-46ad-9134-83ee0b2900fc admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:52:54.210088 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70161cfb-3b0d-46ad-9134-83ee0b2900fc admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:52:54.210503 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70161cfb-3b0d-46ad-9134-83ee0b2900fc admin admin] PATH_INFO: `/v3/projects` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:52:54.215465 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70161cfb-3b0d-46ad-9134-83ee0b2900fc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:52:54.219075 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 700/1401] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Oct 27 09:52:53 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 09:52:54.219075 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b620e5-c485-4833-b24b-a0834b8cae09 service cinder] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:52:54.219376 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70161cfb-3b0d-46ad-9134-83ee0b2900fc admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:52:54.234169 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b620e5-c485-4833-b24b-a0834b8cae09 service cinder] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:52:54.250613 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2e3c84-4344-4de2-a874-e302026955c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:52:54.251256 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2e3c84-4344-4de2-a874-e302026955c2 admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:52:54.256331 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2e3c84-4344-4de2-a874-e302026955c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:52:54.256331 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2e3c84-4344-4de2-a874-e302026955c2 admin admin] PATH_INFO: `/v3/projects` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:52:54.256331 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2e3c84-4344-4de2-a874-e302026955c2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:52:54.256331 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2e3c84-4344-4de2-a874-e302026955c2 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:52:54.356636 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 702/1402] 10.222.0.65 () {60 vars in 1153 bytes} [Thu Oct 27 09:52:54 2022] POST /identity/v3/projects => generated 381 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 09:52:54.360912 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70161cfb-3b0d-46ad-9134-83ee0b2900fc admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:52:54.427776 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 701/1403] 10.222.0.65 () {60 vars in 1153 bytes} [Thu Oct 27 09:52:54 2022] POST /identity/v3/projects => generated 387 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 09:52:54.432153 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2e3c84-4344-4de2-a874-e302026955c2 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:52:54.558130 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70161cfb-3b0d-46ad-9134-83ee0b2900fc admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:52:54.622344 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2e3c84-4344-4de2-a874-e302026955c2 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:52:54.640612 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a357cb4b-42de-43b9-8fee-38923263adf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:52:54.641266 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a357cb4b-42de-43b9-8fee-38923263adf4 admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:52:54.641551 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a357cb4b-42de-43b9-8fee-38923263adf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:52:54.641897 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a357cb4b-42de-43b9-8fee-38923263adf4 admin admin] PATH_INFO: `/v3/users` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:52:54.642597 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a357cb4b-42de-43b9-8fee-38923263adf4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:52:54.644580 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a357cb4b-42de-43b9-8fee-38923263adf4 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:52:54.722767 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea51f883-9cc4-44c6-9a80-84e6c8a2d96a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:52:54.723408 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea51f883-9cc4-44c6-9a80-84e6c8a2d96a admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:52:54.723794 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea51f883-9cc4-44c6-9a80-84e6c8a2d96a admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:52:54.724245 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea51f883-9cc4-44c6-9a80-84e6c8a2d96a admin admin] PATH_INFO: `/v3/users` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:52:54.724896 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea51f883-9cc4-44c6-9a80-84e6c8a2d96a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:52:54.727682 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea51f883-9cc4-44c6-9a80-84e6c8a2d96a admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:52:54.761285 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 702/1404] 10.222.0.65 () {60 vars in 1144 bytes} [Thu Oct 27 09:52:54 2022] POST /identity/v3/users => generated 300 bytes in 328 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 09:52:54.768419 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a357cb4b-42de-43b9-8fee-38923263adf4 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:52:54.806340 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a357cb4b-42de-43b9-8fee-38923263adf4 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:52:54.826230 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f265b64-629f-40de-a2e5-a267cc26d3af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:52:54.826997 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f265b64-629f-40de-a2e5-a267cc26d3af admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:52:54.828512 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f265b64-629f-40de-a2e5-a267cc26d3af admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:52:54.828512 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f265b64-629f-40de-a2e5-a267cc26d3af admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:52:54.831421 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f265b64-629f-40de-a2e5-a267cc26d3af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:52:54.833965 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f265b64-629f-40de-a2e5-a267cc26d3af admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:52:54.888498 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 703/1405] 10.222.0.65 () {60 vars in 1144 bytes} [Thu Oct 27 09:52:54 2022] POST /identity/v3/users => generated 291 bytes in 528 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 09:52:54.889835 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 703/1406] 10.222.0.65 () {58 vars in 1122 bytes} [Thu Oct 27 09:52:54 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 09:52:54.894729 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea51f883-9cc4-44c6-9a80-84e6c8a2d96a admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:52:54.896143 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f265b64-629f-40de-a2e5-a267cc26d3af admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:52:54.927728 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea51f883-9cc4-44c6-9a80-84e6c8a2d96a admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:52:54.931609 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f265b64-629f-40de-a2e5-a267cc26d3af admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:52:54.937815 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d039698-8f32-4bf1-9c7d-8b4a67c39c9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:52:54.940092 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d039698-8f32-4bf1-9c7d-8b4a67c39c9c admin admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:52:54.940402 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d039698-8f32-4bf1-9c7d-8b4a67c39c9c admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:52:54.940688 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d039698-8f32-4bf1-9c7d-8b4a67c39c9c admin admin] PATH_INFO: `/v3/projects/7e2e6dbb427742d99900166027ef8f3b/users/8af49016684c449887d5c557694e9982/roles/6ad17b9f9dea4b66ab2da3677d7e715d` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:52:54.942748 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f965f1e9-8fb5-4bdd-9b13-23ce36c83eb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:52:54.950078 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f965f1e9-8fb5-4bdd-9b13-23ce36c83eb1 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:52:54.950458 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f965f1e9-8fb5-4bdd-9b13-23ce36c83eb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:52:54.951414 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f965f1e9-8fb5-4bdd-9b13-23ce36c83eb1 admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:52:54.952758 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f965f1e9-8fb5-4bdd-9b13-23ce36c83eb1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:52:54.960441 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f965f1e9-8fb5-4bdd-9b13-23ce36c83eb1 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:52:55.002031 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 704/1407] 10.222.0.65 () {58 vars in 1122 bytes} [Thu Oct 27 09:52:54 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 09:52:55.011058 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f965f1e9-8fb5-4bdd-9b13-23ce36c83eb1 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:52:55.017782 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-f965f1e9-8fb5-4bdd-9b13-23ce36c83eb1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:52:55.020078 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d039698-8f32-4bf1-9c7d-8b4a67c39c9c admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e2e6dbb427742d99900166027ef8f3b, user_id=8af49016684c449887d5c557694e9982, role_id=6ad17b9f9dea4b66ab2da3677d7e715d)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:52:55.032955 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d039698-8f32-4bf1-9c7d-8b4a67c39c9c admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:52:55.170391 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f965f1e9-8fb5-4bdd-9b13-23ce36c83eb1 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:52:55.179099 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5066d13-4059-41b0-bd10-c7c355769132 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd0d23ef039d4f1591a589d302ef165f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc2e3a7a1bcc480891c0b433291c00b1', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:52:55.180029 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5066d13-4059-41b0-bd10-c7c355769132 service nova] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:52:55.180331 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5066d13-4059-41b0-bd10-c7c355769132 service nova] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:52:55.180626 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5066d13-4059-41b0-bd10-c7c355769132 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:52:55.184559 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-d5066d13-4059-41b0-bd10-c7c355769132 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:52:55.208191 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 704/1408] 10.222.0.65 () {60 vars in 1483 bytes} [Thu Oct 27 09:52:54 2022] PUT /identity/v3/projects/7e2e6dbb427742d99900166027ef8f3b/users/8af49016684c449887d5c557694e9982/roles/6ad17b9f9dea4b66ab2da3677d7e715d => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 09:52:55.209186 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d039698-8f32-4bf1-9c7d-8b4a67c39c9c admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:52:55.349454 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5066d13-4059-41b0-bd10-c7c355769132 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:52:55.355466 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5066d13-4059-41b0-bd10-c7c355769132 service nova] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:52:55.397206 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d039698-8f32-4bf1-9c7d-8b4a67c39c9c admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:52:55.408184 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 705/1409] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Oct 27 09:52:55 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 09:52:55.409934 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5066d13-4059-41b0-bd10-c7c355769132 service nova] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:52:55.411228 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc87c01-065f-4e47-8b01-9c418e488d87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:52:55.411954 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc87c01-065f-4e47-8b01-9c418e488d87 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:52:55.412332 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc87c01-065f-4e47-8b01-9c418e488d87 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:52:55.412709 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc87c01-065f-4e47-8b01-9c418e488d87 admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:52:55.413453 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc87c01-065f-4e47-8b01-9c418e488d87 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:52:55.416474 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc87c01-065f-4e47-8b01-9c418e488d87 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:52:55.418843 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-d5066d13-4059-41b0-bd10-c7c355769132 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:52:55.437841 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 705/1410] 10.222.0.65 () {58 vars in 1122 bytes} [Thu Oct 27 09:52:55 2022] GET /identity/v3/roles => generated 1420 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 09:52:55.438913 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc87c01-065f-4e47-8b01-9c418e488d87 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:52:55.461479 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc87c01-065f-4e47-8b01-9c418e488d87 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:52:55.474964 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13307532-cf4d-4411-8b9b-17b0137aab1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:52:55.475679 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13307532-cf4d-4411-8b9b-17b0137aab1a admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:52:55.476056 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13307532-cf4d-4411-8b9b-17b0137aab1a admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:52:55.476425 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13307532-cf4d-4411-8b9b-17b0137aab1a admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:52:55.477721 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13307532-cf4d-4411-8b9b-17b0137aab1a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:52:55.479504 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13307532-cf4d-4411-8b9b-17b0137aab1a admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:52:55.498902 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 706/1411] 10.222.0.65 () {58 vars in 1122 bytes} [Thu Oct 27 09:52:55 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 09:52:55.500106 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13307532-cf4d-4411-8b9b-17b0137aab1a admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:52:55.528926 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13307532-cf4d-4411-8b9b-17b0137aab1a admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:52:55.554080 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bbf938-39a2-4618-aad4-45e8d282d7f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:52:55.555423 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bbf938-39a2-4618-aad4-45e8d282d7f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:52:55.555857 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bbf938-39a2-4618-aad4-45e8d282d7f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:52:55.556255 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bbf938-39a2-4618-aad4-45e8d282d7f7 admin admin] PATH_INFO: `/v3/projects/1893ef8ed9354c319f1262483925b245/users/54194ce7dd8e42dd81a870cce4e75343/roles/43543ce1450245af9661cb017bac17bd` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:52:55.577034 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:52:55.581509 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1bbf938-39a2-4618-aad4-45e8d282d7f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1893ef8ed9354c319f1262483925b245, user_id=54194ce7dd8e42dd81a870cce4e75343, role_id=43543ce1450245af9661cb017bac17bd)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:52:55.581509 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1bbf938-39a2-4618-aad4-45e8d282d7f7 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:52:55.710557 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 707/1412] 10.222.0.65 () {60 vars in 1483 bytes} [Thu Oct 27 09:52:55 2022] PUT /identity/v3/projects/1893ef8ed9354c319f1262483925b245/users/54194ce7dd8e42dd81a870cce4e75343/roles/43543ce1450245af9661cb017bac17bd => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 09:52:55.710557 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bbf938-39a2-4618-aad4-45e8d282d7f7 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:52:55.723080 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5066d13-4059-41b0-bd10-c7c355769132 service nova] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:52:55.832316 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bbf938-39a2-4618-aad4-45e8d282d7f7 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:52:55.859779 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ccfb2d-eb23-4983-b917-90953bb152e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:52:55.860724 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ccfb2d-eb23-4983-b917-90953bb152e7 admin admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:52:55.861350 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ccfb2d-eb23-4983-b917-90953bb152e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:52:55.861770 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ccfb2d-eb23-4983-b917-90953bb152e7 admin admin] PATH_INFO: `/v3/projects/7e2e6dbb427742d99900166027ef8f3b/users/8af49016684c449887d5c557694e9982/roles/6ad17b9f9dea4b66ab2da3677d7e715d` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:52:55.864507 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ccfb2d-eb23-4983-b917-90953bb152e7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e2e6dbb427742d99900166027ef8f3b, user_id=8af49016684c449887d5c557694e9982, role_id=6ad17b9f9dea4b66ab2da3677d7e715d)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:52:55.870955 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ccfb2d-eb23-4983-b917-90953bb152e7 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:52:55.995190 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 708/1413] 10.222.0.65 () {60 vars in 1483 bytes} [Thu Oct 27 09:52:55 2022] PUT /identity/v3/projects/7e2e6dbb427742d99900166027ef8f3b/users/8af49016684c449887d5c557694e9982/roles/6ad17b9f9dea4b66ab2da3677d7e715d => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 09:52:55.997756 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb8626c-56ba-4eed-b3c8-53050f66d096 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:52:55.998248 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb8626c-56ba-4eed-b3c8-53050f66d096 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:52:56.007425 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb8626c-56ba-4eed-b3c8-53050f66d096 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:52:56.031199 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:52:56.031516 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5f29e2-f447-43d1-a80d-9b7a2f6422dd service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8c47ff5d72943f6bab09b5df6198d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc2e3a7a1bcc480891c0b433291c00b1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:52:56.032287 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5f29e2-f447-43d1-a80d-9b7a2f6422dd service placement] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:52:56.032717 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5f29e2-f447-43d1-a80d-9b7a2f6422dd service placement] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:52:56.033137 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5f29e2-f447-43d1-a80d-9b7a2f6422dd service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:52:56.042314 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-ef5f29e2-f447-43d1-a80d-9b7a2f6422dd service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:52:56.079687 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5f29e2-f447-43d1-a80d-9b7a2f6422dd service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:52:56.081604 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5f29e2-f447-43d1-a80d-9b7a2f6422dd service placement] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:52:56.109483 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 706/1414] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Oct 27 09:52:55 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 701 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 09:52:56.111598 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18555427-4ef3-47fc-9773-5c8b94cd3e81 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:52:56.112172 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18555427-4ef3-47fc-9773-5c8b94cd3e81 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:52:56.112699 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18555427-4ef3-47fc-9773-5c8b94cd3e81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:52:56.151629 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-dcb8626c-56ba-4eed-b3c8-53050f66d096 None None] MFA Rules not processed for user `54194ce7dd8e42dd81a870cce4e75343`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:52:56.152886 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-dcb8626c-56ba-4eed-b3c8-53050f66d096 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:52:56.184969 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-18555427-4ef3-47fc-9773-5c8b94cd3e81 None None] MFA Rules not processed for user `8af49016684c449887d5c557694e9982`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:52:56.189196 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-18555427-4ef3-47fc-9773-5c8b94cd3e81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:52:56.409101 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 709/1415] 10.222.0.65 () {58 vars in 958 bytes} [Thu Oct 27 09:52:55 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 413 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 09:52:56.421467 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 707/1416] 10.222.0.65 () {58 vars in 958 bytes} [Thu Oct 27 09:52:56 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 311 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 09:52:56.422143 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352cf189-c2b6-4f73-82bb-729b04253b40 None None] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:52:56.422438 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352cf189-c2b6-4f73-82bb-729b04253b40 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:52:56.422736 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352cf189-c2b6-4f73-82bb-729b04253b40 None None] PATH_INFO: `/` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:52:56.422866 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18555427-4ef3-47fc-9773-5c8b94cd3e81 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:52:56.439274 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 710/1417] 10.222.0.65 () {54 vars in 912 bytes} [Thu Oct 27 09:52:56 2022] GET /identity => generated 270 bytes in 30 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 09:52:56.446282 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352cf189-c2b6-4f73-82bb-729b04253b40 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:52:56.630334 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18555427-4ef3-47fc-9773-5c8b94cd3e81 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:52:56.664229 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592ce1e6-07c5-4e98-8e64-23ab63a8e047 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:52:56.665257 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592ce1e6-07c5-4e98-8e64-23ab63a8e047 admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:52:56.665552 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592ce1e6-07c5-4e98-8e64-23ab63a8e047 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:52:56.667264 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592ce1e6-07c5-4e98-8e64-23ab63a8e047 admin admin] PATH_INFO: `/v3/projects` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:52:56.667957 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592ce1e6-07c5-4e98-8e64-23ab63a8e047 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:52:56.672234 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592ce1e6-07c5-4e98-8e64-23ab63a8e047 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:52:56.701804 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352cf189-c2b6-4f73-82bb-729b04253b40 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:52:56.723883 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51af7ac6-4a61-411b-8f13-4f0d614a0d20 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8e5d5f04c4741bb86ca4a0f667d4ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc2e3a7a1bcc480891c0b433291c00b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:52:56.725233 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51af7ac6-4a61-411b-8f13-4f0d614a0d20 service cinder] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:52:56.725893 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51af7ac6-4a61-411b-8f13-4f0d614a0d20 service cinder] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:52:56.726329 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51af7ac6-4a61-411b-8f13-4f0d614a0d20 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:52:56.744756 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51af7ac6-4a61-411b-8f13-4f0d614a0d20 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:52:56.746576 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51af7ac6-4a61-411b-8f13-4f0d614a0d20 service cinder] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:52:56.760014 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 711/1418] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Oct 27 09:52:56 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 09:52:56.763542 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99660bd2-7f1d-4df2-a841-a117055194b4 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:52:56.764247 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99660bd2-7f1d-4df2-a841-a117055194b4 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:52:56.764746 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99660bd2-7f1d-4df2-a841-a117055194b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:52:56.808417 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-99660bd2-7f1d-4df2-a841-a117055194b4 None None] MFA Rules not processed for user `6191cc41efa74f46b49022cf387f7a4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:52:56.814108 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-99660bd2-7f1d-4df2-a841-a117055194b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:52:56.853623 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 708/1419] 10.222.0.65 () {60 vars in 1153 bytes} [Thu Oct 27 09:52:56 2022] POST /identity/v3/projects => generated 381 bytes in 431 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 09:52:56.855242 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592ce1e6-07c5-4e98-8e64-23ab63a8e047 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:52:56.963729 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 712/1420] 10.222.0.65 () {58 vars in 1009 bytes} [Thu Oct 27 09:52:56 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 09:52:56.989620 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592ce1e6-07c5-4e98-8e64-23ab63a8e047 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:52:56.997104 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d873e41-f350-469f-b5a8-1630d1569b56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:52:56.998015 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d873e41-f350-469f-b5a8-1630d1569b56 admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:52:56.998855 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d873e41-f350-469f-b5a8-1630d1569b56 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:52:57.005485 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d873e41-f350-469f-b5a8-1630d1569b56 admin admin] PATH_INFO: `/v3/users` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:52:57.005485 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d873e41-f350-469f-b5a8-1630d1569b56 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:52:57.005485 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d873e41-f350-469f-b5a8-1630d1569b56 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:52:57.044934 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99660bd2-7f1d-4df2-a841-a117055194b4 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:52:57.046567 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-99660bd2-7f1d-4df2-a841-a117055194b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:52:57.061381 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99660bd2-7f1d-4df2-a841-a117055194b4 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:52:57.143193 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d947ffb7-7281-450b-9148-1fcaeb252ec4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6191cc41efa74f46b49022cf387f7a4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc2e3a7a1bcc480891c0b433291c00b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:52:57.143193 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d947ffb7-7281-450b-9148-1fcaeb252ec4 service neutron] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:52:57.143193 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d947ffb7-7281-450b-9148-1fcaeb252ec4 service neutron] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:52:57.143193 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d947ffb7-7281-450b-9148-1fcaeb252ec4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:52:57.152704 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d947ffb7-7281-450b-9148-1fcaeb252ec4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:52:57.155008 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d947ffb7-7281-450b-9148-1fcaeb252ec4 service neutron] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:52:57.178181 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 709/1421] 10.222.0.65 () {60 vars in 1144 bytes} [Thu Oct 27 09:52:56 2022] POST /identity/v3/users => generated 297 bytes in 319 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 09:52:57.178181 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d873e41-f350-469f-b5a8-1630d1569b56 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:52:57.195444 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 713/1422] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Oct 27 09:52:57 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 09:52:57.256362 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d873e41-f350-469f-b5a8-1630d1569b56 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:52:57.287061 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0228b8d0-3cdb-46cf-bd3b-a2e5ac7c0fa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:52:57.287713 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0228b8d0-3cdb-46cf-bd3b-a2e5ac7c0fa8 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:52:57.287997 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0228b8d0-3cdb-46cf-bd3b-a2e5ac7c0fa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:52:57.288272 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0228b8d0-3cdb-46cf-bd3b-a2e5ac7c0fa8 admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:52:57.289981 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0228b8d0-3cdb-46cf-bd3b-a2e5ac7c0fa8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:52:57.291415 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0228b8d0-3cdb-46cf-bd3b-a2e5ac7c0fa8 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:52:57.319493 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 710/1423] 10.222.0.65 () {58 vars in 1122 bytes} [Thu Oct 27 09:52:57 2022] GET /identity/v3/roles => generated 1420 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 09:52:57.330102 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d947ffb7-7281-450b-9148-1fcaeb252ec4 service neutron] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:52:57.372681 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d947ffb7-7281-450b-9148-1fcaeb252ec4 service neutron] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:52:57.384880 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d44dd6-2e3c-494a-9431-d3cb210620da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:52:57.387415 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d44dd6-2e3c-494a-9431-d3cb210620da admin admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:52:57.388028 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d44dd6-2e3c-494a-9431-d3cb210620da admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:52:57.388501 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d44dd6-2e3c-494a-9431-d3cb210620da admin admin] PATH_INFO: `/v3/projects/44b2ccf81b644f4bb07b9141d2d67686/users/e381a4bdc9e14d1d8e96d5588d6ef05f/roles/6ad17b9f9dea4b66ab2da3677d7e715d` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:52:57.443520 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d44dd6-2e3c-494a-9431-d3cb210620da admin admin] RBAC: Authorizing `identity:create_grant(project_id=44b2ccf81b644f4bb07b9141d2d67686, user_id=e381a4bdc9e14d1d8e96d5588d6ef05f, role_id=6ad17b9f9dea4b66ab2da3677d7e715d)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:52:57.454210 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d44dd6-2e3c-494a-9431-d3cb210620da admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:52:57.565718 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18e5213-24f1-4ff6-9ecb-5fc3c8c11500 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:52:57.565718 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18e5213-24f1-4ff6-9ecb-5fc3c8c11500 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:52:57.565718 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18e5213-24f1-4ff6-9ecb-5fc3c8c11500 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:52:57.617271 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 714/1424] 10.222.0.65 () {60 vars in 1483 bytes} [Thu Oct 27 09:52:57 2022] PUT /identity/v3/projects/44b2ccf81b644f4bb07b9141d2d67686/users/e381a4bdc9e14d1d8e96d5588d6ef05f/roles/6ad17b9f9dea4b66ab2da3677d7e715d => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 09:52:57.617359 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-f18e5213-24f1-4ff6-9ecb-5fc3c8c11500 None None] MFA Rules not processed for user `94fd43de1d8343d18e229b6e9429ce66`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:52:57.617359 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-f18e5213-24f1-4ff6-9ecb-5fc3c8c11500 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:52:57.618849 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d44dd6-2e3c-494a-9431-d3cb210620da admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:52:57.682346 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:52:57.778487 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:52:57.797608 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 711/1425] 10.222.0.65 () {58 vars in 958 bytes} [Thu Oct 27 09:52:57 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 09:52:57.806568 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d44dd6-2e3c-494a-9431-d3cb210620da admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:52:57.813638 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9282e9-6d60-445c-81d3-a9e1c01d5a04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:52:57.815505 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9282e9-6d60-445c-81d3-a9e1c01d5a04 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:52:57.816106 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9282e9-6d60-445c-81d3-a9e1c01d5a04 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:52:57.816589 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9282e9-6d60-445c-81d3-a9e1c01d5a04 admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:52:57.817442 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9282e9-6d60-445c-81d3-a9e1c01d5a04 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:52:57.819384 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9282e9-6d60-445c-81d3-a9e1c01d5a04 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:52:57.834035 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 715/1426] 10.222.0.65 () {58 vars in 1122 bytes} [Thu Oct 27 09:52:57 2022] GET /identity/v3/roles => generated 1420 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 09:52:57.839373 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18e5213-24f1-4ff6-9ecb-5fc3c8c11500 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:52:57.875844 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18e5213-24f1-4ff6-9ecb-5fc3c8c11500 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:52:57.890186 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cc9825-045c-4883-9ee8-0c855c2c9544 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:52:57.890992 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cc9825-045c-4883-9ee8-0c855c2c9544 admin admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:52:57.891239 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cc9825-045c-4883-9ee8-0c855c2c9544 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:52:57.891614 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cc9825-045c-4883-9ee8-0c855c2c9544 admin admin] PATH_INFO: `/v3/projects/44b2ccf81b644f4bb07b9141d2d67686/users/e381a4bdc9e14d1d8e96d5588d6ef05f/roles/6ad17b9f9dea4b66ab2da3677d7e715d` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:52:57.897055 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1cc9825-045c-4883-9ee8-0c855c2c9544 admin admin] RBAC: Authorizing `identity:create_grant(project_id=44b2ccf81b644f4bb07b9141d2d67686, user_id=e381a4bdc9e14d1d8e96d5588d6ef05f, role_id=6ad17b9f9dea4b66ab2da3677d7e715d)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:52:57.900193 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1cc9825-045c-4883-9ee8-0c855c2c9544 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:52:57.954960 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 712/1427] 10.222.0.65 () {60 vars in 1483 bytes} [Thu Oct 27 09:52:57 2022] PUT /identity/v3/projects/44b2ccf81b644f4bb07b9141d2d67686/users/e381a4bdc9e14d1d8e96d5588d6ef05f/roles/6ad17b9f9dea4b66ab2da3677d7e715d => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 09:52:57.957130 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec7a596-14d0-4d91-b63b-8c8c572f990f None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:52:57.959522 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec7a596-14d0-4d91-b63b-8c8c572f990f None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:52:57.960110 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec7a596-14d0-4d91-b63b-8c8c572f990f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:52:58.076860 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-4ec7a596-14d0-4d91-b63b-8c8c572f990f None None] MFA Rules not processed for user `e381a4bdc9e14d1d8e96d5588d6ef05f`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:52:58.078266 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-4ec7a596-14d0-4d91-b63b-8c8c572f990f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:52:58.096804 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2475f83-5a3e-400b-8f62-e16d21f20a79 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:52:58.100105 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2475f83-5a3e-400b-8f62-e16d21f20a79 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:52:58.100105 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2475f83-5a3e-400b-8f62-e16d21f20a79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:52:58.144625 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-b2475f83-5a3e-400b-8f62-e16d21f20a79 None None] MFA Rules not processed for user `15b5a9cc367d490cb4de4b6a2759144a`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:52:58.150609 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-b2475f83-5a3e-400b-8f62-e16d21f20a79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:52:58.317118 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 716/1428] 10.222.0.65 () {58 vars in 958 bytes} [Thu Oct 27 09:52:57 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 359 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 09:52:58.321073 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 713/1429] 10.222.0.65 () {58 vars in 958 bytes} [Thu Oct 27 09:52:58 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 09:52:58.526967 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec7a596-14d0-4d91-b63b-8c8c572f990f None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:52:58.529040 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-4ec7a596-14d0-4d91-b63b-8c8c572f990f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:52:58.611440 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec7a596-14d0-4d91-b63b-8c8c572f990f None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:52:58.618206 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7830ae9-443b-40d1-9b5e-d7570dea68b4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8e5d5f04c4741bb86ca4a0f667d4ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc2e3a7a1bcc480891c0b433291c00b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:52:58.626161 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7830ae9-443b-40d1-9b5e-d7570dea68b4 service cinder] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:52:58.626719 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7830ae9-443b-40d1-9b5e-d7570dea68b4 service cinder] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:52:58.627333 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7830ae9-443b-40d1-9b5e-d7570dea68b4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:52:58.667929 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7830ae9-443b-40d1-9b5e-d7570dea68b4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:52:58.673243 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7830ae9-443b-40d1-9b5e-d7570dea68b4 service cinder] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:52:58.699518 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 717/1430] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Oct 27 09:52:58 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 09:52:59.088622 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:52:59.097759 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2475f83-5a3e-400b-8f62-e16d21f20a79 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:52:59.139372 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:52:59.142549 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2475f83-5a3e-400b-8f62-e16d21f20a79 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:52:59.175389 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a333a1-f9ea-4b7b-9570-a43c05bd33e4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8e5d5f04c4741bb86ca4a0f667d4ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc2e3a7a1bcc480891c0b433291c00b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:52:59.175389 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a333a1-f9ea-4b7b-9570-a43c05bd33e4 service cinder] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:52:59.175389 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a333a1-f9ea-4b7b-9570-a43c05bd33e4 service cinder] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:52:59.175389 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a333a1-f9ea-4b7b-9570-a43c05bd33e4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:52:59.224091 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7830ae9-443b-40d1-9b5e-d7570dea68b4 service cinder] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:52:59.240728 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7830ae9-443b-40d1-9b5e-d7570dea68b4 service cinder] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:52:59.253009 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daba73dc-0216-4d6f-aec1-c400e84e37b8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8e5d5f04c4741bb86ca4a0f667d4ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc2e3a7a1bcc480891c0b433291c00b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:52:59.256823 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daba73dc-0216-4d6f-aec1-c400e84e37b8 service cinder] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:52:59.256823 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daba73dc-0216-4d6f-aec1-c400e84e37b8 service cinder] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:52:59.256823 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daba73dc-0216-4d6f-aec1-c400e84e37b8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:52:59.260345 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-daba73dc-0216-4d6f-aec1-c400e84e37b8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:52:59.367754 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a333a1-f9ea-4b7b-9570-a43c05bd33e4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:52:59.378090 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a333a1-f9ea-4b7b-9570-a43c05bd33e4 service cinder] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:52:59.421208 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 714/1431] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Oct 27 09:52:59 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 09:52:59.470850 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daba73dc-0216-4d6f-aec1-c400e84e37b8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:52:59.499563 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daba73dc-0216-4d6f-aec1-c400e84e37b8 service cinder] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:52:59.552068 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 718/1432] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Oct 27 09:52:59 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 09:52:59.887528 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:53:00.496779 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adc938e-2f82-4f55-8f06-8500c460d0e1 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:53:00.497328 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adc938e-2f82-4f55-8f06-8500c460d0e1 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:53:00.497328 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adc938e-2f82-4f55-8f06-8500c460d0e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:53:00.532916 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-1adc938e-2f82-4f55-8f06-8500c460d0e1 None None] MFA Rules not processed for user `c46fe9f4b4db4dcb981c5a1a2cc5f463`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:53:00.534452 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-1adc938e-2f82-4f55-8f06-8500c460d0e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:53:00.664468 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 715/1433] 10.222.0.65 () {58 vars in 958 bytes} [Thu Oct 27 09:53:00 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 09:53:00.897413 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:53:01.044792 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:53:01.637422 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daba73dc-0216-4d6f-aec1-c400e84e37b8 service cinder] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:53:01.795000 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daba73dc-0216-4d6f-aec1-c400e84e37b8 service cinder] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:53:01.814809 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3bb431-977e-4590-9ba0-f73fb37df18d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:53:01.817406 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3bb431-977e-4590-9ba0-f73fb37df18d admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:53:01.834024 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3bb431-977e-4590-9ba0-f73fb37df18d admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:53:01.834904 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3bb431-977e-4590-9ba0-f73fb37df18d admin admin] PATH_INFO: `/v3/users/d8e29f213b9f41c18501072b21da2d33` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:53:01.866507 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3bb431-977e-4590-9ba0-f73fb37df18d admin admin] RBAC: Authorizing `identity:delete_user(user_id=d8e29f213b9f41c18501072b21da2d33)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:53:02.048127 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3bb431-977e-4590-9ba0-f73fb37df18d admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:53:02.115232 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:53:02.265940 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-9c3bb431-977e-4590-9ba0-f73fb37df18d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd8e29f213b9f41c18501072b21da2d33'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:53:02.266663 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-9c3bb431-977e-4590-9ba0-f73fb37df18d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd8e29f213b9f41c18501072b21da2d33'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:53:02.276058 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-9c3bb431-977e-4590-9ba0-f73fb37df18d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd8e29f213b9f41c18501072b21da2d33'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:53:02.276870 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-9c3bb431-977e-4590-9ba0-f73fb37df18d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd8e29f213b9f41c18501072b21da2d33'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:53:02.297109 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-9c3bb431-977e-4590-9ba0-f73fb37df18d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd8e29f213b9f41c18501072b21da2d33'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:53:02.431668 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 719/1434] 10.222.0.65 () {58 vars in 1224 bytes} [Thu Oct 27 09:53:01 2022] DELETE /identity/v3/users/d8e29f213b9f41c18501072b21da2d33 => generated 0 bytes in 795 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 09:53:02.436843 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a46dc90-64cd-4dfd-8dab-f4489cadf0cf None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:53:02.437090 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a46dc90-64cd-4dfd-8dab-f4489cadf0cf None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:53:02.437318 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a46dc90-64cd-4dfd-8dab-f4489cadf0cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:53:02.483806 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-8a46dc90-64cd-4dfd-8dab-f4489cadf0cf None None] MFA Rules not processed for user `b5065084bf664b99bdeac46067cb0f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:53:02.485109 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-8a46dc90-64cd-4dfd-8dab-f4489cadf0cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:53:02.605016 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 716/1435] 10.222.0.65 () {58 vars in 958 bytes} [Thu Oct 27 09:53:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 09:53:02.615673 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3bb431-977e-4590-9ba0-f73fb37df18d admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:53:02.617677 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-9c3bb431-977e-4590-9ba0-f73fb37df18d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:53:02.751997 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3bb431-977e-4590-9ba0-f73fb37df18d admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:53:02.768164 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accad96d-06fa-42ba-95d0-dc683566904e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6191cc41efa74f46b49022cf387f7a4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc2e3a7a1bcc480891c0b433291c00b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:53:02.768804 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accad96d-06fa-42ba-95d0-dc683566904e service neutron] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:53:02.769088 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accad96d-06fa-42ba-95d0-dc683566904e service neutron] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:53:02.769368 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accad96d-06fa-42ba-95d0-dc683566904e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:53:02.792447 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-accad96d-06fa-42ba-95d0-dc683566904e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:53:02.794345 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-accad96d-06fa-42ba-95d0-dc683566904e service neutron] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:53:02.799539 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7466fe5f-d6fa-4ee1-881e-e87886b780df None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:53:02.800506 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7466fe5f-d6fa-4ee1-881e-e87886b780df None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:53:02.800506 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7466fe5f-d6fa-4ee1-881e-e87886b780df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:53:02.806967 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 720/1436] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Oct 27 09:53:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 09:53:02.939527 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-7466fe5f-d6fa-4ee1-881e-e87886b780df None None] MFA Rules not processed for user `c18a92a796934277ad64a51ef3f7bb23`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:53:02.943141 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-7466fe5f-d6fa-4ee1-881e-e87886b780df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:53:03.220895 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 717/1437] 10.222.0.65 () {58 vars in 1009 bytes} [Thu Oct 27 09:53:02 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 423 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 09:53:03.396673 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:53:03.655014 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accad96d-06fa-42ba-95d0-dc683566904e service neutron] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:53:03.656607 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-accad96d-06fa-42ba-95d0-dc683566904e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:53:03.820970 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52609dd2-919a-4362-8c5d-eb32c637fa24 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:53:03.821258 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52609dd2-919a-4362-8c5d-eb32c637fa24 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:53:03.821540 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52609dd2-919a-4362-8c5d-eb32c637fa24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:53:03.859533 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-52609dd2-919a-4362-8c5d-eb32c637fa24 None None] MFA Rules not processed for user `6191cc41efa74f46b49022cf387f7a4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:53:03.865622 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-52609dd2-919a-4362-8c5d-eb32c637fa24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:53:03.882230 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 718/1438] 10.222.0.74 () {58 vars in 1015 bytes} [Thu Oct 27 09:53:03 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 09:53:03.923681 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52609dd2-919a-4362-8c5d-eb32c637fa24 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:53:03.933451 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accad96d-06fa-42ba-95d0-dc683566904e service neutron] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:53:03.938362 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52609dd2-919a-4362-8c5d-eb32c637fa24 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:53:03.955658 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316ef0d0-9a19-4777-b4bf-7bcedbc337b5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6191cc41efa74f46b49022cf387f7a4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc2e3a7a1bcc480891c0b433291c00b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:53:03.956332 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316ef0d0-9a19-4777-b4bf-7bcedbc337b5 service neutron] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:53:03.956621 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316ef0d0-9a19-4777-b4bf-7bcedbc337b5 service neutron] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:53:03.956897 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316ef0d0-9a19-4777-b4bf-7bcedbc337b5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:53:03.959380 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115201fe-a162-4a5f-9f4f-bbe0890ee1bf service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e32fc35c8b467e9604b325cf1527aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc2e3a7a1bcc480891c0b433291c00b1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:53:03.961559 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115201fe-a162-4a5f-9f4f-bbe0890ee1bf service swift] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:53:03.962168 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115201fe-a162-4a5f-9f4f-bbe0890ee1bf service swift] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:53:03.962730 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115201fe-a162-4a5f-9f4f-bbe0890ee1bf service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:53:03.975385 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316ef0d0-9a19-4777-b4bf-7bcedbc337b5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:53:03.978801 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316ef0d0-9a19-4777-b4bf-7bcedbc337b5 service neutron] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:53:04.001738 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115201fe-a162-4a5f-9f4f-bbe0890ee1bf service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:53:04.001924 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 719/1439] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Oct 27 09:53:03 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 09:53:04.007918 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115201fe-a162-4a5f-9f4f-bbe0890ee1bf service swift] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:53:04.026667 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 721/1440] 10.222.0.65 () {60 vars in 1384 bytes} [Thu Oct 27 09:53:03 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 27 09:53:04.735140 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316ef0d0-9a19-4777-b4bf-7bcedbc337b5 service neutron] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:53:04.736764 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-316ef0d0-9a19-4777-b4bf-7bcedbc337b5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:53:04.803882 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316ef0d0-9a19-4777-b4bf-7bcedbc337b5 service neutron] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:53:04.824326 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce1b790-2941-487a-90bc-54d79549dace admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:53:04.828893 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce1b790-2941-487a-90bc-54d79549dace admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:53:04.829282 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce1b790-2941-487a-90bc-54d79549dace admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:53:04.830196 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce1b790-2941-487a-90bc-54d79549dace admin admin] PATH_INFO: `/v3/users/54194ce7dd8e42dd81a870cce4e75343` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:53:04.834156 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce1b790-2941-487a-90bc-54d79549dace admin admin] RBAC: Authorizing `identity:delete_user(user_id=54194ce7dd8e42dd81a870cce4e75343)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:53:04.846701 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce1b790-2941-487a-90bc-54d79549dace admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:53:05.218400 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115201fe-a162-4a5f-9f4f-bbe0890ee1bf service swift] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:53:05.229081 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-115201fe-a162-4a5f-9f4f-bbe0890ee1bf service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:53:05.285816 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115201fe-a162-4a5f-9f4f-bbe0890ee1bf service swift] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:53:05.316139 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1276dcdd-0f6f-4b77-a12f-faf479d0e8c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:53:05.318284 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1276dcdd-0f6f-4b77-a12f-faf479d0e8c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:53:05.318661 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1276dcdd-0f6f-4b77-a12f-faf479d0e8c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:53:05.318947 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1276dcdd-0f6f-4b77-a12f-faf479d0e8c2 admin admin] PATH_INFO: `/v3/projects/330d76695e844c7eb758b04c728587f1` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:53:05.332610 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1276dcdd-0f6f-4b77-a12f-faf479d0e8c2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=330d76695e844c7eb758b04c728587f1)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:53:05.337115 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1276dcdd-0f6f-4b77-a12f-faf479d0e8c2 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:53:05.458901 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-0ce1b790-2941-487a-90bc-54d79549dace admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '54194ce7dd8e42dd81a870cce4e75343'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:53:05.474033 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:53:05.513621 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-0ce1b790-2941-487a-90bc-54d79549dace admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '54194ce7dd8e42dd81a870cce4e75343'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:53:05.518628 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-0ce1b790-2941-487a-90bc-54d79549dace admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '54194ce7dd8e42dd81a870cce4e75343'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:53:05.553757 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-1276dcdd-0f6f-4b77-a12f-faf479d0e8c2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '330d76695e844c7eb758b04c728587f1', 'request_id': 'req-1276dcdd-0f6f-4b77-a12f-faf479d0e8c2'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:53:05.562616 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-0ce1b790-2941-487a-90bc-54d79549dace admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '54194ce7dd8e42dd81a870cce4e75343'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:53:05.595867 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-1276dcdd-0f6f-4b77-a12f-faf479d0e8c2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '330d76695e844c7eb758b04c728587f1', 'request_id': 'req-1276dcdd-0f6f-4b77-a12f-faf479d0e8c2'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:53:05.840347 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-0ce1b790-2941-487a-90bc-54d79549dace admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '54194ce7dd8e42dd81a870cce4e75343'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:53:05.857107 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 720/1441] 10.222.0.65 () {58 vars in 1224 bytes} [Thu Oct 27 09:53:04 2022] DELETE /identity/v3/users/54194ce7dd8e42dd81a870cce4e75343 => generated 0 bytes in 1123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 09:53:05.862092 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d598407f-25a8-400b-be65-a3dd139238f6 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:53:05.862633 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d598407f-25a8-400b-be65-a3dd139238f6 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:53:05.863078 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d598407f-25a8-400b-be65-a3dd139238f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:53:05.907203 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-d598407f-25a8-400b-be65-a3dd139238f6 None None] MFA Rules not processed for user `b5065084bf664b99bdeac46067cb0f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:53:05.908965 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-d598407f-25a8-400b-be65-a3dd139238f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:53:06.006823 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-1276dcdd-0f6f-4b77-a12f-faf479d0e8c2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '330d76695e844c7eb758b04c728587f1', 'request_id': 'req-1276dcdd-0f6f-4b77-a12f-faf479d0e8c2'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:53:06.033799 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-1276dcdd-0f6f-4b77-a12f-faf479d0e8c2 admin admin] The token cache is being invalidate because project 330d76695e844c7eb758b04c728587f1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 09:53:06.041480 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-1276dcdd-0f6f-4b77-a12f-faf479d0e8c2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:53:06.044592 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-1276dcdd-0f6f-4b77-a12f-faf479d0e8c2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:53:06.053105 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 721/1443] 10.222.0.65 () {58 vars in 958 bytes} [Thu Oct 27 09:53:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 09:53:06.056986 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 722/1443] 10.222.0.65 () {58 vars in 1233 bytes} [Thu Oct 27 09:53:05 2022] DELETE /identity/v3/projects/330d76695e844c7eb758b04c728587f1 => generated 0 bytes in 834 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 09:53:06.057283 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d598407f-25a8-400b-be65-a3dd139238f6 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:53:06.058898 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-d598407f-25a8-400b-be65-a3dd139238f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:53:06.083401 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d598407f-25a8-400b-be65-a3dd139238f6 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:53:06.102363 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35194b67-318c-447c-b4ac-b211501dc42d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:53:06.104066 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35194b67-318c-447c-b4ac-b211501dc42d admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:53:06.104995 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35194b67-318c-447c-b4ac-b211501dc42d admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:53:06.105552 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35194b67-318c-447c-b4ac-b211501dc42d admin admin] PATH_INFO: `/v3/users/f57567c858454393a2c81780eeb94977` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:53:06.114127 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35194b67-318c-447c-b4ac-b211501dc42d admin admin] RBAC: Authorizing `identity:delete_user(user_id=f57567c858454393a2c81780eeb94977)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:53:06.121717 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35194b67-318c-447c-b4ac-b211501dc42d admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:53:06.292600 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1276dcdd-0f6f-4b77-a12f-faf479d0e8c2 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:53:06.294288 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-1276dcdd-0f6f-4b77-a12f-faf479d0e8c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:53:06.564781 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1276dcdd-0f6f-4b77-a12f-faf479d0e8c2 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:53:06.747440 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-35194b67-318c-447c-b4ac-b211501dc42d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f57567c858454393a2c81780eeb94977'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:53:06.756088 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84a206b-b09b-48bc-aac0-e3e34223298d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6191cc41efa74f46b49022cf387f7a4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc2e3a7a1bcc480891c0b433291c00b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:53:06.757821 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84a206b-b09b-48bc-aac0-e3e34223298d service neutron] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:53:06.757821 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84a206b-b09b-48bc-aac0-e3e34223298d service neutron] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:53:06.758862 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84a206b-b09b-48bc-aac0-e3e34223298d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:53:06.762852 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-d84a206b-b09b-48bc-aac0-e3e34223298d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:53:06.769302 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-35194b67-318c-447c-b4ac-b211501dc42d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f57567c858454393a2c81780eeb94977'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:53:06.770003 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-35194b67-318c-447c-b4ac-b211501dc42d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f57567c858454393a2c81780eeb94977'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:53:06.781839 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-35194b67-318c-447c-b4ac-b211501dc42d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f57567c858454393a2c81780eeb94977'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:53:06.813702 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84a206b-b09b-48bc-aac0-e3e34223298d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:53:06.815422 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84a206b-b09b-48bc-aac0-e3e34223298d service neutron] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:53:06.830104 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 723/1444] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Oct 27 09:53:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 538 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 09:53:07.006786 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-35194b67-318c-447c-b4ac-b211501dc42d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f57567c858454393a2c81780eeb94977'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:53:07.022270 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 722/1445] 10.222.0.65 () {58 vars in 1224 bytes} [Thu Oct 27 09:53:06 2022] DELETE /identity/v3/users/f57567c858454393a2c81780eeb94977 => generated 0 bytes in 963 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 09:53:07.184391 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:53:07.264079 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:53:08.648949 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:53:08.701463 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5ab5ea-8faa-4157-b5c1-be0be1a3ca01 None None] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:53:08.701463 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5ab5ea-8faa-4157-b5c1-be0be1a3ca01 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:53:08.701463 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5ab5ea-8faa-4157-b5c1-be0be1a3ca01 None None] PATH_INFO: `/` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:53:08.701463 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 724/1446] 10.222.0.65 () {54 vars in 921 bytes} [Thu Oct 27 09:53:08 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 09:53:08.776343 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f992fff9-b346-48ec-82bb-5db443ee29e0 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:53:08.778598 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f992fff9-b346-48ec-82bb-5db443ee29e0 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:53:08.779062 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f992fff9-b346-48ec-82bb-5db443ee29e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:53:08.825448 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-f992fff9-b346-48ec-82bb-5db443ee29e0 None None] MFA Rules not processed for user `fd0d23ef039d4f1591a589d302ef165f`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:53:08.827219 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-f992fff9-b346-48ec-82bb-5db443ee29e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:53:09.037069 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 723/1447] 10.222.0.65 () {58 vars in 1018 bytes} [Thu Oct 27 09:53:08 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 09:53:09.053408 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5ab5ea-8faa-4157-b5c1-be0be1a3ca01 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:53:09.058697 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-7e5ab5ea-8faa-4157-b5c1-be0be1a3ca01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:53:09.088204 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f992fff9-b346-48ec-82bb-5db443ee29e0 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:53:09.091001 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-f992fff9-b346-48ec-82bb-5db443ee29e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:53:09.122128 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5ab5ea-8faa-4157-b5c1-be0be1a3ca01 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:53:09.130957 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d098f8-24d1-4b57-a13e-2274fdecca4d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd0d23ef039d4f1591a589d302ef165f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc2e3a7a1bcc480891c0b433291c00b1', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:53:09.135863 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d098f8-24d1-4b57-a13e-2274fdecca4d service nova] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:53:09.135863 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d098f8-24d1-4b57-a13e-2274fdecca4d service nova] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:53:09.135863 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d098f8-24d1-4b57-a13e-2274fdecca4d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:53:09.153959 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d098f8-24d1-4b57-a13e-2274fdecca4d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:53:09.157192 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d098f8-24d1-4b57-a13e-2274fdecca4d service nova] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:53:09.215474 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 725/1448] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Oct 27 09:53:09 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 09:53:09.310442 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f992fff9-b346-48ec-82bb-5db443ee29e0 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:53:09.332324 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6178af9-c95b-4ca1-9dc9-07eddf6d17dd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8e5d5f04c4741bb86ca4a0f667d4ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc2e3a7a1bcc480891c0b433291c00b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:53:09.335335 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6178af9-c95b-4ca1-9dc9-07eddf6d17dd service cinder] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:53:09.335974 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6178af9-c95b-4ca1-9dc9-07eddf6d17dd service cinder] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:53:09.337018 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6178af9-c95b-4ca1-9dc9-07eddf6d17dd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:53:09.341019 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-b6178af9-c95b-4ca1-9dc9-07eddf6d17dd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:53:09.525837 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6178af9-c95b-4ca1-9dc9-07eddf6d17dd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:53:09.527604 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6178af9-c95b-4ca1-9dc9-07eddf6d17dd service cinder] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:53:09.562815 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 724/1449] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Oct 27 09:53:09 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 475 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 09:53:10.561537 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d098f8-24d1-4b57-a13e-2274fdecca4d service nova] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:53:10.563831 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-06d098f8-24d1-4b57-a13e-2274fdecca4d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:53:10.768844 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d098f8-24d1-4b57-a13e-2274fdecca4d service nova] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:53:10.786143 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53251808-c7c6-463a-9994-a95a3fd4e3a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:53:10.787110 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53251808-c7c6-463a-9994-a95a3fd4e3a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:53:10.787555 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53251808-c7c6-463a-9994-a95a3fd4e3a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:53:10.788589 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53251808-c7c6-463a-9994-a95a3fd4e3a4 admin admin] PATH_INFO: `/v3/projects/4088ce8eae0742e385558d32bf3d7664` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:53:10.790220 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53251808-c7c6-463a-9994-a95a3fd4e3a4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4088ce8eae0742e385558d32bf3d7664)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:53:10.792410 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53251808-c7c6-463a-9994-a95a3fd4e3a4 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:53:11.206978 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-53251808-c7c6-463a-9994-a95a3fd4e3a4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4088ce8eae0742e385558d32bf3d7664', 'request_id': 'req-53251808-c7c6-463a-9994-a95a3fd4e3a4'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:53:11.229889 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-53251808-c7c6-463a-9994-a95a3fd4e3a4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4088ce8eae0742e385558d32bf3d7664', 'request_id': 'req-53251808-c7c6-463a-9994-a95a3fd4e3a4'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:53:11.404593 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-53251808-c7c6-463a-9994-a95a3fd4e3a4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4088ce8eae0742e385558d32bf3d7664', 'request_id': 'req-53251808-c7c6-463a-9994-a95a3fd4e3a4'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:53:11.422557 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6178af9-c95b-4ca1-9dc9-07eddf6d17dd service cinder] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:53:11.425861 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-b6178af9-c95b-4ca1-9dc9-07eddf6d17dd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:53:11.426096 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-53251808-c7c6-463a-9994-a95a3fd4e3a4 admin admin] The token cache is being invalidate because project 4088ce8eae0742e385558d32bf3d7664 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 09:53:11.426896 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-53251808-c7c6-463a-9994-a95a3fd4e3a4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:53:11.431936 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-53251808-c7c6-463a-9994-a95a3fd4e3a4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:53:11.443483 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6178af9-c95b-4ca1-9dc9-07eddf6d17dd service cinder] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:53:11.450282 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 726/1450] 10.222.0.65 () {58 vars in 1233 bytes} [Thu Oct 27 09:53:10 2022] DELETE /identity/v3/projects/4088ce8eae0742e385558d32bf3d7664 => generated 0 bytes in 889 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 09:53:11.456803 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00e6f2b-29d9-4312-a413-75d666e5ef9b None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:53:11.484289 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00e6f2b-29d9-4312-a413-75d666e5ef9b None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:53:11.484289 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00e6f2b-29d9-4312-a413-75d666e5ef9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:53:11.519963 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-b00e6f2b-29d9-4312-a413-75d666e5ef9b None None] MFA Rules not processed for user `b5065084bf664b99bdeac46067cb0f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:53:11.521331 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-b00e6f2b-29d9-4312-a413-75d666e5ef9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:53:11.547709 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83aca407-e28b-49ec-9d96-0742902e3134 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:53:11.548573 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83aca407-e28b-49ec-9d96-0742902e3134 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:53:11.548972 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83aca407-e28b-49ec-9d96-0742902e3134 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:53:11.549487 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83aca407-e28b-49ec-9d96-0742902e3134 admin admin] PATH_INFO: `/v3/projects/1893ef8ed9354c319f1262483925b245` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:53:11.555243 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83aca407-e28b-49ec-9d96-0742902e3134 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1893ef8ed9354c319f1262483925b245)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:53:11.561269 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:53:11.563387 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83aca407-e28b-49ec-9d96-0742902e3134 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:53:11.740760 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:53:11.767377 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 727/1451] 10.222.0.65 () {58 vars in 958 bytes} [Thu Oct 27 09:53:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 09:53:11.787465 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7920fc-cd5b-4e6d-ae1f-a140d4e756bb None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:53:11.790459 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7920fc-cd5b-4e6d-ae1f-a140d4e756bb None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:53:11.791037 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7920fc-cd5b-4e6d-ae1f-a140d4e756bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:53:11.791676 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-83aca407-e28b-49ec-9d96-0742902e3134 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1893ef8ed9354c319f1262483925b245', 'request_id': 'req-83aca407-e28b-49ec-9d96-0742902e3134'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:53:11.899684 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-6c7920fc-cd5b-4e6d-ae1f-a140d4e756bb None None] MFA Rules not processed for user `b5065084bf664b99bdeac46067cb0f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:53:11.901122 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-6c7920fc-cd5b-4e6d-ae1f-a140d4e756bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:53:12.018011 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-83aca407-e28b-49ec-9d96-0742902e3134 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1893ef8ed9354c319f1262483925b245', 'request_id': 'req-83aca407-e28b-49ec-9d96-0742902e3134'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:53:12.027418 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-83aca407-e28b-49ec-9d96-0742902e3134 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1893ef8ed9354c319f1262483925b245', 'request_id': 'req-83aca407-e28b-49ec-9d96-0742902e3134'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:53:12.051221 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-83aca407-e28b-49ec-9d96-0742902e3134 admin admin] The token cache is being invalidate because project 1893ef8ed9354c319f1262483925b245 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 09:53:12.051529 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-83aca407-e28b-49ec-9d96-0742902e3134 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:53:12.052414 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-83aca407-e28b-49ec-9d96-0742902e3134 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:53:12.060330 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 725/1452] 10.222.0.65 () {58 vars in 1233 bytes} [Thu Oct 27 09:53:11 2022] DELETE /identity/v3/projects/1893ef8ed9354c319f1262483925b245 => generated 0 bytes in 634 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 09:53:12.061464 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83aca407-e28b-49ec-9d96-0742902e3134 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:53:12.068494 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-83aca407-e28b-49ec-9d96-0742902e3134 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:53:12.122139 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 728/1453] 10.222.0.65 () {58 vars in 958 bytes} [Thu Oct 27 09:53:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 339 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 09:53:12.126663 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7920fc-cd5b-4e6d-ae1f-a140d4e756bb None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:53:12.146193 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7920fc-cd5b-4e6d-ae1f-a140d4e756bb None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:53:12.156742 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4c2501-639e-4b2e-a78f-d4b378ab4f51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:53:12.157759 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4c2501-639e-4b2e-a78f-d4b378ab4f51 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:53:12.158032 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4c2501-639e-4b2e-a78f-d4b378ab4f51 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:53:12.158314 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4c2501-639e-4b2e-a78f-d4b378ab4f51 admin admin] PATH_INFO: `/v3/domains` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:53:12.159051 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4c2501-639e-4b2e-a78f-d4b378ab4f51 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 09:53:12.159957 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4c2501-639e-4b2e-a78f-d4b378ab4f51 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:53:12.161719 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4c2501-639e-4b2e-a78f-d4b378ab4f51 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:53:12.188552 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 729/1454] 10.222.0.65 () {58 vars in 1153 bytes} [Thu Oct 27 09:53:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 09:53:12.189728 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4c2501-639e-4b2e-a78f-d4b378ab4f51 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:53:12.235581 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4c2501-639e-4b2e-a78f-d4b378ab4f51 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:53:12.246575 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83aca407-e28b-49ec-9d96-0742902e3134 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:53:12.250111 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf14a06-0a6b-4576-a927-770c667ac94e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:53:12.252116 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf14a06-0a6b-4576-a927-770c667ac94e admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:53:12.253137 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf14a06-0a6b-4576-a927-770c667ac94e admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:53:12.253426 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf14a06-0a6b-4576-a927-770c667ac94e admin admin] PATH_INFO: `/v3/projects` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:53:12.254090 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf14a06-0a6b-4576-a927-770c667ac94e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:53:12.256094 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf14a06-0a6b-4576-a927-770c667ac94e admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:53:12.271973 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60726278-c51a-46be-9487-2fc87f5dd072 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:53:12.275421 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60726278-c51a-46be-9487-2fc87f5dd072 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:53:12.276029 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60726278-c51a-46be-9487-2fc87f5dd072 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:53:12.279200 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60726278-c51a-46be-9487-2fc87f5dd072 admin admin] PATH_INFO: `/v3/users/e381a4bdc9e14d1d8e96d5588d6ef05f` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:53:12.283618 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60726278-c51a-46be-9487-2fc87f5dd072 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e381a4bdc9e14d1d8e96d5588d6ef05f)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:53:12.288732 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60726278-c51a-46be-9487-2fc87f5dd072 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:53:12.734029 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 730/1455] 10.222.0.65 () {60 vars in 1153 bytes} [Thu Oct 27 09:53:12 2022] POST /identity/v3/projects => generated 379 bytes in 542 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 09:53:12.735840 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf14a06-0a6b-4576-a927-770c667ac94e admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:53:12.854176 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-60726278-c51a-46be-9487-2fc87f5dd072 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e381a4bdc9e14d1d8e96d5588d6ef05f'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:53:12.911936 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf14a06-0a6b-4576-a927-770c667ac94e admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:53:12.918573 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-60726278-c51a-46be-9487-2fc87f5dd072 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e381a4bdc9e14d1d8e96d5588d6ef05f'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:53:12.926230 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-60726278-c51a-46be-9487-2fc87f5dd072 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e381a4bdc9e14d1d8e96d5588d6ef05f'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:53:12.935467 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f0db47-746e-45b6-9bd1-be956348f387 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:53:12.936103 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f0db47-746e-45b6-9bd1-be956348f387 admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:53:12.936390 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f0db47-746e-45b6-9bd1-be956348f387 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:53:12.936666 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f0db47-746e-45b6-9bd1-be956348f387 admin admin] PATH_INFO: `/v3/users` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:53:12.937312 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f0db47-746e-45b6-9bd1-be956348f387 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:53:12.950309 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f0db47-746e-45b6-9bd1-be956348f387 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:53:12.965580 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-60726278-c51a-46be-9487-2fc87f5dd072 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e381a4bdc9e14d1d8e96d5588d6ef05f'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:53:13.298459 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-60726278-c51a-46be-9487-2fc87f5dd072 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e381a4bdc9e14d1d8e96d5588d6ef05f'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:53:13.308854 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 726/1456] 10.222.0.65 () {58 vars in 1224 bytes} [Thu Oct 27 09:53:12 2022] DELETE /identity/v3/users/e381a4bdc9e14d1d8e96d5588d6ef05f => generated 0 bytes in 1245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 09:53:13.335366 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 731/1457] 10.222.0.65 () {60 vars in 1144 bytes} [Thu Oct 27 09:53:12 2022] POST /identity/v3/users => generated 290 bytes in 593 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 09:53:13.342573 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60726278-c51a-46be-9487-2fc87f5dd072 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:53:13.344713 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-60726278-c51a-46be-9487-2fc87f5dd072 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:53:13.568153 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60726278-c51a-46be-9487-2fc87f5dd072 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:53:13.612190 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a824e4-4cd3-4128-a19e-3fa1fee29867 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:53:13.614071 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a824e4-4cd3-4128-a19e-3fa1fee29867 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:53:13.617039 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a824e4-4cd3-4128-a19e-3fa1fee29867 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:53:13.621479 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a824e4-4cd3-4128-a19e-3fa1fee29867 admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:53:13.621479 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a824e4-4cd3-4128-a19e-3fa1fee29867 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:53:13.623051 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a824e4-4cd3-4128-a19e-3fa1fee29867 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:53:13.668428 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f0db47-746e-45b6-9bd1-be956348f387 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:53:13.670847 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 727/1458] 10.222.0.65 () {58 vars in 1122 bytes} [Thu Oct 27 09:53:13 2022] GET /identity/v3/roles => generated 1420 bytes in 332 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 09:53:13.684318 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f0db47-746e-45b6-9bd1-be956348f387 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:53:13.814742 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4fae36-a59a-489a-96ee-e80f40ac1e4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:53:13.814742 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4fae36-a59a-489a-96ee-e80f40ac1e4d admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:53:13.814742 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4fae36-a59a-489a-96ee-e80f40ac1e4d admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:53:13.814742 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4fae36-a59a-489a-96ee-e80f40ac1e4d admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:53:13.816286 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4fae36-a59a-489a-96ee-e80f40ac1e4d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:53:13.816286 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4fae36-a59a-489a-96ee-e80f40ac1e4d admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:53:13.816286 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 732/1459] 10.222.0.65 () {58 vars in 1122 bytes} [Thu Oct 27 09:53:13 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 09:53:13.821532 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a824e4-4cd3-4128-a19e-3fa1fee29867 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:53:13.899059 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a824e4-4cd3-4128-a19e-3fa1fee29867 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:53:13.919530 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b682469-e7f9-44f9-aa4c-efb970fc6271 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:53:13.920396 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b682469-e7f9-44f9-aa4c-efb970fc6271 admin admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:53:13.920889 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b682469-e7f9-44f9-aa4c-efb970fc6271 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:53:13.921337 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b682469-e7f9-44f9-aa4c-efb970fc6271 admin admin] PATH_INFO: `/v3/projects/91794938d60f4e52ac383fd5bf020689/users/56d2090849ed450faebac65548c7d0be/roles/43543ce1450245af9661cb017bac17bd` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:53:13.946734 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b682469-e7f9-44f9-aa4c-efb970fc6271 admin admin] RBAC: Authorizing `identity:create_grant(project_id=91794938d60f4e52ac383fd5bf020689, user_id=56d2090849ed450faebac65548c7d0be, role_id=43543ce1450245af9661cb017bac17bd)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:53:13.951188 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b682469-e7f9-44f9-aa4c-efb970fc6271 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:53:14.093498 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 728/1460] 10.222.0.65 () {60 vars in 1483 bytes} [Thu Oct 27 09:53:13 2022] PUT /identity/v3/projects/91794938d60f4e52ac383fd5bf020689/users/56d2090849ed450faebac65548c7d0be/roles/43543ce1450245af9661cb017bac17bd => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 09:53:14.108645 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d795af-16d8-46c5-b73d-6f727082bbc3 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:53:14.109273 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d795af-16d8-46c5-b73d-6f727082bbc3 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:53:14.109273 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d795af-16d8-46c5-b73d-6f727082bbc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:53:14.184030 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-b1d795af-16d8-46c5-b73d-6f727082bbc3 None None] MFA Rules not processed for user `56d2090849ed450faebac65548c7d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:53:14.185614 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-b1d795af-16d8-46c5-b73d-6f727082bbc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:53:14.442470 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b682469-e7f9-44f9-aa4c-efb970fc6271 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:53:14.455534 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 733/1461] 10.222.0.65 () {58 vars in 958 bytes} [Thu Oct 27 09:53:14 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 348 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 09:53:14.578004 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b682469-e7f9-44f9-aa4c-efb970fc6271 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:53:14.588266 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2524d2cc-132d-45ff-b48e-bde6bccd4adf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:53:14.591352 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2524d2cc-132d-45ff-b48e-bde6bccd4adf admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:53:14.592887 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2524d2cc-132d-45ff-b48e-bde6bccd4adf admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:53:14.593719 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2524d2cc-132d-45ff-b48e-bde6bccd4adf admin admin] PATH_INFO: `/v3/projects` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:53:14.596101 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2524d2cc-132d-45ff-b48e-bde6bccd4adf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:53:14.607908 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2524d2cc-132d-45ff-b48e-bde6bccd4adf admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:53:14.784996 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 729/1462] 10.222.0.65 () {60 vars in 1153 bytes} [Thu Oct 27 09:53:14 2022] POST /identity/v3/projects => generated 379 bytes in 343 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 09:53:14.787822 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d795af-16d8-46c5-b73d-6f727082bbc3 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:53:14.805217 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d795af-16d8-46c5-b73d-6f727082bbc3 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:53:14.888418 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1693cd83-b089-4ad2-8016-44e56ca78eb8 None None] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:53:14.889507 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1693cd83-b089-4ad2-8016-44e56ca78eb8 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:53:14.889507 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1693cd83-b089-4ad2-8016-44e56ca78eb8 None None] PATH_INFO: `/` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:53:14.891773 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 730/1463] 10.222.0.65 () {54 vars in 921 bytes} [Thu Oct 27 09:53:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 09:53:14.915179 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54193ca4-0de0-4b00-8759-377301950184 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:53:14.918290 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54193ca4-0de0-4b00-8759-377301950184 admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:53:14.918290 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54193ca4-0de0-4b00-8759-377301950184 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:53:14.918290 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54193ca4-0de0-4b00-8759-377301950184 admin admin] PATH_INFO: `/v3/users` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:53:14.918290 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54193ca4-0de0-4b00-8759-377301950184 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:53:14.918679 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f588231e-1ff9-4246-8f55-5444d754dc6a None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:53:14.918679 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f588231e-1ff9-4246-8f55-5444d754dc6a None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:53:14.919512 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f588231e-1ff9-4246-8f55-5444d754dc6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:53:14.919591 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54193ca4-0de0-4b00-8759-377301950184 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:53:14.961731 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-f588231e-1ff9-4246-8f55-5444d754dc6a None None] MFA Rules not processed for user `fd0d23ef039d4f1591a589d302ef165f`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:53:14.973812 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-f588231e-1ff9-4246-8f55-5444d754dc6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:53:15.030635 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 734/1464] 10.222.0.65 () {60 vars in 1144 bytes} [Thu Oct 27 09:53:14 2022] POST /identity/v3/users => generated 296 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 09:53:15.032429 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54193ca4-0de0-4b00-8759-377301950184 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:53:15.073012 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54193ca4-0de0-4b00-8759-377301950184 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:53:15.085707 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a4c86a-20e6-4f59-ba2c-2711a678e609 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:53:15.141155 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a4c86a-20e6-4f59-ba2c-2711a678e609 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:53:15.141155 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a4c86a-20e6-4f59-ba2c-2711a678e609 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:53:15.141155 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a4c86a-20e6-4f59-ba2c-2711a678e609 admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:53:15.141155 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a4c86a-20e6-4f59-ba2c-2711a678e609 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:53:15.141155 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a4c86a-20e6-4f59-ba2c-2711a678e609 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:53:15.141155 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 735/1465] 10.222.0.65 () {58 vars in 1122 bytes} [Thu Oct 27 09:53:15 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 09:53:15.145250 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 731/1466] 10.222.0.65 () {58 vars in 1018 bytes} [Thu Oct 27 09:53:14 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 09:53:15.154198 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a4c86a-20e6-4f59-ba2c-2711a678e609 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:53:15.177352 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a4c86a-20e6-4f59-ba2c-2711a678e609 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:53:15.188234 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420250b0-336d-4b40-86d8-d0b5629208eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:53:15.189168 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420250b0-336d-4b40-86d8-d0b5629208eb admin admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:53:15.189638 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420250b0-336d-4b40-86d8-d0b5629208eb admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:53:15.191022 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420250b0-336d-4b40-86d8-d0b5629208eb admin admin] PATH_INFO: `/v3/projects/5274e21e722447c1a72899a26fbc9e84/users/78288002d1924fce9e183a43add42224/roles/6ad17b9f9dea4b66ab2da3677d7e715d` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:53:15.234240 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420250b0-336d-4b40-86d8-d0b5629208eb admin admin] RBAC: Authorizing `identity:create_grant(project_id=5274e21e722447c1a72899a26fbc9e84, user_id=78288002d1924fce9e183a43add42224, role_id=6ad17b9f9dea4b66ab2da3677d7e715d)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:53:15.238155 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420250b0-336d-4b40-86d8-d0b5629208eb admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:53:15.406451 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 736/1467] 10.222.0.65 () {60 vars in 1483 bytes} [Thu Oct 27 09:53:15 2022] PUT /identity/v3/projects/5274e21e722447c1a72899a26fbc9e84/users/78288002d1924fce9e183a43add42224/roles/6ad17b9f9dea4b66ab2da3677d7e715d => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 09:53:15.407834 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f588231e-1ff9-4246-8f55-5444d754dc6a None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:53:15.478892 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420250b0-336d-4b40-86d8-d0b5629208eb admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:53:15.480812 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-420250b0-336d-4b40-86d8-d0b5629208eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:53:15.501315 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f588231e-1ff9-4246-8f55-5444d754dc6a None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:53:15.726903 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab020f4c-884e-4eb7-8ba2-cd904f358b6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:53:15.727712 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab020f4c-884e-4eb7-8ba2-cd904f358b6f admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:53:15.728094 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab020f4c-884e-4eb7-8ba2-cd904f358b6f admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:53:15.728686 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab020f4c-884e-4eb7-8ba2-cd904f358b6f admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:53:15.729758 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab020f4c-884e-4eb7-8ba2-cd904f358b6f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:53:15.732397 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab020f4c-884e-4eb7-8ba2-cd904f358b6f admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:53:15.748626 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 732/1468] 10.222.0.65 () {58 vars in 1122 bytes} [Thu Oct 27 09:53:15 2022] GET /identity/v3/roles => generated 1420 bytes in 342 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 09:53:15.757128 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab020f4c-884e-4eb7-8ba2-cd904f358b6f admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:53:15.774110 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420250b0-336d-4b40-86d8-d0b5629208eb admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:53:15.791401 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab020f4c-884e-4eb7-8ba2-cd904f358b6f admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:53:15.795750 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b00f424-28d9-482d-a364-4346882d7505 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd0d23ef039d4f1591a589d302ef165f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc2e3a7a1bcc480891c0b433291c00b1', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:53:15.796384 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b00f424-28d9-482d-a364-4346882d7505 service nova] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:53:15.796671 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b00f424-28d9-482d-a364-4346882d7505 service nova] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:53:15.796951 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b00f424-28d9-482d-a364-4346882d7505 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:53:15.806446 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2858c935-934d-44e3-b72a-7a92b06a20d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:53:15.809000 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2858c935-934d-44e3-b72a-7a92b06a20d1 admin admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:53:15.809309 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2858c935-934d-44e3-b72a-7a92b06a20d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:53:15.809595 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2858c935-934d-44e3-b72a-7a92b06a20d1 admin admin] PATH_INFO: `/v3/projects/5274e21e722447c1a72899a26fbc9e84/users/78288002d1924fce9e183a43add42224/roles/6ad17b9f9dea4b66ab2da3677d7e715d` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:53:15.814665 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2858c935-934d-44e3-b72a-7a92b06a20d1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5274e21e722447c1a72899a26fbc9e84, user_id=78288002d1924fce9e183a43add42224, role_id=6ad17b9f9dea4b66ab2da3677d7e715d)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:53:15.823070 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2858c935-934d-44e3-b72a-7a92b06a20d1 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:53:15.831015 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b00f424-28d9-482d-a364-4346882d7505 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:53:15.831015 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b00f424-28d9-482d-a364-4346882d7505 service nova] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:53:15.867501 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 733/1469] 10.222.0.65 () {60 vars in 1483 bytes} [Thu Oct 27 09:53:15 2022] PUT /identity/v3/projects/5274e21e722447c1a72899a26fbc9e84/users/78288002d1924fce9e183a43add42224/roles/6ad17b9f9dea4b66ab2da3677d7e715d => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 09:53:15.881013 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 737/1470] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Oct 27 09:53:15 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 09:53:15.894805 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9327e8-49a0-4e6e-9041-2135779b2cd8 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:53:15.895601 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9327e8-49a0-4e6e-9041-2135779b2cd8 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:53:15.895601 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9327e8-49a0-4e6e-9041-2135779b2cd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:53:15.991843 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-ef9327e8-49a0-4e6e-9041-2135779b2cd8 None None] MFA Rules not processed for user `78288002d1924fce9e183a43add42224`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:53:15.993088 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-ef9327e8-49a0-4e6e-9041-2135779b2cd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:53:16.150091 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 734/1471] 10.222.0.65 () {58 vars in 958 bytes} [Thu Oct 27 09:53:15 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 09:53:16.286809 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b00f424-28d9-482d-a364-4346882d7505 service nova] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:53:16.286809 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-2b00f424-28d9-482d-a364-4346882d7505 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:53:16.353914 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b00f424-28d9-482d-a364-4346882d7505 service nova] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:53:16.448623 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7ccd62-9013-4b62-bb09-7518bd0d009e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:53:16.462902 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7ccd62-9013-4b62-bb09-7518bd0d009e admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:53:16.462902 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7ccd62-9013-4b62-bb09-7518bd0d009e admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:53:16.462902 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7ccd62-9013-4b62-bb09-7518bd0d009e admin admin] PATH_INFO: `/v3/projects/44b2ccf81b644f4bb07b9141d2d67686` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:53:16.462902 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7ccd62-9013-4b62-bb09-7518bd0d009e admin admin] RBAC: Authorizing `identity:delete_project(project_id=44b2ccf81b644f4bb07b9141d2d67686)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:53:16.462902 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7ccd62-9013-4b62-bb09-7518bd0d009e admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:53:16.647940 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-bf7ccd62-9013-4b62-bb09-7518bd0d009e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '44b2ccf81b644f4bb07b9141d2d67686', 'request_id': 'req-bf7ccd62-9013-4b62-bb09-7518bd0d009e'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:53:16.664427 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-bf7ccd62-9013-4b62-bb09-7518bd0d009e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '44b2ccf81b644f4bb07b9141d2d67686', 'request_id': 'req-bf7ccd62-9013-4b62-bb09-7518bd0d009e'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:53:16.795106 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-bf7ccd62-9013-4b62-bb09-7518bd0d009e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '44b2ccf81b644f4bb07b9141d2d67686', 'request_id': 'req-bf7ccd62-9013-4b62-bb09-7518bd0d009e'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:53:16.869401 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-bf7ccd62-9013-4b62-bb09-7518bd0d009e admin admin] The token cache is being invalidate because project 44b2ccf81b644f4bb07b9141d2d67686 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 09:53:16.870484 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-bf7ccd62-9013-4b62-bb09-7518bd0d009e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:53:16.872170 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-bf7ccd62-9013-4b62-bb09-7518bd0d009e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:53:16.876403 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 738/1472] 10.222.0.65 () {58 vars in 1233 bytes} [Thu Oct 27 09:53:16 2022] DELETE /identity/v3/projects/44b2ccf81b644f4bb07b9141d2d67686 => generated 0 bytes in 595 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 09:53:16.881839 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5deede27-baaa-4097-82ac-2b4eeb822719 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:53:16.882181 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5deede27-baaa-4097-82ac-2b4eeb822719 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:53:16.882463 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5deede27-baaa-4097-82ac-2b4eeb822719 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:53:16.914922 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-5deede27-baaa-4097-82ac-2b4eeb822719 None None] MFA Rules not processed for user `b5065084bf664b99bdeac46067cb0f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:53:16.922554 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-5deede27-baaa-4097-82ac-2b4eeb822719 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:53:17.086820 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 735/1473] 10.222.0.65 () {58 vars in 958 bytes} [Thu Oct 27 09:53:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 09:53:17.097113 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdd6e86-2984-4027-a895-79a355015fa6 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:53:17.097930 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdd6e86-2984-4027-a895-79a355015fa6 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:53:17.098420 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdd6e86-2984-4027-a895-79a355015fa6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:53:17.152474 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-4cdd6e86-2984-4027-a895-79a355015fa6 None None] MFA Rules not processed for user `b5065084bf664b99bdeac46067cb0f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:53:17.154640 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-4cdd6e86-2984-4027-a895-79a355015fa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:53:17.169580 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 739/1474] 10.222.0.65 () {58 vars in 958 bytes} [Thu Oct 27 09:53:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 09:53:17.173577 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5deede27-baaa-4097-82ac-2b4eeb822719 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:53:17.188241 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5deede27-baaa-4097-82ac-2b4eeb822719 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:53:17.195614 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba164e0-f454-4810-91a2-1f6fb5b0c77f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:53:17.196772 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba164e0-f454-4810-91a2-1f6fb5b0c77f admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:53:17.197304 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba164e0-f454-4810-91a2-1f6fb5b0c77f admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:53:17.197969 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba164e0-f454-4810-91a2-1f6fb5b0c77f admin admin] PATH_INFO: `/v3/domains` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:53:17.199258 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba164e0-f454-4810-91a2-1f6fb5b0c77f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 09:53:17.200282 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba164e0-f454-4810-91a2-1f6fb5b0c77f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:53:17.202632 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba164e0-f454-4810-91a2-1f6fb5b0c77f admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:53:17.223234 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 736/1475] 10.222.0.65 () {58 vars in 1153 bytes} [Thu Oct 27 09:53:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 09:53:17.228101 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdd6e86-2984-4027-a895-79a355015fa6 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:53:17.238899 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdd6e86-2984-4027-a895-79a355015fa6 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:53:17.247097 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b0956c-77ec-44f7-9f57-7aa8beeeb7e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:53:17.248250 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b0956c-77ec-44f7-9f57-7aa8beeeb7e1 admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:53:17.248788 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b0956c-77ec-44f7-9f57-7aa8beeeb7e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:53:17.249418 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b0956c-77ec-44f7-9f57-7aa8beeeb7e1 admin admin] PATH_INFO: `/v3/projects` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:53:17.250586 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b0956c-77ec-44f7-9f57-7aa8beeeb7e1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:53:17.254587 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b0956c-77ec-44f7-9f57-7aa8beeeb7e1 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:53:17.380357 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 740/1476] 10.222.0.65 () {60 vars in 1153 bytes} [Thu Oct 27 09:53:17 2022] POST /identity/v3/projects => generated 385 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 09:53:17.385962 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba164e0-f454-4810-91a2-1f6fb5b0c77f admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:53:17.408656 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba164e0-f454-4810-91a2-1f6fb5b0c77f admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:53:17.526700 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9950718-c8d4-48a4-b84f-b5b46d9f2c41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:53:17.527474 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9950718-c8d4-48a4-b84f-b5b46d9f2c41 admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:53:17.527761 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9950718-c8d4-48a4-b84f-b5b46d9f2c41 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:53:17.529212 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9950718-c8d4-48a4-b84f-b5b46d9f2c41 admin admin] PATH_INFO: `/v3/users` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:53:17.529935 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9950718-c8d4-48a4-b84f-b5b46d9f2c41 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:53:17.532579 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9950718-c8d4-48a4-b84f-b5b46d9f2c41 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:53:17.665709 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 737/1477] 10.222.0.65 () {60 vars in 1144 bytes} [Thu Oct 27 09:53:17 2022] POST /identity/v3/users => generated 293 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 09:53:17.669025 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b0956c-77ec-44f7-9f57-7aa8beeeb7e1 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:53:17.685646 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b0956c-77ec-44f7-9f57-7aa8beeeb7e1 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:53:17.697212 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b94aff-ade3-4e8f-9217-9dd6cade8222 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:53:17.704792 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b94aff-ade3-4e8f-9217-9dd6cade8222 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:53:17.704792 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b94aff-ade3-4e8f-9217-9dd6cade8222 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:53:17.704792 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b94aff-ade3-4e8f-9217-9dd6cade8222 admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:53:17.704792 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b94aff-ade3-4e8f-9217-9dd6cade8222 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:53:17.704792 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b94aff-ade3-4e8f-9217-9dd6cade8222 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:53:17.712323 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 741/1478] 10.222.0.65 () {58 vars in 1122 bytes} [Thu Oct 27 09:53:17 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 09:53:17.716218 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9950718-c8d4-48a4-b84f-b5b46d9f2c41 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:53:17.746624 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9950718-c8d4-48a4-b84f-b5b46d9f2c41 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:53:17.753487 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee8c2fd-15a7-4d25-bb6e-3f3adee915e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:53:17.754557 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee8c2fd-15a7-4d25-bb6e-3f3adee915e0 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:53:17.754557 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee8c2fd-15a7-4d25-bb6e-3f3adee915e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:53:17.757293 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee8c2fd-15a7-4d25-bb6e-3f3adee915e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:53:17.760298 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee8c2fd-15a7-4d25-bb6e-3f3adee915e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:53:17.763370 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee8c2fd-15a7-4d25-bb6e-3f3adee915e0 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:53:17.781710 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 738/1479] 10.222.0.65 () {58 vars in 1122 bytes} [Thu Oct 27 09:53:17 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 09:53:17.783742 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b94aff-ade3-4e8f-9217-9dd6cade8222 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:53:17.796516 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b94aff-ade3-4e8f-9217-9dd6cade8222 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:53:17.822341 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128120b9-fd29-48df-89b2-4efd62156e24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:53:17.823583 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128120b9-fd29-48df-89b2-4efd62156e24 admin admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:53:17.824557 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128120b9-fd29-48df-89b2-4efd62156e24 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:53:17.825117 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128120b9-fd29-48df-89b2-4efd62156e24 admin admin] PATH_INFO: `/v3/projects/e175c6ec10b644fb9086ee5737cce18b/users/e15c24a4572b41bda25f73d7dae2bc2d/roles/43543ce1450245af9661cb017bac17bd` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:53:17.926695 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee8c2fd-15a7-4d25-bb6e-3f3adee915e0 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:53:17.929294 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-5ee8c2fd-15a7-4d25-bb6e-3f3adee915e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:53:18.037736 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128120b9-fd29-48df-89b2-4efd62156e24 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e175c6ec10b644fb9086ee5737cce18b, user_id=e15c24a4572b41bda25f73d7dae2bc2d, role_id=43543ce1450245af9661cb017bac17bd)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:53:18.056197 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128120b9-fd29-48df-89b2-4efd62156e24 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:53:18.058228 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee8c2fd-15a7-4d25-bb6e-3f3adee915e0 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:53:18.067367 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a19692-fa2b-4091-8c45-d72f0fe55f98 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8e5d5f04c4741bb86ca4a0f667d4ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc2e3a7a1bcc480891c0b433291c00b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:53:18.068330 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a19692-fa2b-4091-8c45-d72f0fe55f98 service cinder] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:53:18.068835 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a19692-fa2b-4091-8c45-d72f0fe55f98 service cinder] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:53:18.069287 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a19692-fa2b-4091-8c45-d72f0fe55f98 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:53:18.071538 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-e1a19692-fa2b-4091-8c45-d72f0fe55f98 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:53:18.158434 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a19692-fa2b-4091-8c45-d72f0fe55f98 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:53:18.160013 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a19692-fa2b-4091-8c45-d72f0fe55f98 service cinder] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:53:18.171712 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 739/1480] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Oct 27 09:53:17 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 09:53:18.172874 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a19692-fa2b-4091-8c45-d72f0fe55f98 service cinder] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:53:18.174296 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-e1a19692-fa2b-4091-8c45-d72f0fe55f98 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:53:18.187886 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a19692-fa2b-4091-8c45-d72f0fe55f98 service cinder] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:53:18.193987 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad147842-3889-4233-9dce-86cb0fdb86ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:53:18.195310 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad147842-3889-4233-9dce-86cb0fdb86ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:53:18.195310 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad147842-3889-4233-9dce-86cb0fdb86ac admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:53:18.195975 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad147842-3889-4233-9dce-86cb0fdb86ac admin admin] PATH_INFO: `/v3/users/de6865bee3674ab98d990d5727f39403` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:53:18.197628 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad147842-3889-4233-9dce-86cb0fdb86ac admin admin] RBAC: Authorizing `identity:delete_user(user_id=de6865bee3674ab98d990d5727f39403)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:53:18.212842 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad147842-3889-4233-9dce-86cb0fdb86ac admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:53:18.306981 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 742/1481] 10.222.0.65 () {60 vars in 1483 bytes} [Thu Oct 27 09:53:17 2022] PUT /identity/v3/projects/e175c6ec10b644fb9086ee5737cce18b/users/e15c24a4572b41bda25f73d7dae2bc2d/roles/43543ce1450245af9661cb017bac17bd => generated 0 bytes in 524 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 09:53:18.316972 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d095ea-7964-4659-aabd-4e85a24cb397 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:53:18.317260 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d095ea-7964-4659-aabd-4e85a24cb397 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:53:18.317531 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d095ea-7964-4659-aabd-4e85a24cb397 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:53:18.364660 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-20d095ea-7964-4659-aabd-4e85a24cb397 None None] MFA Rules not processed for user `e15c24a4572b41bda25f73d7dae2bc2d`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:53:18.366811 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-20d095ea-7964-4659-aabd-4e85a24cb397 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:53:18.464789 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 743/1482] 10.222.0.65 () {58 vars in 958 bytes} [Thu Oct 27 09:53:18 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 09:53:18.475162 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d095ea-7964-4659-aabd-4e85a24cb397 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:53:18.518578 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-ad147842-3889-4233-9dce-86cb0fdb86ac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'de6865bee3674ab98d990d5727f39403'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:53:18.536509 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-ad147842-3889-4233-9dce-86cb0fdb86ac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'de6865bee3674ab98d990d5727f39403'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:53:18.538725 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-ad147842-3889-4233-9dce-86cb0fdb86ac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'de6865bee3674ab98d990d5727f39403'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:53:18.549082 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-ad147842-3889-4233-9dce-86cb0fdb86ac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'de6865bee3674ab98d990d5727f39403'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:53:18.596703 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d095ea-7964-4659-aabd-4e85a24cb397 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:53:18.602877 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5727994-bfeb-476f-8b99-430353218228 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:53:18.603725 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5727994-bfeb-476f-8b99-430353218228 admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:53:18.604497 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5727994-bfeb-476f-8b99-430353218228 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:53:18.604781 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5727994-bfeb-476f-8b99-430353218228 admin admin] PATH_INFO: `/v3/projects` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:53:18.605486 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5727994-bfeb-476f-8b99-430353218228 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:53:18.608076 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5727994-bfeb-476f-8b99-430353218228 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:53:18.646291 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-ad147842-3889-4233-9dce-86cb0fdb86ac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'de6865bee3674ab98d990d5727f39403'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:53:18.657083 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 740/1483] 10.222.0.65 () {58 vars in 1224 bytes} [Thu Oct 27 09:53:18 2022] DELETE /identity/v3/users/de6865bee3674ab98d990d5727f39403 => generated 0 bytes in 484 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 09:53:18.666955 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cca928b-c7d0-4620-8f45-826edb38339b None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:53:18.666955 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cca928b-c7d0-4620-8f45-826edb38339b None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:53:18.666955 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cca928b-c7d0-4620-8f45-826edb38339b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:53:18.693345 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-6cca928b-c7d0-4620-8f45-826edb38339b None None] MFA Rules not processed for user `b5065084bf664b99bdeac46067cb0f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:53:18.696569 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-6cca928b-c7d0-4620-8f45-826edb38339b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:53:18.783066 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 744/1484] 10.222.0.65 () {60 vars in 1153 bytes} [Thu Oct 27 09:53:18 2022] POST /identity/v3/projects => generated 383 bytes in 308 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 09:53:18.784267 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5727994-bfeb-476f-8b99-430353218228 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:53:18.788418 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-c5727994-bfeb-476f-8b99-430353218228 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:53:18.794018 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 741/1485] 10.222.0.65 () {58 vars in 958 bytes} [Thu Oct 27 09:53:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 09:53:18.806263 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cca928b-c7d0-4620-8f45-826edb38339b None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:53:18.807161 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-6cca928b-c7d0-4620-8f45-826edb38339b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:53:18.882636 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5727994-bfeb-476f-8b99-430353218228 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:53:18.887372 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cca928b-c7d0-4620-8f45-826edb38339b None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:53:18.888439 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33eecca7-905a-4568-b4d9-be7646c054ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:53:18.889084 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33eecca7-905a-4568-b4d9-be7646c054ad admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:53:18.889365 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33eecca7-905a-4568-b4d9-be7646c054ad admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:53:18.889636 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33eecca7-905a-4568-b4d9-be7646c054ad admin admin] PATH_INFO: `/v3/users` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:53:18.890301 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33eecca7-905a-4568-b4d9-be7646c054ad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:53:18.892245 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33eecca7-905a-4568-b4d9-be7646c054ad admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:53:18.937545 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5c5821-3007-4943-9251-457ad6b03fab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6191cc41efa74f46b49022cf387f7a4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc2e3a7a1bcc480891c0b433291c00b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:53:18.938165 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5c5821-3007-4943-9251-457ad6b03fab service neutron] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:53:18.938446 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5c5821-3007-4943-9251-457ad6b03fab service neutron] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:53:18.938753 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5c5821-3007-4943-9251-457ad6b03fab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:53:18.949579 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5c5821-3007-4943-9251-457ad6b03fab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:53:18.951081 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5c5821-3007-4943-9251-457ad6b03fab service neutron] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:53:18.962003 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 742/1486] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Oct 27 09:53:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 09:53:19.027510 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 745/1487] 10.222.0.65 () {60 vars in 1144 bytes} [Thu Oct 27 09:53:18 2022] POST /identity/v3/users => generated 298 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 09:53:19.029193 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5c5821-3007-4943-9251-457ad6b03fab service neutron] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:53:19.040825 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5c5821-3007-4943-9251-457ad6b03fab service neutron] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:53:19.045736 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a9cbce-b16f-484e-825a-279a39bad78f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:53:19.046342 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a9cbce-b16f-484e-825a-279a39bad78f admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:53:19.046656 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a9cbce-b16f-484e-825a-279a39bad78f admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:53:19.046930 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a9cbce-b16f-484e-825a-279a39bad78f admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:53:19.047821 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a9cbce-b16f-484e-825a-279a39bad78f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:53:19.049763 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a9cbce-b16f-484e-825a-279a39bad78f admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:53:19.060705 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 743/1488] 10.222.0.65 () {58 vars in 1122 bytes} [Thu Oct 27 09:53:19 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 09:53:19.064943 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33eecca7-905a-4568-b4d9-be7646c054ad admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:53:19.075926 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33eecca7-905a-4568-b4d9-be7646c054ad admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:53:19.081012 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fc85e3-5db2-494a-8036-eea33ca9f944 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:53:19.082002 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fc85e3-5db2-494a-8036-eea33ca9f944 admin admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:53:19.082280 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fc85e3-5db2-494a-8036-eea33ca9f944 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:53:19.082874 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fc85e3-5db2-494a-8036-eea33ca9f944 admin admin] PATH_INFO: `/v3/projects/1e71a2ac65124b1e8373eaf74ca111eb/users/95790be05de9450d86de66c3893b11e7/roles/6ad17b9f9dea4b66ab2da3677d7e715d` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:53:19.103085 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92fc85e3-5db2-494a-8036-eea33ca9f944 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e71a2ac65124b1e8373eaf74ca111eb, user_id=95790be05de9450d86de66c3893b11e7, role_id=6ad17b9f9dea4b66ab2da3677d7e715d)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:53:19.106061 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92fc85e3-5db2-494a-8036-eea33ca9f944 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:53:19.288398 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 746/1489] 10.222.0.65 () {60 vars in 1483 bytes} [Thu Oct 27 09:53:19 2022] PUT /identity/v3/projects/1e71a2ac65124b1e8373eaf74ca111eb/users/95790be05de9450d86de66c3893b11e7/roles/6ad17b9f9dea4b66ab2da3677d7e715d => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 09:53:19.294003 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a9cbce-b16f-484e-825a-279a39bad78f admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:53:19.305919 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a9cbce-b16f-484e-825a-279a39bad78f admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:53:19.384532 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e708b7fb-df41-45ff-b6c6-8344bc5b37f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:53:19.385095 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e708b7fb-df41-45ff-b6c6-8344bc5b37f7 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:53:19.385385 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e708b7fb-df41-45ff-b6c6-8344bc5b37f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:53:19.385668 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e708b7fb-df41-45ff-b6c6-8344bc5b37f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:53:19.386373 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e708b7fb-df41-45ff-b6c6-8344bc5b37f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:53:19.388217 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e708b7fb-df41-45ff-b6c6-8344bc5b37f7 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:53:19.402572 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 744/1490] 10.222.0.65 () {58 vars in 1122 bytes} [Thu Oct 27 09:53:19 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 09:53:19.404465 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fc85e3-5db2-494a-8036-eea33ca9f944 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:53:19.420449 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fc85e3-5db2-494a-8036-eea33ca9f944 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:53:19.426016 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd151c59-c125-472f-9c59-861173be53f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:53:19.427058 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd151c59-c125-472f-9c59-861173be53f8 admin admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:53:19.427652 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd151c59-c125-472f-9c59-861173be53f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:53:19.429418 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd151c59-c125-472f-9c59-861173be53f8 admin admin] PATH_INFO: `/v3/projects/1e71a2ac65124b1e8373eaf74ca111eb/users/95790be05de9450d86de66c3893b11e7/roles/6ad17b9f9dea4b66ab2da3677d7e715d` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:53:19.431754 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd151c59-c125-472f-9c59-861173be53f8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e71a2ac65124b1e8373eaf74ca111eb, user_id=95790be05de9450d86de66c3893b11e7, role_id=6ad17b9f9dea4b66ab2da3677d7e715d)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:53:19.434980 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd151c59-c125-472f-9c59-861173be53f8 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:53:19.450958 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 747/1491] 10.222.0.65 () {60 vars in 1483 bytes} [Thu Oct 27 09:53:19 2022] PUT /identity/v3/projects/1e71a2ac65124b1e8373eaf74ca111eb/users/95790be05de9450d86de66c3893b11e7/roles/6ad17b9f9dea4b66ab2da3677d7e715d => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 09:53:19.461980 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773c2543-1d04-4f64-9b77-3043f205c71d None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:53:19.462399 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773c2543-1d04-4f64-9b77-3043f205c71d None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:53:19.462809 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773c2543-1d04-4f64-9b77-3043f205c71d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:53:19.496948 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-773c2543-1d04-4f64-9b77-3043f205c71d None None] MFA Rules not processed for user `95790be05de9450d86de66c3893b11e7`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:53:19.498584 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-773c2543-1d04-4f64-9b77-3043f205c71d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:53:19.532204 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:53:19.567714 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd151c59-c125-472f-9c59-861173be53f8 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:53:19.572350 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-dd151c59-c125-472f-9c59-861173be53f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:53:19.618006 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 745/1492] 10.222.0.65 () {58 vars in 958 bytes} [Thu Oct 27 09:53:19 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 09:53:19.632212 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773c2543-1d04-4f64-9b77-3043f205c71d None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:53:19.637237 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-773c2543-1d04-4f64-9b77-3043f205c71d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:53:19.675072 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd151c59-c125-472f-9c59-861173be53f8 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:53:19.682646 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abac246d-9f08-43e7-93af-3f24f89f6c6b tempest-VolumeQuotaClassesTest-766582423 tempest-VolumeQuotaClassesTest-766582423-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78288002d1924fce9e183a43add42224', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5274e21e722447c1a72899a26fbc9e84', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:53:19.683213 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abac246d-9f08-43e7-93af-3f24f89f6c6b tempest-VolumeQuotaClassesTest-766582423 tempest-VolumeQuotaClassesTest-766582423-project-admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:53:19.683665 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abac246d-9f08-43e7-93af-3f24f89f6c6b tempest-VolumeQuotaClassesTest-766582423 tempest-VolumeQuotaClassesTest-766582423-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:53:19.683945 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abac246d-9f08-43e7-93af-3f24f89f6c6b tempest-VolumeQuotaClassesTest-766582423 tempest-VolumeQuotaClassesTest-766582423-project-admin] PATH_INFO: `/v3/domains` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:53:19.685251 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abac246d-9f08-43e7-93af-3f24f89f6c6b tempest-VolumeQuotaClassesTest-766582423 tempest-VolumeQuotaClassesTest-766582423-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 09:53:19.685600 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abac246d-9f08-43e7-93af-3f24f89f6c6b tempest-VolumeQuotaClassesTest-766582423 tempest-VolumeQuotaClassesTest-766582423-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:53:19.687472 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abac246d-9f08-43e7-93af-3f24f89f6c6b tempest-VolumeQuotaClassesTest-766582423 tempest-VolumeQuotaClassesTest-766582423-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:53:19.701747 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 748/1493] 10.222.0.65 () {58 vars in 1153 bytes} [Thu Oct 27 09:53:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 09:53:19.707564 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abac246d-9f08-43e7-93af-3f24f89f6c6b tempest-VolumeQuotaClassesTest-766582423 tempest-VolumeQuotaClassesTest-766582423-project-admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:53:19.761347 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abac246d-9f08-43e7-93af-3f24f89f6c6b tempest-VolumeQuotaClassesTest-766582423 tempest-VolumeQuotaClassesTest-766582423-project-admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:53:19.772993 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:53:19.787711 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0977f9b-ce56-421f-b1f3-f84aad7f0004 tempest-VolumeQuotaClassesTest-766582423 tempest-VolumeQuotaClassesTest-766582423-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78288002d1924fce9e183a43add42224', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5274e21e722447c1a72899a26fbc9e84', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:53:19.788295 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0977f9b-ce56-421f-b1f3-f84aad7f0004 tempest-VolumeQuotaClassesTest-766582423 tempest-VolumeQuotaClassesTest-766582423-project-admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:53:19.788586 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0977f9b-ce56-421f-b1f3-f84aad7f0004 tempest-VolumeQuotaClassesTest-766582423 tempest-VolumeQuotaClassesTest-766582423-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:53:19.788867 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0977f9b-ce56-421f-b1f3-f84aad7f0004 tempest-VolumeQuotaClassesTest-766582423 tempest-VolumeQuotaClassesTest-766582423-project-admin] PATH_INFO: `/v3/projects` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:53:19.789517 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0977f9b-ce56-421f-b1f3-f84aad7f0004 tempest-VolumeQuotaClassesTest-766582423 tempest-VolumeQuotaClassesTest-766582423-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:53:19.799981 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0977f9b-ce56-421f-b1f3-f84aad7f0004 tempest-VolumeQuotaClassesTest-766582423 tempest-VolumeQuotaClassesTest-766582423-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:53:19.802157 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773c2543-1d04-4f64-9b77-3043f205c71d None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:53:19.816189 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9187569c-192f-4221-bc4c-35f4d7a39f15 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8e5d5f04c4741bb86ca4a0f667d4ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc2e3a7a1bcc480891c0b433291c00b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:53:19.817155 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9187569c-192f-4221-bc4c-35f4d7a39f15 service cinder] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:53:19.819704 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9187569c-192f-4221-bc4c-35f4d7a39f15 service cinder] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:53:19.820294 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9187569c-192f-4221-bc4c-35f4d7a39f15 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:53:19.826288 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-9187569c-192f-4221-bc4c-35f4d7a39f15 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:53:19.924578 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 749/1494] 10.222.0.65 () {60 vars in 1153 bytes} [Thu Oct 27 09:53:19 2022] POST /identity/v3/projects => generated 355 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 09:53:19.928821 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0977f9b-ce56-421f-b1f3-f84aad7f0004 tempest-VolumeQuotaClassesTest-766582423 tempest-VolumeQuotaClassesTest-766582423-project-admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:53:19.949542 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9187569c-192f-4221-bc4c-35f4d7a39f15 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:53:19.951751 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9187569c-192f-4221-bc4c-35f4d7a39f15 service cinder] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:53:19.966454 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 746/1495] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Oct 27 09:53:19 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 09:53:20.034250 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0977f9b-ce56-421f-b1f3-f84aad7f0004 tempest-VolumeQuotaClassesTest-766582423 tempest-VolumeQuotaClassesTest-766582423-project-admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:53:20.041498 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c3c381-eeb9-4dbe-9a9b-dd9ba60554c2 tempest-VolumeQuotaClassesTest-766582423 tempest-VolumeQuotaClassesTest-766582423-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78288002d1924fce9e183a43add42224', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5274e21e722447c1a72899a26fbc9e84', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:53:20.042558 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c3c381-eeb9-4dbe-9a9b-dd9ba60554c2 tempest-VolumeQuotaClassesTest-766582423 tempest-VolumeQuotaClassesTest-766582423-project-admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:53:20.043554 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c3c381-eeb9-4dbe-9a9b-dd9ba60554c2 tempest-VolumeQuotaClassesTest-766582423 tempest-VolumeQuotaClassesTest-766582423-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:53:20.044074 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c3c381-eeb9-4dbe-9a9b-dd9ba60554c2 tempest-VolumeQuotaClassesTest-766582423 tempest-VolumeQuotaClassesTest-766582423-project-admin] PATH_INFO: `/v3/domains` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:53:20.044894 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c3c381-eeb9-4dbe-9a9b-dd9ba60554c2 tempest-VolumeQuotaClassesTest-766582423 tempest-VolumeQuotaClassesTest-766582423-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 09:53:20.045355 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c3c381-eeb9-4dbe-9a9b-dd9ba60554c2 tempest-VolumeQuotaClassesTest-766582423 tempest-VolumeQuotaClassesTest-766582423-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:53:20.047915 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c3c381-eeb9-4dbe-9a9b-dd9ba60554c2 tempest-VolumeQuotaClassesTest-766582423 tempest-VolumeQuotaClassesTest-766582423-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:53:20.080316 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 750/1496] 10.222.0.65 () {58 vars in 1153 bytes} [Thu Oct 27 09:53:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 09:53:20.137424 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9187569c-192f-4221-bc4c-35f4d7a39f15 service cinder] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:53:20.151751 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9187569c-192f-4221-bc4c-35f4d7a39f15 service cinder] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:53:20.170596 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a888085-4a9d-4162-869f-d7cba7feaa4e tempest-VolumeQuotaClassesTest-766582423 tempest-VolumeQuotaClassesTest-766582423-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78288002d1924fce9e183a43add42224', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5274e21e722447c1a72899a26fbc9e84', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:53:20.170596 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a888085-4a9d-4162-869f-d7cba7feaa4e tempest-VolumeQuotaClassesTest-766582423 tempest-VolumeQuotaClassesTest-766582423-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:53:20.170596 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a888085-4a9d-4162-869f-d7cba7feaa4e tempest-VolumeQuotaClassesTest-766582423 tempest-VolumeQuotaClassesTest-766582423-project-admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:53:20.171229 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a888085-4a9d-4162-869f-d7cba7feaa4e tempest-VolumeQuotaClassesTest-766582423 tempest-VolumeQuotaClassesTest-766582423-project-admin] PATH_INFO: `/v3/projects/05fcbd15bc3a487b98fee47e982cc722` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:53:20.171229 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a888085-4a9d-4162-869f-d7cba7feaa4e tempest-VolumeQuotaClassesTest-766582423 tempest-VolumeQuotaClassesTest-766582423-project-admin] RBAC: Authorizing `identity:delete_project(project_id=05fcbd15bc3a487b98fee47e982cc722)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:53:20.171229 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a888085-4a9d-4162-869f-d7cba7feaa4e tempest-VolumeQuotaClassesTest-766582423 tempest-VolumeQuotaClassesTest-766582423-project-admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:53:20.186022 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c3c381-eeb9-4dbe-9a9b-dd9ba60554c2 tempest-VolumeQuotaClassesTest-766582423 tempest-VolumeQuotaClassesTest-766582423-project-admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:53:20.187950 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-d7c3c381-eeb9-4dbe-9a9b-dd9ba60554c2 tempest-VolumeQuotaClassesTest-766582423 tempest-VolumeQuotaClassesTest-766582423-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:53:20.291722 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c3c381-eeb9-4dbe-9a9b-dd9ba60554c2 tempest-VolumeQuotaClassesTest-766582423 tempest-VolumeQuotaClassesTest-766582423-project-admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:53:20.301875 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38ef7c4-5e5a-4898-bb98-45910d18b764 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:53:20.303599 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38ef7c4-5e5a-4898-bb98-45910d18b764 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:53:20.303599 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38ef7c4-5e5a-4898-bb98-45910d18b764 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:53:20.303849 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38ef7c4-5e5a-4898-bb98-45910d18b764 admin admin] PATH_INFO: `/v3/projects/5090fafe35da4021973773d3614e5687` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:53:20.305598 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38ef7c4-5e5a-4898-bb98-45910d18b764 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5090fafe35da4021973773d3614e5687)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:53:20.307683 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38ef7c4-5e5a-4898-bb98-45910d18b764 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:53:20.373395 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-6a888085-4a9d-4162-869f-d7cba7feaa4e tempest-VolumeQuotaClassesTest-766582423 tempest-VolumeQuotaClassesTest-766582423-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '05fcbd15bc3a487b98fee47e982cc722', 'request_id': 'req-6a888085-4a9d-4162-869f-d7cba7feaa4e'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:53:20.445282 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-a38ef7c4-5e5a-4898-bb98-45910d18b764 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5090fafe35da4021973773d3614e5687', 'request_id': 'req-a38ef7c4-5e5a-4898-bb98-45910d18b764'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:53:20.452010 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-a38ef7c4-5e5a-4898-bb98-45910d18b764 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5090fafe35da4021973773d3614e5687', 'request_id': 'req-a38ef7c4-5e5a-4898-bb98-45910d18b764'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:53:20.478817 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-6a888085-4a9d-4162-869f-d7cba7feaa4e tempest-VolumeQuotaClassesTest-766582423 tempest-VolumeQuotaClassesTest-766582423-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '05fcbd15bc3a487b98fee47e982cc722', 'request_id': 'req-6a888085-4a9d-4162-869f-d7cba7feaa4e'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:53:20.485094 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-6a888085-4a9d-4162-869f-d7cba7feaa4e tempest-VolumeQuotaClassesTest-766582423 tempest-VolumeQuotaClassesTest-766582423-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '05fcbd15bc3a487b98fee47e982cc722', 'request_id': 'req-6a888085-4a9d-4162-869f-d7cba7feaa4e'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:53:20.498237 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-6a888085-4a9d-4162-869f-d7cba7feaa4e tempest-VolumeQuotaClassesTest-766582423 tempest-VolumeQuotaClassesTest-766582423-project-admin] The token cache is being invalidate because project 05fcbd15bc3a487b98fee47e982cc722 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 09:53:20.498512 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-6a888085-4a9d-4162-869f-d7cba7feaa4e tempest-VolumeQuotaClassesTest-766582423 tempest-VolumeQuotaClassesTest-766582423-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:53:20.499255 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-6a888085-4a9d-4162-869f-d7cba7feaa4e tempest-VolumeQuotaClassesTest-766582423 tempest-VolumeQuotaClassesTest-766582423-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:53:20.500821 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 747/1497] 10.222.0.65 () {58 vars in 1233 bytes} [Thu Oct 27 09:53:20 2022] DELETE /identity/v3/projects/05fcbd15bc3a487b98fee47e982cc722 => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 09:53:20.582236 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-a38ef7c4-5e5a-4898-bb98-45910d18b764 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5090fafe35da4021973773d3614e5687', 'request_id': 'req-a38ef7c4-5e5a-4898-bb98-45910d18b764'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:53:20.593319 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-a38ef7c4-5e5a-4898-bb98-45910d18b764 admin admin] The token cache is being invalidate because project 5090fafe35da4021973773d3614e5687 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 09:53:20.596512 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-a38ef7c4-5e5a-4898-bb98-45910d18b764 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:53:20.596512 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-a38ef7c4-5e5a-4898-bb98-45910d18b764 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:53:20.596512 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 751/1498] 10.222.0.65 () {58 vars in 1233 bytes} [Thu Oct 27 09:53:20 2022] DELETE /identity/v3/projects/5090fafe35da4021973773d3614e5687 => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 09:53:20.600037 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a888085-4a9d-4162-869f-d7cba7feaa4e tempest-VolumeQuotaClassesTest-766582423 tempest-VolumeQuotaClassesTest-766582423-project-admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:53:20.601735 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-6a888085-4a9d-4162-869f-d7cba7feaa4e tempest-VolumeQuotaClassesTest-766582423 tempest-VolumeQuotaClassesTest-766582423-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:53:20.670489 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a888085-4a9d-4162-869f-d7cba7feaa4e tempest-VolumeQuotaClassesTest-766582423 tempest-VolumeQuotaClassesTest-766582423-project-admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:53:20.738009 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d26cb7c-e985-4d4c-a0f3-a54bb6cbd136 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:53:20.738844 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d26cb7c-e985-4d4c-a0f3-a54bb6cbd136 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:53:20.741221 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d26cb7c-e985-4d4c-a0f3-a54bb6cbd136 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:53:20.741221 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d26cb7c-e985-4d4c-a0f3-a54bb6cbd136 admin admin] PATH_INFO: `/v3/users/f867eea92f1c48168fc01952fec84084` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:53:20.741957 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d26cb7c-e985-4d4c-a0f3-a54bb6cbd136 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f867eea92f1c48168fc01952fec84084)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:53:20.744195 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d26cb7c-e985-4d4c-a0f3-a54bb6cbd136 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:53:21.070654 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-6d26cb7c-e985-4d4c-a0f3-a54bb6cbd136 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f867eea92f1c48168fc01952fec84084'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:53:21.083081 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-6d26cb7c-e985-4d4c-a0f3-a54bb6cbd136 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f867eea92f1c48168fc01952fec84084'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:53:21.084326 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-6d26cb7c-e985-4d4c-a0f3-a54bb6cbd136 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f867eea92f1c48168fc01952fec84084'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:53:21.091710 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-6d26cb7c-e985-4d4c-a0f3-a54bb6cbd136 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f867eea92f1c48168fc01952fec84084'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:53:21.182606 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-6d26cb7c-e985-4d4c-a0f3-a54bb6cbd136 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f867eea92f1c48168fc01952fec84084'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:53:21.195007 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 748/1499] 10.222.0.65 () {58 vars in 1224 bytes} [Thu Oct 27 09:53:20 2022] DELETE /identity/v3/users/f867eea92f1c48168fc01952fec84084 => generated 0 bytes in 592 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 09:53:21.292070 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38ef7c4-5e5a-4898-bb98-45910d18b764 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:53:21.293647 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-a38ef7c4-5e5a-4898-bb98-45910d18b764 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:53:21.310992 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38ef7c4-5e5a-4898-bb98-45910d18b764 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:53:21.379811 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d311b5d-041f-4c84-aea7-bbaf3a719d39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:53:21.381612 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d311b5d-041f-4c84-aea7-bbaf3a719d39 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:53:21.381612 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d311b5d-041f-4c84-aea7-bbaf3a719d39 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:53:21.381972 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d311b5d-041f-4c84-aea7-bbaf3a719d39 admin admin] PATH_INFO: `/v3/users/56d2090849ed450faebac65548c7d0be` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:53:21.383306 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d311b5d-041f-4c84-aea7-bbaf3a719d39 admin admin] RBAC: Authorizing `identity:delete_user(user_id=56d2090849ed450faebac65548c7d0be)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:53:21.385772 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d311b5d-041f-4c84-aea7-bbaf3a719d39 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:53:21.655138 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-7d311b5d-041f-4c84-aea7-bbaf3a719d39 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '56d2090849ed450faebac65548c7d0be'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:53:21.657206 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-7d311b5d-041f-4c84-aea7-bbaf3a719d39 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '56d2090849ed450faebac65548c7d0be'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:53:21.665595 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-7d311b5d-041f-4c84-aea7-bbaf3a719d39 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '56d2090849ed450faebac65548c7d0be'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:53:21.666312 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-7d311b5d-041f-4c84-aea7-bbaf3a719d39 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '56d2090849ed450faebac65548c7d0be'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:53:21.679540 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-7d311b5d-041f-4c84-aea7-bbaf3a719d39 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '56d2090849ed450faebac65548c7d0be'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:53:21.806832 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 752/1500] 10.222.0.65 () {58 vars in 1224 bytes} [Thu Oct 27 09:53:21 2022] DELETE /identity/v3/users/56d2090849ed450faebac65548c7d0be => generated 0 bytes in 516 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 09:53:21.822688 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebfed27-24eb-4157-b508-24f349de83ad None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:53:21.822688 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebfed27-24eb-4157-b508-24f349de83ad None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:53:21.822688 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebfed27-24eb-4157-b508-24f349de83ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:53:21.831685 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-eebfed27-24eb-4157-b508-24f349de83ad None None] MFA Rules not processed for user `b5065084bf664b99bdeac46067cb0f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:53:21.832918 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-eebfed27-24eb-4157-b508-24f349de83ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:53:21.853755 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d311b5d-041f-4c84-aea7-bbaf3a719d39 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:53:21.856992 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-7d311b5d-041f-4c84-aea7-bbaf3a719d39 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:53:21.932827 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 749/1501] 10.222.0.65 () {58 vars in 958 bytes} [Thu Oct 27 09:53:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 09:53:21.939305 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebfed27-24eb-4157-b508-24f349de83ad None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:53:21.941343 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-eebfed27-24eb-4157-b508-24f349de83ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:53:21.980126 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d311b5d-041f-4c84-aea7-bbaf3a719d39 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:53:21.987100 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd046fbf-7471-469b-b343-687018351897 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:53:21.987960 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd046fbf-7471-469b-b343-687018351897 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:53:21.989166 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd046fbf-7471-469b-b343-687018351897 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:53:21.989539 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd046fbf-7471-469b-b343-687018351897 admin admin] PATH_INFO: `/v3/projects/f22ea7758cf84775bd772bbe3f622d7f` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:53:21.991375 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd046fbf-7471-469b-b343-687018351897 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f22ea7758cf84775bd772bbe3f622d7f)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:53:21.993287 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd046fbf-7471-469b-b343-687018351897 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:53:22.027291 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebfed27-24eb-4157-b508-24f349de83ad None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:53:22.031445 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad267bfe-17ba-4460-a033-978769e4e09c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6191cc41efa74f46b49022cf387f7a4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc2e3a7a1bcc480891c0b433291c00b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:53:22.032326 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad267bfe-17ba-4460-a033-978769e4e09c service neutron] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:53:22.032688 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad267bfe-17ba-4460-a033-978769e4e09c service neutron] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:53:22.032889 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad267bfe-17ba-4460-a033-978769e4e09c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:53:22.043130 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad267bfe-17ba-4460-a033-978769e4e09c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:53:22.044497 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad267bfe-17ba-4460-a033-978769e4e09c service neutron] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:53:22.054292 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 750/1502] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Oct 27 09:53:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 09:53:22.152860 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-bd046fbf-7471-469b-b343-687018351897 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f22ea7758cf84775bd772bbe3f622d7f', 'request_id': 'req-bd046fbf-7471-469b-b343-687018351897'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:53:22.159446 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-bd046fbf-7471-469b-b343-687018351897 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f22ea7758cf84775bd772bbe3f622d7f', 'request_id': 'req-bd046fbf-7471-469b-b343-687018351897'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:53:22.234302 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-bd046fbf-7471-469b-b343-687018351897 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f22ea7758cf84775bd772bbe3f622d7f', 'request_id': 'req-bd046fbf-7471-469b-b343-687018351897'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:53:22.248695 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-bd046fbf-7471-469b-b343-687018351897 admin admin] The token cache is being invalidate because project f22ea7758cf84775bd772bbe3f622d7f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 09:53:22.248986 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-bd046fbf-7471-469b-b343-687018351897 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:53:22.249788 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-bd046fbf-7471-469b-b343-687018351897 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:53:22.251571 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 753/1503] 10.222.0.65 () {58 vars in 1233 bytes} [Thu Oct 27 09:53:21 2022] DELETE /identity/v3/projects/f22ea7758cf84775bd772bbe3f622d7f => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 09:53:22.255399 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad267bfe-17ba-4460-a033-978769e4e09c service neutron] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:53:22.268148 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad267bfe-17ba-4460-a033-978769e4e09c service neutron] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:53:22.354624 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c10d3ba-f0a0-4626-86d7-d814c1e44af5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:53:22.354624 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c10d3ba-f0a0-4626-86d7-d814c1e44af5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:53:22.354624 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c10d3ba-f0a0-4626-86d7-d814c1e44af5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:53:22.354624 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c10d3ba-f0a0-4626-86d7-d814c1e44af5 admin admin] PATH_INFO: `/v3/users/8af49016684c449887d5c557694e9982` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:53:22.354971 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c10d3ba-f0a0-4626-86d7-d814c1e44af5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8af49016684c449887d5c557694e9982)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:53:22.354971 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c10d3ba-f0a0-4626-86d7-d814c1e44af5 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:53:22.600471 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-0c10d3ba-f0a0-4626-86d7-d814c1e44af5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8af49016684c449887d5c557694e9982'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:53:22.625423 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd046fbf-7471-469b-b343-687018351897 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:53:22.629386 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-bd046fbf-7471-469b-b343-687018351897 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:53:22.645698 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-0c10d3ba-f0a0-4626-86d7-d814c1e44af5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8af49016684c449887d5c557694e9982'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:53:22.648813 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-0c10d3ba-f0a0-4626-86d7-d814c1e44af5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8af49016684c449887d5c557694e9982'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:53:22.665011 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd046fbf-7471-469b-b343-687018351897 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:53:22.672112 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-0c10d3ba-f0a0-4626-86d7-d814c1e44af5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8af49016684c449887d5c557694e9982'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:53:22.678618 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a33268-6aa0-4a4e-86df-80ba07f42f61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:53:22.690715 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a33268-6aa0-4a4e-86df-80ba07f42f61 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:53:22.690715 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a33268-6aa0-4a4e-86df-80ba07f42f61 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:53:22.690715 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a33268-6aa0-4a4e-86df-80ba07f42f61 admin admin] PATH_INFO: `/v3/projects/91794938d60f4e52ac383fd5bf020689` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:53:22.690715 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a33268-6aa0-4a4e-86df-80ba07f42f61 admin admin] RBAC: Authorizing `identity:delete_project(project_id=91794938d60f4e52ac383fd5bf020689)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:53:22.690715 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a33268-6aa0-4a4e-86df-80ba07f42f61 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:53:22.772197 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-0c10d3ba-f0a0-4626-86d7-d814c1e44af5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8af49016684c449887d5c557694e9982'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:53:22.775292 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:53:22.787432 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 751/1504] 10.222.0.65 () {58 vars in 1224 bytes} [Thu Oct 27 09:53:22 2022] DELETE /identity/v3/users/8af49016684c449887d5c557694e9982 => generated 0 bytes in 529 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 09:53:22.816241 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-45a33268-6aa0-4a4e-86df-80ba07f42f61 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '91794938d60f4e52ac383fd5bf020689', 'request_id': 'req-45a33268-6aa0-4a4e-86df-80ba07f42f61'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:53:22.824934 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-45a33268-6aa0-4a4e-86df-80ba07f42f61 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '91794938d60f4e52ac383fd5bf020689', 'request_id': 'req-45a33268-6aa0-4a4e-86df-80ba07f42f61'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:53:22.925899 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-45a33268-6aa0-4a4e-86df-80ba07f42f61 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '91794938d60f4e52ac383fd5bf020689', 'request_id': 'req-45a33268-6aa0-4a4e-86df-80ba07f42f61'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:53:22.937143 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-45a33268-6aa0-4a4e-86df-80ba07f42f61 admin admin] The token cache is being invalidate because project 91794938d60f4e52ac383fd5bf020689 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 09:53:22.937433 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-45a33268-6aa0-4a4e-86df-80ba07f42f61 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:53:22.938162 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-45a33268-6aa0-4a4e-86df-80ba07f42f61 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:53:22.939727 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 754/1505] 10.222.0.65 () {58 vars in 1233 bytes} [Thu Oct 27 09:53:22 2022] DELETE /identity/v3/projects/91794938d60f4e52ac383fd5bf020689 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 09:53:22.943838 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c10d3ba-f0a0-4626-86d7-d814c1e44af5 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:53:22.945410 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-0c10d3ba-f0a0-4626-86d7-d814c1e44af5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:53:23.011096 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c10d3ba-f0a0-4626-86d7-d814c1e44af5 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:53:23.068966 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d917efb-b6e4-428b-8fbc-8b1f2d7f7af2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:53:23.069776 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d917efb-b6e4-428b-8fbc-8b1f2d7f7af2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:53:23.070238 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d917efb-b6e4-428b-8fbc-8b1f2d7f7af2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:53:23.070649 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d917efb-b6e4-428b-8fbc-8b1f2d7f7af2 admin admin] PATH_INFO: `/v3/users/78288002d1924fce9e183a43add42224` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:53:23.071918 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d917efb-b6e4-428b-8fbc-8b1f2d7f7af2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=78288002d1924fce9e183a43add42224)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:53:23.073879 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d917efb-b6e4-428b-8fbc-8b1f2d7f7af2 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:53:23.077155 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:53:23.264064 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-6d917efb-b6e4-428b-8fbc-8b1f2d7f7af2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '78288002d1924fce9e183a43add42224'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:53:23.276960 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-6d917efb-b6e4-428b-8fbc-8b1f2d7f7af2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '78288002d1924fce9e183a43add42224'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:53:23.277671 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-6d917efb-b6e4-428b-8fbc-8b1f2d7f7af2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '78288002d1924fce9e183a43add42224'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:53:23.286139 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a33268-6aa0-4a4e-86df-80ba07f42f61 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:53:23.286417 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-6d917efb-b6e4-428b-8fbc-8b1f2d7f7af2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '78288002d1924fce9e183a43add42224'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:53:23.293306 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-45a33268-6aa0-4a4e-86df-80ba07f42f61 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:53:23.301712 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a33268-6aa0-4a4e-86df-80ba07f42f61 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:53:23.307085 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bd1776-466a-4334-be32-45c0422bbcf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:53:23.307737 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bd1776-466a-4334-be32-45c0422bbcf2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:53:23.308022 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bd1776-466a-4334-be32-45c0422bbcf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:53:23.308330 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bd1776-466a-4334-be32-45c0422bbcf2 admin admin] PATH_INFO: `/v3/projects/7e2e6dbb427742d99900166027ef8f3b` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:53:23.309533 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39bd1776-466a-4334-be32-45c0422bbcf2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7e2e6dbb427742d99900166027ef8f3b)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:53:23.311489 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39bd1776-466a-4334-be32-45c0422bbcf2 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:53:23.370117 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-6d917efb-b6e4-428b-8fbc-8b1f2d7f7af2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '78288002d1924fce9e183a43add42224'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:53:23.376581 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 752/1506] 10.222.0.65 () {58 vars in 1224 bytes} [Thu Oct 27 09:53:22 2022] DELETE /identity/v3/users/78288002d1924fce9e183a43add42224 => generated 0 bytes in 433 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 09:53:23.435257 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-39bd1776-466a-4334-be32-45c0422bbcf2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7e2e6dbb427742d99900166027ef8f3b', 'request_id': 'req-39bd1776-466a-4334-be32-45c0422bbcf2'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:53:23.443125 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-39bd1776-466a-4334-be32-45c0422bbcf2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7e2e6dbb427742d99900166027ef8f3b', 'request_id': 'req-39bd1776-466a-4334-be32-45c0422bbcf2'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:53:23.568893 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-39bd1776-466a-4334-be32-45c0422bbcf2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7e2e6dbb427742d99900166027ef8f3b', 'request_id': 'req-39bd1776-466a-4334-be32-45c0422bbcf2'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:53:23.581206 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-39bd1776-466a-4334-be32-45c0422bbcf2 admin admin] The token cache is being invalidate because project 7e2e6dbb427742d99900166027ef8f3b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 09:53:23.581206 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-39bd1776-466a-4334-be32-45c0422bbcf2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:53:23.581988 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-39bd1776-466a-4334-be32-45c0422bbcf2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:53:23.584479 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 755/1507] 10.222.0.65 () {58 vars in 1233 bytes} [Thu Oct 27 09:53:23 2022] DELETE /identity/v3/projects/7e2e6dbb427742d99900166027ef8f3b => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 09:53:23.591345 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59eb6da-1102-4409-a20a-f7ced414e9fa None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:53:23.591705 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59eb6da-1102-4409-a20a-f7ced414e9fa None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:53:23.592083 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59eb6da-1102-4409-a20a-f7ced414e9fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:53:23.618777 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-a59eb6da-1102-4409-a20a-f7ced414e9fa None None] MFA Rules not processed for user `b5065084bf664b99bdeac46067cb0f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:53:23.620750 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-a59eb6da-1102-4409-a20a-f7ced414e9fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:53:23.761997 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 753/1508] 10.222.0.65 () {58 vars in 958 bytes} [Thu Oct 27 09:53:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 09:53:23.769818 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6252984d-9e7a-4f27-b447-9a7c5149bfd4 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:53:23.770312 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6252984d-9e7a-4f27-b447-9a7c5149bfd4 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:53:23.811200 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6252984d-9e7a-4f27-b447-9a7c5149bfd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:53:23.811200 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-6252984d-9e7a-4f27-b447-9a7c5149bfd4 None None] MFA Rules not processed for user `b5065084bf664b99bdeac46067cb0f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:53:23.811200 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-6252984d-9e7a-4f27-b447-9a7c5149bfd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:53:23.832040 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 756/1509] 10.222.0.65 () {58 vars in 958 bytes} [Thu Oct 27 09:53:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 09:53:23.838417 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59eb6da-1102-4409-a20a-f7ced414e9fa None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:53:23.860235 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59eb6da-1102-4409-a20a-f7ced414e9fa None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:53:23.873122 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6035b1c3-cd68-4485-a0fc-1ec1089053d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:53:23.873677 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6035b1c3-cd68-4485-a0fc-1ec1089053d5 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:53:23.873961 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6035b1c3-cd68-4485-a0fc-1ec1089053d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:53:23.874236 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6035b1c3-cd68-4485-a0fc-1ec1089053d5 admin admin] PATH_INFO: `/v3/domains` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:53:23.874986 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6035b1c3-cd68-4485-a0fc-1ec1089053d5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 09:53:23.875292 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6035b1c3-cd68-4485-a0fc-1ec1089053d5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:53:23.879277 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6035b1c3-cd68-4485-a0fc-1ec1089053d5 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:53:23.914282 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 754/1510] 10.222.0.65 () {58 vars in 1153 bytes} [Thu Oct 27 09:53:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 09:53:23.918799 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6252984d-9e7a-4f27-b447-9a7c5149bfd4 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:53:23.929910 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6252984d-9e7a-4f27-b447-9a7c5149bfd4 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:53:23.935037 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab44c90b-2da5-423b-a5f8-69a3e9b23a0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:53:23.935820 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab44c90b-2da5-423b-a5f8-69a3e9b23a0d admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:53:23.936194 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab44c90b-2da5-423b-a5f8-69a3e9b23a0d admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:53:23.936563 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab44c90b-2da5-423b-a5f8-69a3e9b23a0d admin admin] PATH_INFO: `/v3/projects` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:53:23.937498 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab44c90b-2da5-423b-a5f8-69a3e9b23a0d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:53:23.939589 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab44c90b-2da5-423b-a5f8-69a3e9b23a0d admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:53:24.071623 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6035b1c3-cd68-4485-a0fc-1ec1089053d5 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:53:24.073896 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-6035b1c3-cd68-4485-a0fc-1ec1089053d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:53:24.093849 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6035b1c3-cd68-4485-a0fc-1ec1089053d5 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:53:24.100290 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba15b6ed-6017-43af-9434-89210ceea621 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:53:24.101330 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba15b6ed-6017-43af-9434-89210ceea621 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:53:24.101711 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba15b6ed-6017-43af-9434-89210ceea621 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:53:24.106952 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba15b6ed-6017-43af-9434-89210ceea621 admin admin] PATH_INFO: `/v3/projects/5274e21e722447c1a72899a26fbc9e84` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:53:24.108653 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba15b6ed-6017-43af-9434-89210ceea621 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5274e21e722447c1a72899a26fbc9e84)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:53:24.110864 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba15b6ed-6017-43af-9434-89210ceea621 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:53:24.136933 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 757/1511] 10.222.0.65 () {60 vars in 1153 bytes} [Thu Oct 27 09:53:23 2022] POST /identity/v3/projects => generated 367 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 09:53:24.139367 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab44c90b-2da5-423b-a5f8-69a3e9b23a0d admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:53:24.205202 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab44c90b-2da5-423b-a5f8-69a3e9b23a0d admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:53:24.209831 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac14a7fa-32d0-42cd-857a-9787eac75781 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:53:24.210447 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac14a7fa-32d0-42cd-857a-9787eac75781 admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:53:24.210762 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac14a7fa-32d0-42cd-857a-9787eac75781 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:53:24.211034 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac14a7fa-32d0-42cd-857a-9787eac75781 admin admin] PATH_INFO: `/v3/users` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:53:24.211659 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac14a7fa-32d0-42cd-857a-9787eac75781 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:53:24.213620 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac14a7fa-32d0-42cd-857a-9787eac75781 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:53:24.228132 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-ba15b6ed-6017-43af-9434-89210ceea621 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5274e21e722447c1a72899a26fbc9e84', 'request_id': 'req-ba15b6ed-6017-43af-9434-89210ceea621'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:53:24.331440 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-ba15b6ed-6017-43af-9434-89210ceea621 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5274e21e722447c1a72899a26fbc9e84', 'request_id': 'req-ba15b6ed-6017-43af-9434-89210ceea621'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:53:24.337258 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 758/1512] 10.222.0.65 () {60 vars in 1144 bytes} [Thu Oct 27 09:53:24 2022] POST /identity/v3/users => generated 284 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 09:53:24.338466 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-ba15b6ed-6017-43af-9434-89210ceea621 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5274e21e722447c1a72899a26fbc9e84', 'request_id': 'req-ba15b6ed-6017-43af-9434-89210ceea621'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:53:24.341527 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac14a7fa-32d0-42cd-857a-9787eac75781 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:53:24.352180 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-ba15b6ed-6017-43af-9434-89210ceea621 admin admin] The token cache is being invalidate because project 5274e21e722447c1a72899a26fbc9e84 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 09:53:24.352467 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-ba15b6ed-6017-43af-9434-89210ceea621 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:53:24.352965 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac14a7fa-32d0-42cd-857a-9787eac75781 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:53:24.353141 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-ba15b6ed-6017-43af-9434-89210ceea621 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:53:24.354666 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 755/1513] 10.222.0.65 () {58 vars in 1233 bytes} [Thu Oct 27 09:53:24 2022] DELETE /identity/v3/projects/5274e21e722447c1a72899a26fbc9e84 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 09:53:24.359708 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca53584d-b177-4f37-8a6b-b65ddf3aa352 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:53:24.359995 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca53584d-b177-4f37-8a6b-b65ddf3aa352 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:53:24.360267 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca53584d-b177-4f37-8a6b-b65ddf3aa352 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:53:24.381155 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-ca53584d-b177-4f37-8a6b-b65ddf3aa352 None None] MFA Rules not processed for user `b5065084bf664b99bdeac46067cb0f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:53:24.383251 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-ca53584d-b177-4f37-8a6b-b65ddf3aa352 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:53:24.432627 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c3e233-63a5-4c98-b12f-b7ef5b6a5332 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:53:24.433383 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c3e233-63a5-4c98-b12f-b7ef5b6a5332 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:53:24.433739 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c3e233-63a5-4c98-b12f-b7ef5b6a5332 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:53:24.434107 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c3e233-63a5-4c98-b12f-b7ef5b6a5332 admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:53:24.434879 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c3e233-63a5-4c98-b12f-b7ef5b6a5332 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:53:24.436812 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c3e233-63a5-4c98-b12f-b7ef5b6a5332 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:53:24.450554 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 759/1514] 10.222.0.65 () {58 vars in 1122 bytes} [Thu Oct 27 09:53:24 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 09:53:24.454246 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c3e233-63a5-4c98-b12f-b7ef5b6a5332 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:53:24.456519 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-60c3e233-63a5-4c98-b12f-b7ef5b6a5332 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:53:24.457344 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 756/1515] 10.222.0.65 () {58 vars in 958 bytes} [Thu Oct 27 09:53:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 09:53:24.470771 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47de3f75-6556-4989-aceb-f5986c6d0194 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:53:24.471187 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47de3f75-6556-4989-aceb-f5986c6d0194 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:53:24.471375 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c3e233-63a5-4c98-b12f-b7ef5b6a5332 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:53:24.471680 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47de3f75-6556-4989-aceb-f5986c6d0194 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:53:24.476570 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77ef997-b680-490a-9f8f-b320b59855a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:53:24.477208 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77ef997-b680-490a-9f8f-b320b59855a2 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:53:24.477546 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77ef997-b680-490a-9f8f-b320b59855a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:53:24.477842 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77ef997-b680-490a-9f8f-b320b59855a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:53:24.478538 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77ef997-b680-490a-9f8f-b320b59855a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:53:24.480212 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77ef997-b680-490a-9f8f-b320b59855a2 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:53:24.494959 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 760/1516] 10.222.0.65 () {58 vars in 1122 bytes} [Thu Oct 27 09:53:24 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 09:53:24.495138 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-47de3f75-6556-4989-aceb-f5986c6d0194 None None] MFA Rules not processed for user `b5065084bf664b99bdeac46067cb0f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:53:24.495138 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-47de3f75-6556-4989-aceb-f5986c6d0194 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:53:24.495986 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77ef997-b680-490a-9f8f-b320b59855a2 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:53:24.502308 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 757/1517] 10.222.0.65 () {58 vars in 958 bytes} [Thu Oct 27 09:53:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 09:53:24.506227 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47de3f75-6556-4989-aceb-f5986c6d0194 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:53:24.506377 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77ef997-b680-490a-9f8f-b320b59855a2 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:53:24.512451 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3e7e96-baef-42e4-a7ef-980e3c29a96e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:53:24.513139 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3e7e96-baef-42e4-a7ef-980e3c29a96e admin admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:53:24.513465 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3e7e96-baef-42e4-a7ef-980e3c29a96e admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:53:24.513754 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3e7e96-baef-42e4-a7ef-980e3c29a96e admin admin] PATH_INFO: `/v3/projects/314b9f8df52a462b835cb5e1717e93ef/users/1372fd10dc1747f8957712decd4279c0/roles/43543ce1450245af9661cb017bac17bd` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:53:24.517851 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47de3f75-6556-4989-aceb-f5986c6d0194 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:53:24.523346 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c06a3e-4165-428e-974c-4e498cb55fb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:53:24.524173 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c06a3e-4165-428e-974c-4e498cb55fb0 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:53:24.524463 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c06a3e-4165-428e-974c-4e498cb55fb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:53:24.524741 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c06a3e-4165-428e-974c-4e498cb55fb0 admin admin] PATH_INFO: `/v3/domains` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:53:24.525408 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c06a3e-4165-428e-974c-4e498cb55fb0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 09:53:24.525719 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c06a3e-4165-428e-974c-4e498cb55fb0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:53:24.527695 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c06a3e-4165-428e-974c-4e498cb55fb0 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:53:24.531083 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3e7e96-baef-42e4-a7ef-980e3c29a96e admin admin] RBAC: Authorizing `identity:create_grant(project_id=314b9f8df52a462b835cb5e1717e93ef, user_id=1372fd10dc1747f8957712decd4279c0, role_id=43543ce1450245af9661cb017bac17bd)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:53:24.534285 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3e7e96-baef-42e4-a7ef-980e3c29a96e admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:53:24.539240 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:53:24.540762 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 758/1518] 10.222.0.65 () {58 vars in 1153 bytes} [Thu Oct 27 09:53:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 09:53:24.545702 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c06a3e-4165-428e-974c-4e498cb55fb0 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:53:24.556383 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c06a3e-4165-428e-974c-4e498cb55fb0 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:53:24.561397 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4cbc01-9d1c-42aa-82bd-8fe12a0fd087 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:53:24.562143 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4cbc01-9d1c-42aa-82bd-8fe12a0fd087 admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:53:24.563028 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4cbc01-9d1c-42aa-82bd-8fe12a0fd087 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:53:24.563028 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4cbc01-9d1c-42aa-82bd-8fe12a0fd087 admin admin] PATH_INFO: `/v3/projects` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:53:24.563365 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4cbc01-9d1c-42aa-82bd-8fe12a0fd087 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:53:24.565358 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4cbc01-9d1c-42aa-82bd-8fe12a0fd087 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:53:24.590550 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 761/1519] 10.222.0.65 () {60 vars in 1483 bytes} [Thu Oct 27 09:53:24 2022] PUT /identity/v3/projects/314b9f8df52a462b835cb5e1717e93ef/users/1372fd10dc1747f8957712decd4279c0/roles/43543ce1450245af9661cb017bac17bd => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 09:53:24.603061 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e4c75a-c84e-4311-b51d-ff3e4992e386 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:53:24.603349 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e4c75a-c84e-4311-b51d-ff3e4992e386 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:53:24.603628 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e4c75a-c84e-4311-b51d-ff3e4992e386 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:53:24.632305 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-36e4c75a-c84e-4311-b51d-ff3e4992e386 None None] MFA Rules not processed for user `1372fd10dc1747f8957712decd4279c0`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:53:24.633877 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-36e4c75a-c84e-4311-b51d-ff3e4992e386 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:53:24.650987 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 759/1520] 10.222.0.65 () {60 vars in 1153 bytes} [Thu Oct 27 09:53:24 2022] POST /identity/v3/projects => generated 383 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 09:53:24.652028 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4cbc01-9d1c-42aa-82bd-8fe12a0fd087 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:53:24.703313 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 762/1521] 10.222.0.65 () {58 vars in 958 bytes} [Thu Oct 27 09:53:24 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 09:53:24.708491 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e4c75a-c84e-4311-b51d-ff3e4992e386 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:53:24.727708 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4cbc01-9d1c-42aa-82bd-8fe12a0fd087 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:53:24.732988 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d93c68-d097-4218-bb0e-3675bdf29ec4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:53:24.733655 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d93c68-d097-4218-bb0e-3675bdf29ec4 admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:53:24.733940 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d93c68-d097-4218-bb0e-3675bdf29ec4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:53:24.734216 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d93c68-d097-4218-bb0e-3675bdf29ec4 admin admin] PATH_INFO: `/v3/users` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:53:24.734876 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d93c68-d097-4218-bb0e-3675bdf29ec4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:53:24.736791 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d93c68-d097-4218-bb0e-3675bdf29ec4 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:53:24.786891 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e4c75a-c84e-4311-b51d-ff3e4992e386 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:53:24.791763 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e17b538-a31d-464c-9b85-d66d858e6e82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:53:24.792379 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e17b538-a31d-464c-9b85-d66d858e6e82 admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:53:24.792662 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e17b538-a31d-464c-9b85-d66d858e6e82 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:53:24.792937 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e17b538-a31d-464c-9b85-d66d858e6e82 admin admin] PATH_INFO: `/v3/projects` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:53:24.793574 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e17b538-a31d-464c-9b85-d66d858e6e82 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:53:24.795549 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e17b538-a31d-464c-9b85-d66d858e6e82 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:53:24.844015 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 760/1522] 10.222.0.65 () {60 vars in 1144 bytes} [Thu Oct 27 09:53:24 2022] POST /identity/v3/users => generated 292 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 09:53:24.847611 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d93c68-d097-4218-bb0e-3675bdf29ec4 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:53:24.859937 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d93c68-d097-4218-bb0e-3675bdf29ec4 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:53:24.865509 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2742afc1-6791-4826-99c3-3ac4151eef63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:53:24.867351 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2742afc1-6791-4826-99c3-3ac4151eef63 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:53:24.867702 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2742afc1-6791-4826-99c3-3ac4151eef63 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:53:24.868046 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2742afc1-6791-4826-99c3-3ac4151eef63 admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:53:24.868762 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2742afc1-6791-4826-99c3-3ac4151eef63 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:53:24.870670 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2742afc1-6791-4826-99c3-3ac4151eef63 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:53:24.884077 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 761/1523] 10.222.0.65 () {58 vars in 1122 bytes} [Thu Oct 27 09:53:24 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 09:53:24.888201 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2742afc1-6791-4826-99c3-3ac4151eef63 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:53:24.898785 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2742afc1-6791-4826-99c3-3ac4151eef63 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:53:24.909149 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a67215-0b4d-448b-9d82-5154dc709080 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:53:24.909754 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a67215-0b4d-448b-9d82-5154dc709080 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:53:24.910046 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a67215-0b4d-448b-9d82-5154dc709080 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:53:24.910323 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a67215-0b4d-448b-9d82-5154dc709080 admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:53:24.912685 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a67215-0b4d-448b-9d82-5154dc709080 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:53:24.914469 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a67215-0b4d-448b-9d82-5154dc709080 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:53:24.926085 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 762/1524] 10.222.0.65 () {58 vars in 1122 bytes} [Thu Oct 27 09:53:24 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 09:53:24.931781 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a67215-0b4d-448b-9d82-5154dc709080 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:53:24.943611 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a67215-0b4d-448b-9d82-5154dc709080 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:53:24.952684 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c4dc23-4984-48af-8d68-83fb4c386a49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:53:24.953374 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c4dc23-4984-48af-8d68-83fb4c386a49 admin admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:53:24.953660 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c4dc23-4984-48af-8d68-83fb4c386a49 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:53:24.958091 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c4dc23-4984-48af-8d68-83fb4c386a49 admin admin] PATH_INFO: `/v3/projects/608f114ae16e426bb4e286a9a68d244e/users/78ba1df2eaa44a7986c680c4ebaec43a/roles/43543ce1450245af9661cb017bac17bd` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:53:24.974949 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c4dc23-4984-48af-8d68-83fb4c386a49 admin admin] RBAC: Authorizing `identity:create_grant(project_id=608f114ae16e426bb4e286a9a68d244e, user_id=78ba1df2eaa44a7986c680c4ebaec43a, role_id=43543ce1450245af9661cb017bac17bd)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:53:24.978400 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c4dc23-4984-48af-8d68-83fb4c386a49 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:53:24.998010 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 763/1525] 10.222.0.65 () {60 vars in 1153 bytes} [Thu Oct 27 09:53:24 2022] POST /identity/v3/projects => generated 367 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 09:53:25.001965 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e17b538-a31d-464c-9b85-d66d858e6e82 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:53:25.090317 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 763/1526] 10.222.0.65 () {60 vars in 1483 bytes} [Thu Oct 27 09:53:24 2022] PUT /identity/v3/projects/608f114ae16e426bb4e286a9a68d244e/users/78ba1df2eaa44a7986c680c4ebaec43a/roles/43543ce1450245af9661cb017bac17bd => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 09:53:25.095652 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e17b538-a31d-464c-9b85-d66d858e6e82 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:53:25.100306 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602ced08-f187-4150-b781-29b46a043237 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:53:25.101339 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602ced08-f187-4150-b781-29b46a043237 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:53:25.102005 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602ced08-f187-4150-b781-29b46a043237 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:53:25.140348 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-602ced08-f187-4150-b781-29b46a043237 None None] MFA Rules not processed for user `78ba1df2eaa44a7986c680c4ebaec43a`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:53:25.141875 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-602ced08-f187-4150-b781-29b46a043237 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:53:25.230250 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478d2a0b-1da2-4c8a-9435-5c00f3998a70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:53:25.233314 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 764/1527] 10.222.0.65 () {58 vars in 958 bytes} [Thu Oct 27 09:53:25 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 09:53:25.235631 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478d2a0b-1da2-4c8a-9435-5c00f3998a70 admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:53:25.235631 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478d2a0b-1da2-4c8a-9435-5c00f3998a70 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:53:25.235970 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478d2a0b-1da2-4c8a-9435-5c00f3998a70 admin admin] PATH_INFO: `/v3/users` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:53:25.237802 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602ced08-f187-4150-b781-29b46a043237 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:53:25.238945 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478d2a0b-1da2-4c8a-9435-5c00f3998a70 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:53:25.243451 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478d2a0b-1da2-4c8a-9435-5c00f3998a70 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:53:25.253285 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602ced08-f187-4150-b781-29b46a043237 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:53:25.259490 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfaa960-b5d7-40c3-b85c-067aca9adf45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:53:25.260329 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfaa960-b5d7-40c3-b85c-067aca9adf45 admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:53:25.260861 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfaa960-b5d7-40c3-b85c-067aca9adf45 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:53:25.265626 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfaa960-b5d7-40c3-b85c-067aca9adf45 admin admin] PATH_INFO: `/v3/projects` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:53:25.265626 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfaa960-b5d7-40c3-b85c-067aca9adf45 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:53:25.265626 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfaa960-b5d7-40c3-b85c-067aca9adf45 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:53:25.365958 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 764/1528] 10.222.0.65 () {60 vars in 1144 bytes} [Thu Oct 27 09:53:25 2022] POST /identity/v3/users => generated 290 bytes in 364 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 09:53:25.371021 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478d2a0b-1da2-4c8a-9435-5c00f3998a70 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:53:25.382032 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478d2a0b-1da2-4c8a-9435-5c00f3998a70 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:53:25.387235 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948e885f-c15d-49a7-b5b7-750e5947bac4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:53:25.387842 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948e885f-c15d-49a7-b5b7-750e5947bac4 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:53:25.388121 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948e885f-c15d-49a7-b5b7-750e5947bac4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:53:25.388414 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948e885f-c15d-49a7-b5b7-750e5947bac4 admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:53:25.389053 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948e885f-c15d-49a7-b5b7-750e5947bac4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:53:25.390758 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948e885f-c15d-49a7-b5b7-750e5947bac4 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:53:25.403098 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 765/1529] 10.222.0.65 () {58 vars in 1122 bytes} [Thu Oct 27 09:53:25 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 09:53:25.409243 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948e885f-c15d-49a7-b5b7-750e5947bac4 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:53:25.421211 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948e885f-c15d-49a7-b5b7-750e5947bac4 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:53:25.426087 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83da89b1-ae6c-4476-b0c2-b34c2b17b074 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:53:25.426785 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83da89b1-ae6c-4476-b0c2-b34c2b17b074 admin admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:53:25.427074 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83da89b1-ae6c-4476-b0c2-b34c2b17b074 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:53:25.427356 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83da89b1-ae6c-4476-b0c2-b34c2b17b074 admin admin] PATH_INFO: `/v3/projects/7d9085fb7bf040238dad59135705daef/users/7925fdd0b6bd4854a8eab07674d7aa21/roles/6ad17b9f9dea4b66ab2da3677d7e715d` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:53:25.437762 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 765/1530] 10.222.0.65 () {60 vars in 1153 bytes} [Thu Oct 27 09:53:25 2022] POST /identity/v3/projects => generated 383 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 09:53:25.441990 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfaa960-b5d7-40c3-b85c-067aca9adf45 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:53:25.446577 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83da89b1-ae6c-4476-b0c2-b34c2b17b074 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7d9085fb7bf040238dad59135705daef, user_id=7925fdd0b6bd4854a8eab07674d7aa21, role_id=6ad17b9f9dea4b66ab2da3677d7e715d)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:53:25.449422 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83da89b1-ae6c-4476-b0c2-b34c2b17b074 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:53:25.456832 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:53:25.550822 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 766/1531] 10.222.0.65 () {60 vars in 1483 bytes} [Thu Oct 27 09:53:25 2022] PUT /identity/v3/projects/7d9085fb7bf040238dad59135705daef/users/7925fdd0b6bd4854a8eab07674d7aa21/roles/6ad17b9f9dea4b66ab2da3677d7e715d => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 09:53:25.554718 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83da89b1-ae6c-4476-b0c2-b34c2b17b074 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:53:25.634226 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83da89b1-ae6c-4476-b0c2-b34c2b17b074 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:53:25.639748 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a2e738-523d-49e8-a0fe-445963baddf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:53:25.640363 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a2e738-523d-49e8-a0fe-445963baddf6 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:53:25.640640 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a2e738-523d-49e8-a0fe-445963baddf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:53:25.640911 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a2e738-523d-49e8-a0fe-445963baddf6 admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:53:25.641557 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a2e738-523d-49e8-a0fe-445963baddf6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:53:25.643261 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a2e738-523d-49e8-a0fe-445963baddf6 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:53:25.647093 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfaa960-b5d7-40c3-b85c-067aca9adf45 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:53:25.652500 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bbc467-2e27-4507-a0ad-1d20c2c2c64d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:53:25.653109 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bbc467-2e27-4507-a0ad-1d20c2c2c64d admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:53:25.653387 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bbc467-2e27-4507-a0ad-1d20c2c2c64d admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:53:25.653657 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bbc467-2e27-4507-a0ad-1d20c2c2c64d admin admin] PATH_INFO: `/v3/users` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:53:25.654284 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39bbc467-2e27-4507-a0ad-1d20c2c2c64d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:53:25.654831 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 767/1532] 10.222.0.65 () {58 vars in 1122 bytes} [Thu Oct 27 09:53:25 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 09:53:25.657051 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a2e738-523d-49e8-a0fe-445963baddf6 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:53:25.657245 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39bbc467-2e27-4507-a0ad-1d20c2c2c64d admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:53:25.660437 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-c8a2e738-523d-49e8-a0fe-445963baddf6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:53:25.722603 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a2e738-523d-49e8-a0fe-445963baddf6 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:53:25.727120 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14c36d5-7187-4d66-a48e-5952600b414a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8e5d5f04c4741bb86ca4a0f667d4ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc2e3a7a1bcc480891c0b433291c00b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:53:25.727772 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14c36d5-7187-4d66-a48e-5952600b414a service cinder] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:53:25.728056 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14c36d5-7187-4d66-a48e-5952600b414a service cinder] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:53:25.728330 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14c36d5-7187-4d66-a48e-5952600b414a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:53:25.730272 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-d14c36d5-7187-4d66-a48e-5952600b414a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:53:25.750226 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 766/1533] 10.222.0.65 () {60 vars in 1144 bytes} [Thu Oct 27 09:53:25 2022] POST /identity/v3/users => generated 298 bytes in 309 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 09:53:25.751134 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bbc467-2e27-4507-a0ad-1d20c2c2c64d admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:53:25.762449 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bbc467-2e27-4507-a0ad-1d20c2c2c64d admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:53:25.769908 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3af2494-0285-4e1b-a5cb-06846c835e78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:53:25.770628 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3af2494-0285-4e1b-a5cb-06846c835e78 admin admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:53:25.770920 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3af2494-0285-4e1b-a5cb-06846c835e78 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:53:25.771203 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3af2494-0285-4e1b-a5cb-06846c835e78 admin admin] PATH_INFO: `/v3/projects/7d9085fb7bf040238dad59135705daef/users/7925fdd0b6bd4854a8eab07674d7aa21/roles/6ad17b9f9dea4b66ab2da3677d7e715d` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:53:25.776172 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3af2494-0285-4e1b-a5cb-06846c835e78 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7d9085fb7bf040238dad59135705daef, user_id=7925fdd0b6bd4854a8eab07674d7aa21, role_id=6ad17b9f9dea4b66ab2da3677d7e715d)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:53:25.779268 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3af2494-0285-4e1b-a5cb-06846c835e78 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:53:25.792972 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 767/1534] 10.222.0.65 () {60 vars in 1483 bytes} [Thu Oct 27 09:53:25 2022] PUT /identity/v3/projects/7d9085fb7bf040238dad59135705daef/users/7925fdd0b6bd4854a8eab07674d7aa21/roles/6ad17b9f9dea4b66ab2da3677d7e715d => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 09:53:25.795902 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3af2494-0285-4e1b-a5cb-06846c835e78 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:53:25.809255 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14c36d5-7187-4d66-a48e-5952600b414a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:53:25.811922 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14c36d5-7187-4d66-a48e-5952600b414a service cinder] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:53:25.824124 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 768/1535] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Oct 27 09:53:25 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 09:53:25.833182 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc95cb6a-ac98-4879-b882-20537aaf3bfe None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:53:25.833545 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc95cb6a-ac98-4879-b882-20537aaf3bfe None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:53:25.833851 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc95cb6a-ac98-4879-b882-20537aaf3bfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:53:25.885968 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-bc95cb6a-ac98-4879-b882-20537aaf3bfe None None] MFA Rules not processed for user `7925fdd0b6bd4854a8eab07674d7aa21`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:53:25.886348 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3af2494-0285-4e1b-a5cb-06846c835e78 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:53:25.887313 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-bc95cb6a-ac98-4879-b882-20537aaf3bfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:53:25.891655 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8cb908-20ec-4bec-b91d-bd844f122692 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:53:25.892366 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8cb908-20ec-4bec-b91d-bd844f122692 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:53:25.892720 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8cb908-20ec-4bec-b91d-bd844f122692 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:53:25.893075 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8cb908-20ec-4bec-b91d-bd844f122692 admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:53:25.893806 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8cb908-20ec-4bec-b91d-bd844f122692 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:53:25.895654 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8cb908-20ec-4bec-b91d-bd844f122692 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:53:25.909597 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 768/1536] 10.222.0.65 () {58 vars in 1122 bytes} [Thu Oct 27 09:53:25 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 09:53:25.914454 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8cb908-20ec-4bec-b91d-bd844f122692 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:53:25.930310 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8cb908-20ec-4bec-b91d-bd844f122692 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:53:25.938697 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a215c4-4be1-49bf-93ee-62ecdf71d4f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:53:25.938697 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a215c4-4be1-49bf-93ee-62ecdf71d4f4 admin admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:53:25.938697 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a215c4-4be1-49bf-93ee-62ecdf71d4f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:53:25.939249 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a215c4-4be1-49bf-93ee-62ecdf71d4f4 admin admin] PATH_INFO: `/v3/projects/33cb8fff022f47a5a327d5ff0e6686d0/users/d4b26f55769042cfa8a6b5523747f76a/roles/6ad17b9f9dea4b66ab2da3677d7e715d` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:53:25.956098 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a215c4-4be1-49bf-93ee-62ecdf71d4f4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=33cb8fff022f47a5a327d5ff0e6686d0, user_id=d4b26f55769042cfa8a6b5523747f76a, role_id=6ad17b9f9dea4b66ab2da3677d7e715d)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:53:25.958975 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a215c4-4be1-49bf-93ee-62ecdf71d4f4 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:53:25.975684 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 769/1537] 10.222.0.65 () {58 vars in 958 bytes} [Thu Oct 27 09:53:25 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 09:53:25.987542 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc95cb6a-ac98-4879-b882-20537aaf3bfe None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:53:25.988935 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-bc95cb6a-ac98-4879-b882-20537aaf3bfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:53:26.047078 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc95cb6a-ac98-4879-b882-20537aaf3bfe None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:53:26.050779 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbeaa64-f47f-4469-9784-106b0f4d38be service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8e5d5f04c4741bb86ca4a0f667d4ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc2e3a7a1bcc480891c0b433291c00b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:53:26.051385 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbeaa64-f47f-4469-9784-106b0f4d38be service cinder] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:53:26.051665 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbeaa64-f47f-4469-9784-106b0f4d38be service cinder] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:53:26.051974 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbeaa64-f47f-4469-9784-106b0f4d38be service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:53:26.061301 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbeaa64-f47f-4469-9784-106b0f4d38be service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:53:26.062885 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbeaa64-f47f-4469-9784-106b0f4d38be service cinder] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:53:26.072935 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 770/1538] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Oct 27 09:53:25 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 09:53:26.079637 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 769/1539] 10.222.0.65 () {60 vars in 1483 bytes} [Thu Oct 27 09:53:25 2022] PUT /identity/v3/projects/33cb8fff022f47a5a327d5ff0e6686d0/users/d4b26f55769042cfa8a6b5523747f76a/roles/6ad17b9f9dea4b66ab2da3677d7e715d => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 09:53:26.083586 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbeaa64-f47f-4469-9784-106b0f4d38be service cinder] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:53:26.101941 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbeaa64-f47f-4469-9784-106b0f4d38be service cinder] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:53:26.136424 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:53:26.164618 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6028ef5-c142-4900-b3b9-f2c0c86fea77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:53:26.165284 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6028ef5-c142-4900-b3b9-f2c0c86fea77 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:53:26.165633 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6028ef5-c142-4900-b3b9-f2c0c86fea77 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:53:26.165972 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6028ef5-c142-4900-b3b9-f2c0c86fea77 admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:53:26.166721 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6028ef5-c142-4900-b3b9-f2c0c86fea77 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:53:26.168596 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6028ef5-c142-4900-b3b9-f2c0c86fea77 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:53:26.187921 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 771/1540] 10.222.0.65 () {58 vars in 1122 bytes} [Thu Oct 27 09:53:26 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 09:53:26.188056 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a215c4-4be1-49bf-93ee-62ecdf71d4f4 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:53:26.198912 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a215c4-4be1-49bf-93ee-62ecdf71d4f4 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:53:26.211798 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6dde5c6-23f2-4369-a7df-57a8a7c9519a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:53:26.213203 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dde5c6-23f2-4369-a7df-57a8a7c9519a admin admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:53:26.213203 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dde5c6-23f2-4369-a7df-57a8a7c9519a admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:53:26.213203 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dde5c6-23f2-4369-a7df-57a8a7c9519a admin admin] PATH_INFO: `/v3/projects/33cb8fff022f47a5a327d5ff0e6686d0/users/d4b26f55769042cfa8a6b5523747f76a/roles/6ad17b9f9dea4b66ab2da3677d7e715d` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:53:26.216780 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6dde5c6-23f2-4369-a7df-57a8a7c9519a admin admin] RBAC: Authorizing `identity:create_grant(project_id=33cb8fff022f47a5a327d5ff0e6686d0, user_id=d4b26f55769042cfa8a6b5523747f76a, role_id=6ad17b9f9dea4b66ab2da3677d7e715d)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:53:26.219071 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6dde5c6-23f2-4369-a7df-57a8a7c9519a admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:53:26.232684 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 770/1541] 10.222.0.65 () {60 vars in 1483 bytes} [Thu Oct 27 09:53:26 2022] PUT /identity/v3/projects/33cb8fff022f47a5a327d5ff0e6686d0/users/d4b26f55769042cfa8a6b5523747f76a/roles/6ad17b9f9dea4b66ab2da3677d7e715d => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 09:53:26.244291 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517d5e62-ed79-41ab-8c10-4a6bd7e58015 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:53:26.244699 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517d5e62-ed79-41ab-8c10-4a6bd7e58015 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:53:26.245216 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517d5e62-ed79-41ab-8c10-4a6bd7e58015 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:53:26.295814 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-517d5e62-ed79-41ab-8c10-4a6bd7e58015 None None] MFA Rules not processed for user `d4b26f55769042cfa8a6b5523747f76a`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:53:26.297143 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-517d5e62-ed79-41ab-8c10-4a6bd7e58015 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:53:26.305866 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:53:26.349279 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6dde5c6-23f2-4369-a7df-57a8a7c9519a admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:53:26.439692 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 772/1542] 10.222.0.65 () {58 vars in 958 bytes} [Thu Oct 27 09:53:26 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 09:53:26.468073 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6dde5c6-23f2-4369-a7df-57a8a7c9519a admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:53:26.473258 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8362baae-e2d2-4ba0-90c8-fc20a7d2c68b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8e5d5f04c4741bb86ca4a0f667d4ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc2e3a7a1bcc480891c0b433291c00b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:53:26.473881 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8362baae-e2d2-4ba0-90c8-fc20a7d2c68b service cinder] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:53:26.474186 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8362baae-e2d2-4ba0-90c8-fc20a7d2c68b service cinder] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:53:26.475461 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8362baae-e2d2-4ba0-90c8-fc20a7d2c68b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:53:26.538821 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8362baae-e2d2-4ba0-90c8-fc20a7d2c68b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:53:26.540402 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8362baae-e2d2-4ba0-90c8-fc20a7d2c68b service cinder] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:53:26.550350 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 771/1543] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Oct 27 09:53:26 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 09:53:26.595674 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517d5e62-ed79-41ab-8c10-4a6bd7e58015 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:53:26.648011 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517d5e62-ed79-41ab-8c10-4a6bd7e58015 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:53:26.648011 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7316f9f5-8c03-42a1-8863-0d58de5567f3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8e5d5f04c4741bb86ca4a0f667d4ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc2e3a7a1bcc480891c0b433291c00b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:53:26.648011 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7316f9f5-8c03-42a1-8863-0d58de5567f3 service cinder] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:53:26.648011 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7316f9f5-8c03-42a1-8863-0d58de5567f3 service cinder] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:53:26.648283 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7316f9f5-8c03-42a1-8863-0d58de5567f3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:53:26.648283 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7316f9f5-8c03-42a1-8863-0d58de5567f3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:53:26.648283 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7316f9f5-8c03-42a1-8863-0d58de5567f3 service cinder] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:53:26.648283 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 773/1544] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Oct 27 09:53:26 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 09:53:26.867696 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8362baae-e2d2-4ba0-90c8-fc20a7d2c68b service cinder] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:53:26.876060 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8362baae-e2d2-4ba0-90c8-fc20a7d2c68b service cinder] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:53:26.880888 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebed2af6-7663-4c71-a473-7874c2a607a8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8e5d5f04c4741bb86ca4a0f667d4ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc2e3a7a1bcc480891c0b433291c00b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:53:26.883449 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebed2af6-7663-4c71-a473-7874c2a607a8 service cinder] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:53:26.883449 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebed2af6-7663-4c71-a473-7874c2a607a8 service cinder] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:53:26.883449 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebed2af6-7663-4c71-a473-7874c2a607a8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:53:26.945247 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebed2af6-7663-4c71-a473-7874c2a607a8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:53:26.946741 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebed2af6-7663-4c71-a473-7874c2a607a8 service cinder] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:53:26.956544 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 772/1545] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Oct 27 09:53:26 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 09:53:27.242906 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3c358f-1df8-4929-9575-acef32a7bf30 None None] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:53:27.243846 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3c358f-1df8-4929-9575-acef32a7bf30 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:53:27.244152 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3c358f-1df8-4929-9575-acef32a7bf30 None None] PATH_INFO: `/` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:53:27.245890 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 774/1546] 10.222.0.65 () {54 vars in 921 bytes} [Thu Oct 27 09:53:27 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 09:53:27.264954 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb6f5cc-9bc6-43d9-8bb2-2fa0b218a923 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:53:27.265774 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb6f5cc-9bc6-43d9-8bb2-2fa0b218a923 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:53:27.266134 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb6f5cc-9bc6-43d9-8bb2-2fa0b218a923 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:53:27.288936 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-bcb6f5cc-9bc6-43d9-8bb2-2fa0b218a923 None None] MFA Rules not processed for user `fd0d23ef039d4f1591a589d302ef165f`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:53:27.290249 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-bcb6f5cc-9bc6-43d9-8bb2-2fa0b218a923 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:53:27.394851 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 773/1547] 10.222.0.65 () {58 vars in 1018 bytes} [Thu Oct 27 09:53:27 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 09:53:27.578354 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3c358f-1df8-4929-9575-acef32a7bf30 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:53:27.581267 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-7a3c358f-1df8-4929-9575-acef32a7bf30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:53:27.597807 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb6f5cc-9bc6-43d9-8bb2-2fa0b218a923 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:53:27.622389 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3c358f-1df8-4929-9575-acef32a7bf30 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:53:27.630941 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5963b825-87d9-42dd-a392-acc56a8f183e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd0d23ef039d4f1591a589d302ef165f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc2e3a7a1bcc480891c0b433291c00b1', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:53:27.632695 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5963b825-87d9-42dd-a392-acc56a8f183e service nova] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:53:27.633157 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5963b825-87d9-42dd-a392-acc56a8f183e service nova] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:53:27.633609 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5963b825-87d9-42dd-a392-acc56a8f183e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:53:27.651222 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5963b825-87d9-42dd-a392-acc56a8f183e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:53:27.655211 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5963b825-87d9-42dd-a392-acc56a8f183e service nova] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:53:27.679951 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 775/1548] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Oct 27 09:53:27 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 09:53:27.693435 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb6f5cc-9bc6-43d9-8bb2-2fa0b218a923 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:53:27.699224 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb3efe1-68f6-43dc-b7f9-1f822cca3735 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:53:27.699932 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb3efe1-68f6-43dc-b7f9-1f822cca3735 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:53:27.703518 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb3efe1-68f6-43dc-b7f9-1f822cca3735 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:53:27.703518 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb3efe1-68f6-43dc-b7f9-1f822cca3735 admin admin] PATH_INFO: `/v3/users/78ba1df2eaa44a7986c680c4ebaec43a` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:53:27.703518 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb3efe1-68f6-43dc-b7f9-1f822cca3735 admin admin] RBAC: Authorizing `identity:delete_user(user_id=78ba1df2eaa44a7986c680c4ebaec43a)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:53:27.703852 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb3efe1-68f6-43dc-b7f9-1f822cca3735 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:53:27.854772 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:53:28.042141 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-5fb3efe1-68f6-43dc-b7f9-1f822cca3735 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '78ba1df2eaa44a7986c680c4ebaec43a'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:53:28.055035 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-5fb3efe1-68f6-43dc-b7f9-1f822cca3735 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '78ba1df2eaa44a7986c680c4ebaec43a'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:53:28.055753 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-5fb3efe1-68f6-43dc-b7f9-1f822cca3735 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '78ba1df2eaa44a7986c680c4ebaec43a'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:53:28.062776 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-5fb3efe1-68f6-43dc-b7f9-1f822cca3735 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '78ba1df2eaa44a7986c680c4ebaec43a'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:53:28.147346 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-5fb3efe1-68f6-43dc-b7f9-1f822cca3735 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '78ba1df2eaa44a7986c680c4ebaec43a'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:53:28.153718 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 774/1549] 10.222.0.65 () {58 vars in 1224 bytes} [Thu Oct 27 09:53:27 2022] DELETE /identity/v3/users/78ba1df2eaa44a7986c680c4ebaec43a => generated 0 bytes in 557 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 09:53:28.158990 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab93082a-16ba-474c-8c95-2ea0096b1f4e None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:53:28.165281 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab93082a-16ba-474c-8c95-2ea0096b1f4e None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:53:28.165281 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab93082a-16ba-474c-8c95-2ea0096b1f4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:53:28.179945 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-ab93082a-16ba-474c-8c95-2ea0096b1f4e None None] MFA Rules not processed for user `b5065084bf664b99bdeac46067cb0f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:53:28.181202 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-ab93082a-16ba-474c-8c95-2ea0096b1f4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:53:28.246704 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 776/1550] 10.222.0.65 () {58 vars in 958 bytes} [Thu Oct 27 09:53:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 09:53:28.256906 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb3efe1-68f6-43dc-b7f9-1f822cca3735 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:53:28.258321 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-5fb3efe1-68f6-43dc-b7f9-1f822cca3735 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:53:28.316682 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb3efe1-68f6-43dc-b7f9-1f822cca3735 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:53:28.321318 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c169051-239b-4db2-930f-9958860b76d3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6191cc41efa74f46b49022cf387f7a4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc2e3a7a1bcc480891c0b433291c00b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:53:28.321943 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c169051-239b-4db2-930f-9958860b76d3 service neutron] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:53:28.322227 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c169051-239b-4db2-930f-9958860b76d3 service neutron] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:53:28.322504 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c169051-239b-4db2-930f-9958860b76d3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:53:28.339429 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c169051-239b-4db2-930f-9958860b76d3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:53:28.341031 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c169051-239b-4db2-930f-9958860b76d3 service neutron] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:53:28.352677 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 775/1551] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Oct 27 09:53:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 09:53:28.459130 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:53:29.202180 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab93082a-16ba-474c-8c95-2ea0096b1f4e None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:53:29.203927 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-ab93082a-16ba-474c-8c95-2ea0096b1f4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:53:29.219897 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab93082a-16ba-474c-8c95-2ea0096b1f4e None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:53:29.229387 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9793f5-1e24-4968-9ffd-36414ba796d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:53:29.231917 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9793f5-1e24-4968-9ffd-36414ba796d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:53:29.232429 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9793f5-1e24-4968-9ffd-36414ba796d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:53:29.232866 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9793f5-1e24-4968-9ffd-36414ba796d5 admin admin] PATH_INFO: `/v3/projects/608f114ae16e426bb4e286a9a68d244e` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:53:29.235042 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9793f5-1e24-4968-9ffd-36414ba796d5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=608f114ae16e426bb4e286a9a68d244e)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:53:29.238696 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9793f5-1e24-4968-9ffd-36414ba796d5 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:53:29.479811 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-af9793f5-1e24-4968-9ffd-36414ba796d5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '608f114ae16e426bb4e286a9a68d244e', 'request_id': 'req-af9793f5-1e24-4968-9ffd-36414ba796d5'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:53:29.496568 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-af9793f5-1e24-4968-9ffd-36414ba796d5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '608f114ae16e426bb4e286a9a68d244e', 'request_id': 'req-af9793f5-1e24-4968-9ffd-36414ba796d5'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:53:29.617368 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-af9793f5-1e24-4968-9ffd-36414ba796d5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '608f114ae16e426bb4e286a9a68d244e', 'request_id': 'req-af9793f5-1e24-4968-9ffd-36414ba796d5'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:53:29.632361 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-af9793f5-1e24-4968-9ffd-36414ba796d5 admin admin] The token cache is being invalidate because project 608f114ae16e426bb4e286a9a68d244e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 09:53:29.632948 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-af9793f5-1e24-4968-9ffd-36414ba796d5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:53:29.633855 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-af9793f5-1e24-4968-9ffd-36414ba796d5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:53:29.637892 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 777/1552] 10.222.0.65 () {58 vars in 1233 bytes} [Thu Oct 27 09:53:29 2022] DELETE /identity/v3/projects/608f114ae16e426bb4e286a9a68d244e => generated 0 bytes in 436 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 09:53:29.641929 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c169051-239b-4db2-930f-9958860b76d3 service neutron] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:53:29.653007 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c169051-239b-4db2-930f-9958860b76d3 service neutron] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:53:29.790503 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49767bb-d745-4428-9051-d40fb275b763 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:53:29.791378 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49767bb-d745-4428-9051-d40fb275b763 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:53:29.791723 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49767bb-d745-4428-9051-d40fb275b763 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:53:29.792053 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49767bb-d745-4428-9051-d40fb275b763 admin admin] PATH_INFO: `/v3/users/d4b26f55769042cfa8a6b5523747f76a` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:53:29.793376 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49767bb-d745-4428-9051-d40fb275b763 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d4b26f55769042cfa8a6b5523747f76a)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:53:29.795626 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49767bb-d745-4428-9051-d40fb275b763 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:53:30.007243 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-f49767bb-d745-4428-9051-d40fb275b763 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd4b26f55769042cfa8a6b5523747f76a'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:53:30.023100 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-f49767bb-d745-4428-9051-d40fb275b763 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd4b26f55769042cfa8a6b5523747f76a'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:53:30.023859 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-f49767bb-d745-4428-9051-d40fb275b763 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd4b26f55769042cfa8a6b5523747f76a'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:53:30.031705 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-f49767bb-d745-4428-9051-d40fb275b763 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd4b26f55769042cfa8a6b5523747f76a'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:53:30.136986 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-f49767bb-d745-4428-9051-d40fb275b763 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd4b26f55769042cfa8a6b5523747f76a'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:53:30.148190 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 776/1553] 10.222.0.65 () {58 vars in 1224 bytes} [Thu Oct 27 09:53:29 2022] DELETE /identity/v3/users/d4b26f55769042cfa8a6b5523747f76a => generated 0 bytes in 503 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 09:53:30.857354 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9793f5-1e24-4968-9ffd-36414ba796d5 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:53:30.859772 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-af9793f5-1e24-4968-9ffd-36414ba796d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:53:30.883475 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9793f5-1e24-4968-9ffd-36414ba796d5 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:53:30.965055 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f09c88-f33f-4212-99db-80eb6f38a6ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:53:30.965938 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f09c88-f33f-4212-99db-80eb6f38a6ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:53:30.966290 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f09c88-f33f-4212-99db-80eb6f38a6ed admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:53:30.966757 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f09c88-f33f-4212-99db-80eb6f38a6ed admin admin] PATH_INFO: `/v3/projects/33cb8fff022f47a5a327d5ff0e6686d0` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:53:30.968240 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f09c88-f33f-4212-99db-80eb6f38a6ed admin admin] RBAC: Authorizing `identity:delete_project(project_id=33cb8fff022f47a5a327d5ff0e6686d0)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:53:30.970595 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f09c88-f33f-4212-99db-80eb6f38a6ed admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:53:31.165500 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-42f09c88-f33f-4212-99db-80eb6f38a6ed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '33cb8fff022f47a5a327d5ff0e6686d0', 'request_id': 'req-42f09c88-f33f-4212-99db-80eb6f38a6ed'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:53:31.172171 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-42f09c88-f33f-4212-99db-80eb6f38a6ed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '33cb8fff022f47a5a327d5ff0e6686d0', 'request_id': 'req-42f09c88-f33f-4212-99db-80eb6f38a6ed'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:53:31.282119 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-42f09c88-f33f-4212-99db-80eb6f38a6ed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '33cb8fff022f47a5a327d5ff0e6686d0', 'request_id': 'req-42f09c88-f33f-4212-99db-80eb6f38a6ed'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:53:31.303897 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-42f09c88-f33f-4212-99db-80eb6f38a6ed admin admin] The token cache is being invalidate because project 33cb8fff022f47a5a327d5ff0e6686d0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 09:53:31.304393 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-42f09c88-f33f-4212-99db-80eb6f38a6ed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:53:31.305340 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-42f09c88-f33f-4212-99db-80eb6f38a6ed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:53:31.311519 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 778/1554] 10.222.0.65 () {58 vars in 1233 bytes} [Thu Oct 27 09:53:30 2022] DELETE /identity/v3/projects/33cb8fff022f47a5a327d5ff0e6686d0 => generated 0 bytes in 461 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 09:53:31.317970 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1d2f66-0054-4bb7-8183-82d20902a709 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:53:31.318543 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1d2f66-0054-4bb7-8183-82d20902a709 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:53:31.319549 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1d2f66-0054-4bb7-8183-82d20902a709 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:53:31.369268 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-1c1d2f66-0054-4bb7-8183-82d20902a709 None None] MFA Rules not processed for user `b5065084bf664b99bdeac46067cb0f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:53:31.370751 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-1c1d2f66-0054-4bb7-8183-82d20902a709 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:53:31.499318 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 777/1555] 10.222.0.65 () {58 vars in 958 bytes} [Thu Oct 27 09:53:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 09:53:31.507646 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e071f45e-b0b5-4e55-96d1-8db65d19a4e5 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:53:31.507977 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e071f45e-b0b5-4e55-96d1-8db65d19a4e5 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:53:31.508205 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e071f45e-b0b5-4e55-96d1-8db65d19a4e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:53:31.532953 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-e071f45e-b0b5-4e55-96d1-8db65d19a4e5 None None] MFA Rules not processed for user `b5065084bf664b99bdeac46067cb0f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:53:31.538306 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-e071f45e-b0b5-4e55-96d1-8db65d19a4e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:53:31.547602 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 779/1556] 10.222.0.65 () {58 vars in 958 bytes} [Thu Oct 27 09:53:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 09:53:31.550196 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1d2f66-0054-4bb7-8183-82d20902a709 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:53:31.560375 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1d2f66-0054-4bb7-8183-82d20902a709 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:53:31.565582 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2654501a-1c09-4fc1-90b3-3fe52e78500c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:53:31.566285 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2654501a-1c09-4fc1-90b3-3fe52e78500c admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:53:31.567074 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2654501a-1c09-4fc1-90b3-3fe52e78500c admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:53:31.567074 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2654501a-1c09-4fc1-90b3-3fe52e78500c admin admin] PATH_INFO: `/v3/domains` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:53:31.567921 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2654501a-1c09-4fc1-90b3-3fe52e78500c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 09:53:31.567921 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2654501a-1c09-4fc1-90b3-3fe52e78500c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:53:31.569461 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2654501a-1c09-4fc1-90b3-3fe52e78500c admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:53:31.589569 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 778/1557] 10.222.0.65 () {58 vars in 1153 bytes} [Thu Oct 27 09:53:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 09:53:31.607896 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e071f45e-b0b5-4e55-96d1-8db65d19a4e5 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:53:31.620034 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e071f45e-b0b5-4e55-96d1-8db65d19a4e5 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:53:31.627872 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d32b39-53aa-41ca-95d0-15498a078e23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:53:31.638421 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d32b39-53aa-41ca-95d0-15498a078e23 admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:53:31.649403 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d32b39-53aa-41ca-95d0-15498a078e23 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:53:31.649880 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d32b39-53aa-41ca-95d0-15498a078e23 admin admin] PATH_INFO: `/v3/projects` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:53:31.650810 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d32b39-53aa-41ca-95d0-15498a078e23 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:53:31.652863 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d32b39-53aa-41ca-95d0-15498a078e23 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:53:31.858838 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 780/1558] 10.222.0.65 () {60 vars in 1153 bytes} [Thu Oct 27 09:53:31 2022] POST /identity/v3/projects => generated 375 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 09:53:31.862939 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2654501a-1c09-4fc1-90b3-3fe52e78500c admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:53:31.875622 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2654501a-1c09-4fc1-90b3-3fe52e78500c admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:53:31.938193 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c6b199-114e-403f-871d-2e137d62771f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:53:31.938931 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c6b199-114e-403f-871d-2e137d62771f admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:53:31.939217 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c6b199-114e-403f-871d-2e137d62771f admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:53:31.939496 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c6b199-114e-403f-871d-2e137d62771f admin admin] PATH_INFO: `/v3/users` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:53:31.940163 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c6b199-114e-403f-871d-2e137d62771f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:53:31.942097 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c6b199-114e-403f-871d-2e137d62771f admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:53:32.050222 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 779/1559] 10.222.0.65 () {60 vars in 1144 bytes} [Thu Oct 27 09:53:31 2022] POST /identity/v3/users => generated 288 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 09:53:32.055223 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d32b39-53aa-41ca-95d0-15498a078e23 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:53:32.065777 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d32b39-53aa-41ca-95d0-15498a078e23 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:53:32.071527 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1899f11b-7ced-4c49-b600-29fe74c5c358 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:53:32.072258 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1899f11b-7ced-4c49-b600-29fe74c5c358 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:53:32.089955 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1899f11b-7ced-4c49-b600-29fe74c5c358 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:53:32.090302 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1899f11b-7ced-4c49-b600-29fe74c5c358 admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:53:32.091053 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1899f11b-7ced-4c49-b600-29fe74c5c358 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:53:32.092691 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:53:32.093303 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1899f11b-7ced-4c49-b600-29fe74c5c358 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:53:32.108493 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 781/1560] 10.222.0.65 () {58 vars in 1122 bytes} [Thu Oct 27 09:53:32 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 09:53:32.112488 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c6b199-114e-403f-871d-2e137d62771f admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:53:32.124542 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c6b199-114e-403f-871d-2e137d62771f admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:53:32.129639 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beae1103-d34a-4dc7-84aa-d0487923e952 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:53:32.130286 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beae1103-d34a-4dc7-84aa-d0487923e952 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:53:32.130693 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beae1103-d34a-4dc7-84aa-d0487923e952 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:53:32.130861 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beae1103-d34a-4dc7-84aa-d0487923e952 admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:53:32.132191 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beae1103-d34a-4dc7-84aa-d0487923e952 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:53:32.133678 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beae1103-d34a-4dc7-84aa-d0487923e952 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:53:32.144863 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 780/1561] 10.222.0.65 () {58 vars in 1122 bytes} [Thu Oct 27 09:53:32 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 09:53:32.150848 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1899f11b-7ced-4c49-b600-29fe74c5c358 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:53:32.161908 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1899f11b-7ced-4c49-b600-29fe74c5c358 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:53:32.167255 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2c95d2-2ae5-4b71-8850-4f31c4e08302 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:53:32.168200 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2c95d2-2ae5-4b71-8850-4f31c4e08302 admin admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:53:32.168794 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2c95d2-2ae5-4b71-8850-4f31c4e08302 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:53:32.169099 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2c95d2-2ae5-4b71-8850-4f31c4e08302 admin admin] PATH_INFO: `/v3/projects/7cf647f7c8fb4b31b577fbafa32e3808/users/74902827ee10461b8630727739b9e65c/roles/43543ce1450245af9661cb017bac17bd` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:53:32.186545 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2c95d2-2ae5-4b71-8850-4f31c4e08302 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7cf647f7c8fb4b31b577fbafa32e3808, user_id=74902827ee10461b8630727739b9e65c, role_id=43543ce1450245af9661cb017bac17bd)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:53:32.189256 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2c95d2-2ae5-4b71-8850-4f31c4e08302 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:53:32.267726 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:53:32.275625 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 782/1562] 10.222.0.65 () {60 vars in 1483 bytes} [Thu Oct 27 09:53:32 2022] PUT /identity/v3/projects/7cf647f7c8fb4b31b577fbafa32e3808/users/74902827ee10461b8630727739b9e65c/roles/43543ce1450245af9661cb017bac17bd => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 09:53:32.286244 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d77147-b6b8-4263-b2d9-f450d9aad276 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:53:32.286613 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d77147-b6b8-4263-b2d9-f450d9aad276 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:53:32.286898 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d77147-b6b8-4263-b2d9-f450d9aad276 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:53:32.317493 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-41d77147-b6b8-4263-b2d9-f450d9aad276 None None] MFA Rules not processed for user `74902827ee10461b8630727739b9e65c`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:53:32.318878 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-41d77147-b6b8-4263-b2d9-f450d9aad276 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:53:32.392377 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 781/1563] 10.222.0.65 () {58 vars in 958 bytes} [Thu Oct 27 09:53:32 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 09:53:32.404742 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2c95d2-2ae5-4b71-8850-4f31c4e08302 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:53:32.407463 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-de2c95d2-2ae5-4b71-8850-4f31c4e08302 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:53:32.470294 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2c95d2-2ae5-4b71-8850-4f31c4e08302 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:53:32.474023 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e50adff-7576-4190-ab32-5444560aeb7b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8e5d5f04c4741bb86ca4a0f667d4ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc2e3a7a1bcc480891c0b433291c00b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:53:32.474683 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e50adff-7576-4190-ab32-5444560aeb7b service cinder] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:53:32.475723 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e50adff-7576-4190-ab32-5444560aeb7b service cinder] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:53:32.476195 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e50adff-7576-4190-ab32-5444560aeb7b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:53:32.485407 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e50adff-7576-4190-ab32-5444560aeb7b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:53:32.486938 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e50adff-7576-4190-ab32-5444560aeb7b service cinder] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:53:32.496981 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 783/1564] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Oct 27 09:53:32 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 09:53:32.628740 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d77147-b6b8-4263-b2d9-f450d9aad276 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:53:32.630143 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-41d77147-b6b8-4263-b2d9-f450d9aad276 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:53:32.731425 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d77147-b6b8-4263-b2d9-f450d9aad276 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:53:32.736650 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a2d796-fb66-41d9-bf49-9e881e556dab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:53:32.737282 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a2d796-fb66-41d9-bf49-9e881e556dab admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:53:32.737570 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a2d796-fb66-41d9-bf49-9e881e556dab admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:53:32.737849 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a2d796-fb66-41d9-bf49-9e881e556dab admin admin] PATH_INFO: `/v3/users/e15c24a4572b41bda25f73d7dae2bc2d` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:53:32.739271 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a2d796-fb66-41d9-bf49-9e881e556dab admin admin] RBAC: Authorizing `identity:delete_user(user_id=e15c24a4572b41bda25f73d7dae2bc2d)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:53:32.741834 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a2d796-fb66-41d9-bf49-9e881e556dab admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:53:32.845891 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:53:33.004150 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-42a2d796-fb66-41d9-bf49-9e881e556dab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e15c24a4572b41bda25f73d7dae2bc2d'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:53:33.023238 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-42a2d796-fb66-41d9-bf49-9e881e556dab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e15c24a4572b41bda25f73d7dae2bc2d'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:53:33.024146 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-42a2d796-fb66-41d9-bf49-9e881e556dab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e15c24a4572b41bda25f73d7dae2bc2d'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:53:33.034821 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-42a2d796-fb66-41d9-bf49-9e881e556dab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e15c24a4572b41bda25f73d7dae2bc2d'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:53:33.125164 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-42a2d796-fb66-41d9-bf49-9e881e556dab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e15c24a4572b41bda25f73d7dae2bc2d'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:53:33.133764 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 782/1565] 10.222.0.65 () {58 vars in 1224 bytes} [Thu Oct 27 09:53:32 2022] DELETE /identity/v3/users/e15c24a4572b41bda25f73d7dae2bc2d => generated 0 bytes in 506 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 09:53:33.140874 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301bb36a-6b5c-4a9e-8eaa-f0409d15bce5 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:53:33.141375 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301bb36a-6b5c-4a9e-8eaa-f0409d15bce5 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:53:33.141375 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301bb36a-6b5c-4a9e-8eaa-f0409d15bce5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:53:33.161893 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-301bb36a-6b5c-4a9e-8eaa-f0409d15bce5 None None] MFA Rules not processed for user `b5065084bf664b99bdeac46067cb0f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:53:33.163824 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-301bb36a-6b5c-4a9e-8eaa-f0409d15bce5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:53:33.226474 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 784/1566] 10.222.0.65 () {58 vars in 958 bytes} [Thu Oct 27 09:53:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 09:53:33.237215 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a2d796-fb66-41d9-bf49-9e881e556dab admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:53:33.238908 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-42a2d796-fb66-41d9-bf49-9e881e556dab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:53:33.314391 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a2d796-fb66-41d9-bf49-9e881e556dab admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:53:33.318362 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2180835d-7b9b-48f4-a8a4-55aee771b333 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6191cc41efa74f46b49022cf387f7a4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc2e3a7a1bcc480891c0b433291c00b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:53:33.320179 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2180835d-7b9b-48f4-a8a4-55aee771b333 service neutron] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:53:33.320759 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2180835d-7b9b-48f4-a8a4-55aee771b333 service neutron] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:53:33.320851 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2180835d-7b9b-48f4-a8a4-55aee771b333 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:53:33.335601 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2180835d-7b9b-48f4-a8a4-55aee771b333 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:53:33.337303 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2180835d-7b9b-48f4-a8a4-55aee771b333 service neutron] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:53:33.349414 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 783/1567] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Oct 27 09:53:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 09:53:33.428049 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:53:33.994657 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301bb36a-6b5c-4a9e-8eaa-f0409d15bce5 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:53:33.996107 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-301bb36a-6b5c-4a9e-8eaa-f0409d15bce5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:53:34.011602 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301bb36a-6b5c-4a9e-8eaa-f0409d15bce5 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:53:34.016688 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffba39f-35cc-4351-887d-b715d0497f26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:53:34.017561 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffba39f-35cc-4351-887d-b715d0497f26 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:53:34.017984 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffba39f-35cc-4351-887d-b715d0497f26 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:53:34.018398 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffba39f-35cc-4351-887d-b715d0497f26 admin admin] PATH_INFO: `/v3/projects/e175c6ec10b644fb9086ee5737cce18b` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:53:34.019785 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffba39f-35cc-4351-887d-b715d0497f26 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e175c6ec10b644fb9086ee5737cce18b)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:53:34.022480 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffba39f-35cc-4351-887d-b715d0497f26 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:53:34.140136 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-bffba39f-35cc-4351-887d-b715d0497f26 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e175c6ec10b644fb9086ee5737cce18b', 'request_id': 'req-bffba39f-35cc-4351-887d-b715d0497f26'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:53:34.150126 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-bffba39f-35cc-4351-887d-b715d0497f26 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e175c6ec10b644fb9086ee5737cce18b', 'request_id': 'req-bffba39f-35cc-4351-887d-b715d0497f26'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:53:34.232273 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-bffba39f-35cc-4351-887d-b715d0497f26 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e175c6ec10b644fb9086ee5737cce18b', 'request_id': 'req-bffba39f-35cc-4351-887d-b715d0497f26'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:53:34.245317 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-bffba39f-35cc-4351-887d-b715d0497f26 admin admin] The token cache is being invalidate because project e175c6ec10b644fb9086ee5737cce18b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 09:53:34.245623 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-bffba39f-35cc-4351-887d-b715d0497f26 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:53:34.246302 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-bffba39f-35cc-4351-887d-b715d0497f26 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:53:34.248086 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 785/1568] 10.222.0.65 () {58 vars in 1233 bytes} [Thu Oct 27 09:53:33 2022] DELETE /identity/v3/projects/e175c6ec10b644fb9086ee5737cce18b => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 09:53:34.251900 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2180835d-7b9b-48f4-a8a4-55aee771b333 service neutron] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:53:34.262818 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2180835d-7b9b-48f4-a8a4-55aee771b333 service neutron] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:53:34.329122 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c31175-8d72-4bdb-9644-5643ebd065eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:53:34.329859 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c31175-8d72-4bdb-9644-5643ebd065eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:53:34.330029 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c31175-8d72-4bdb-9644-5643ebd065eb admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:53:34.330307 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c31175-8d72-4bdb-9644-5643ebd065eb admin admin] PATH_INFO: `/v3/users/95790be05de9450d86de66c3893b11e7` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:53:34.331489 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c31175-8d72-4bdb-9644-5643ebd065eb admin admin] RBAC: Authorizing `identity:delete_user(user_id=95790be05de9450d86de66c3893b11e7)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:53:34.333429 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c31175-8d72-4bdb-9644-5643ebd065eb admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:53:34.455306 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:53:34.533855 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-73c31175-8d72-4bdb-9644-5643ebd065eb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '95790be05de9450d86de66c3893b11e7'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:53:34.547469 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-73c31175-8d72-4bdb-9644-5643ebd065eb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '95790be05de9450d86de66c3893b11e7'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:53:34.548462 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-73c31175-8d72-4bdb-9644-5643ebd065eb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '95790be05de9450d86de66c3893b11e7'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:53:34.555788 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-73c31175-8d72-4bdb-9644-5643ebd065eb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '95790be05de9450d86de66c3893b11e7'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:53:34.644354 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-73c31175-8d72-4bdb-9644-5643ebd065eb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '95790be05de9450d86de66c3893b11e7'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:53:34.652237 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 784/1569] 10.222.0.65 () {58 vars in 1224 bytes} [Thu Oct 27 09:53:34 2022] DELETE /identity/v3/users/95790be05de9450d86de66c3893b11e7 => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 09:53:34.987396 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffba39f-35cc-4351-887d-b715d0497f26 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:53:34.989391 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:53:34.991003 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-bffba39f-35cc-4351-887d-b715d0497f26 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:53:35.012216 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffba39f-35cc-4351-887d-b715d0497f26 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:53:35.174155 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a485ff-d2d8-40a7-92fc-9d499dfa541e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:53:35.175624 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a485ff-d2d8-40a7-92fc-9d499dfa541e admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:53:35.176055 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a485ff-d2d8-40a7-92fc-9d499dfa541e admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:53:35.178386 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a485ff-d2d8-40a7-92fc-9d499dfa541e admin admin] PATH_INFO: `/v3/users/1372fd10dc1747f8957712decd4279c0` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:53:35.192458 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a485ff-d2d8-40a7-92fc-9d499dfa541e admin admin] RBAC: Authorizing `identity:delete_user(user_id=1372fd10dc1747f8957712decd4279c0)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:53:35.200861 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a485ff-d2d8-40a7-92fc-9d499dfa541e admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:53:35.370344 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c31175-8d72-4bdb-9644-5643ebd065eb admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:53:35.372803 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-73c31175-8d72-4bdb-9644-5643ebd065eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:53:35.388350 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c31175-8d72-4bdb-9644-5643ebd065eb admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:53:35.396630 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6a1ff4-1ab0-4953-aabe-317fe6301512 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:53:35.397320 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6a1ff4-1ab0-4953-aabe-317fe6301512 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:53:35.397973 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6a1ff4-1ab0-4953-aabe-317fe6301512 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:53:35.398637 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6a1ff4-1ab0-4953-aabe-317fe6301512 admin admin] PATH_INFO: `/v3/projects/1e71a2ac65124b1e8373eaf74ca111eb` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:53:35.403774 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6a1ff4-1ab0-4953-aabe-317fe6301512 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1e71a2ac65124b1e8373eaf74ca111eb)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:53:35.406132 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6a1ff4-1ab0-4953-aabe-317fe6301512 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:53:35.461299 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-38a485ff-d2d8-40a7-92fc-9d499dfa541e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1372fd10dc1747f8957712decd4279c0'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:53:35.461908 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-38a485ff-d2d8-40a7-92fc-9d499dfa541e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1372fd10dc1747f8957712decd4279c0'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:53:35.469915 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-38a485ff-d2d8-40a7-92fc-9d499dfa541e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1372fd10dc1747f8957712decd4279c0'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:53:35.474219 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-38a485ff-d2d8-40a7-92fc-9d499dfa541e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1372fd10dc1747f8957712decd4279c0'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:53:35.483897 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-38a485ff-d2d8-40a7-92fc-9d499dfa541e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1372fd10dc1747f8957712decd4279c0'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:53:35.510436 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-4d6a1ff4-1ab0-4953-aabe-317fe6301512 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1e71a2ac65124b1e8373eaf74ca111eb', 'request_id': 'req-4d6a1ff4-1ab0-4953-aabe-317fe6301512'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:53:35.604446 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 786/1570] 10.222.0.65 () {58 vars in 1224 bytes} [Thu Oct 27 09:53:34 2022] DELETE /identity/v3/users/1372fd10dc1747f8957712decd4279c0 => generated 0 bytes in 615 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 09:53:35.606709 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bf0da8-e740-4e4d-b709-35288fe12d24 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:53:35.606991 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bf0da8-e740-4e4d-b709-35288fe12d24 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:53:35.607431 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bf0da8-e740-4e4d-b709-35288fe12d24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:53:35.644602 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-16bf0da8-e740-4e4d-b709-35288fe12d24 None None] MFA Rules not processed for user `b5065084bf664b99bdeac46067cb0f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:53:35.646015 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-16bf0da8-e740-4e4d-b709-35288fe12d24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:53:35.708467 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-4d6a1ff4-1ab0-4953-aabe-317fe6301512 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1e71a2ac65124b1e8373eaf74ca111eb', 'request_id': 'req-4d6a1ff4-1ab0-4953-aabe-317fe6301512'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:53:35.725638 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-4d6a1ff4-1ab0-4953-aabe-317fe6301512 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1e71a2ac65124b1e8373eaf74ca111eb', 'request_id': 'req-4d6a1ff4-1ab0-4953-aabe-317fe6301512'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:53:35.740061 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-4d6a1ff4-1ab0-4953-aabe-317fe6301512 admin admin] The token cache is being invalidate because project 1e71a2ac65124b1e8373eaf74ca111eb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 09:53:35.741324 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-4d6a1ff4-1ab0-4953-aabe-317fe6301512 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:53:35.742358 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-4d6a1ff4-1ab0-4953-aabe-317fe6301512 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:53:35.744383 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 785/1571] 10.222.0.65 () {58 vars in 1233 bytes} [Thu Oct 27 09:53:35 2022] DELETE /identity/v3/projects/1e71a2ac65124b1e8373eaf74ca111eb => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 09:53:35.751103 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ec3d36-fc47-4a1f-93c0-72d0f9b53811 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:53:35.751748 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ec3d36-fc47-4a1f-93c0-72d0f9b53811 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:53:35.752229 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ec3d36-fc47-4a1f-93c0-72d0f9b53811 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:53:35.780885 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-f8ec3d36-fc47-4a1f-93c0-72d0f9b53811 None None] MFA Rules not processed for user `b5065084bf664b99bdeac46067cb0f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:53:35.782668 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-f8ec3d36-fc47-4a1f-93c0-72d0f9b53811 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:53:35.786441 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 787/1572] 10.222.0.65 () {58 vars in 958 bytes} [Thu Oct 27 09:53:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 09:53:35.798424 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bf0da8-e740-4e4d-b709-35288fe12d24 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:53:35.799981 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-16bf0da8-e740-4e4d-b709-35288fe12d24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:53:35.806994 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 786/1573] 10.222.0.65 () {58 vars in 958 bytes} [Thu Oct 27 09:53:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 09:53:35.816041 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687d887a-ea10-4b86-858e-149b3d77d792 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:53:35.816364 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687d887a-ea10-4b86-858e-149b3d77d792 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:53:35.816642 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687d887a-ea10-4b86-858e-149b3d77d792 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:53:35.838709 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-687d887a-ea10-4b86-858e-149b3d77d792 None None] MFA Rules not processed for user `b5065084bf664b99bdeac46067cb0f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:53:35.840007 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-687d887a-ea10-4b86-858e-149b3d77d792 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:53:35.858050 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 787/1574] 10.222.0.65 () {58 vars in 958 bytes} [Thu Oct 27 09:53:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 09:53:35.859249 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687d887a-ea10-4b86-858e-149b3d77d792 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:53:35.873240 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687d887a-ea10-4b86-858e-149b3d77d792 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:53:35.879168 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db3cc43-f8c9-455a-a184-730dd4508ea2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:53:35.879858 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db3cc43-f8c9-455a-a184-730dd4508ea2 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:53:35.880146 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db3cc43-f8c9-455a-a184-730dd4508ea2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:53:35.881413 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db3cc43-f8c9-455a-a184-730dd4508ea2 admin admin] PATH_INFO: `/v3/domains` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:53:35.881779 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db3cc43-f8c9-455a-a184-730dd4508ea2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 09:53:35.882151 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db3cc43-f8c9-455a-a184-730dd4508ea2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:53:35.884150 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db3cc43-f8c9-455a-a184-730dd4508ea2 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:53:35.886545 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bf0da8-e740-4e4d-b709-35288fe12d24 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:53:35.902560 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79023f7a-e393-4b0f-ad9b-fd331270405b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6191cc41efa74f46b49022cf387f7a4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc2e3a7a1bcc480891c0b433291c00b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:53:35.902560 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79023f7a-e393-4b0f-ad9b-fd331270405b service neutron] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:53:35.902560 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79023f7a-e393-4b0f-ad9b-fd331270405b service neutron] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:53:35.902560 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79023f7a-e393-4b0f-ad9b-fd331270405b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:53:35.906352 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 788/1575] 10.222.0.65 () {58 vars in 1153 bytes} [Thu Oct 27 09:53:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 09:53:35.906583 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79023f7a-e393-4b0f-ad9b-fd331270405b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:53:35.906730 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79023f7a-e393-4b0f-ad9b-fd331270405b service neutron] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:53:35.907780 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db3cc43-f8c9-455a-a184-730dd4508ea2 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:53:35.918712 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 788/1576] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Oct 27 09:53:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 09:53:35.923058 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db3cc43-f8c9-455a-a184-730dd4508ea2 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:53:35.928613 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfb4e01-31ac-44f6-a92d-69c98a0f63e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:53:35.929363 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfb4e01-31ac-44f6-a92d-69c98a0f63e2 admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:53:35.929643 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfb4e01-31ac-44f6-a92d-69c98a0f63e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:53:35.929913 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfb4e01-31ac-44f6-a92d-69c98a0f63e2 admin admin] PATH_INFO: `/v3/projects` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:53:35.930568 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfb4e01-31ac-44f6-a92d-69c98a0f63e2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:53:35.932523 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfb4e01-31ac-44f6-a92d-69c98a0f63e2 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:53:36.061903 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 789/1577] 10.222.0.65 () {60 vars in 1153 bytes} [Thu Oct 27 09:53:35 2022] POST /identity/v3/projects => generated 373 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 09:53:36.063071 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79023f7a-e393-4b0f-ad9b-fd331270405b service neutron] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:53:36.072709 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79023f7a-e393-4b0f-ad9b-fd331270405b service neutron] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:53:36.158070 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0851bfd3-e956-4a71-a36d-514fa5c271e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:53:36.158947 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0851bfd3-e956-4a71-a36d-514fa5c271e7 admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:53:36.159334 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0851bfd3-e956-4a71-a36d-514fa5c271e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:53:36.159706 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0851bfd3-e956-4a71-a36d-514fa5c271e7 admin admin] PATH_INFO: `/v3/users` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:53:36.160447 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0851bfd3-e956-4a71-a36d-514fa5c271e7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:53:36.163902 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0851bfd3-e956-4a71-a36d-514fa5c271e7 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:53:36.279145 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 789/1578] 10.222.0.65 () {60 vars in 1144 bytes} [Thu Oct 27 09:53:36 2022] POST /identity/v3/users => generated 287 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 09:53:36.281392 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfb4e01-31ac-44f6-a92d-69c98a0f63e2 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:53:36.293009 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfb4e01-31ac-44f6-a92d-69c98a0f63e2 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:53:36.297877 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87666ed-c7f4-4e0b-b673-ff8fe26c7ec6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:53:36.298721 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87666ed-c7f4-4e0b-b673-ff8fe26c7ec6 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:53:36.298994 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87666ed-c7f4-4e0b-b673-ff8fe26c7ec6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:53:36.299547 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87666ed-c7f4-4e0b-b673-ff8fe26c7ec6 admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:53:36.300386 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87666ed-c7f4-4e0b-b673-ff8fe26c7ec6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:53:36.302163 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87666ed-c7f4-4e0b-b673-ff8fe26c7ec6 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:53:36.314273 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 790/1579] 10.222.0.65 () {58 vars in 1122 bytes} [Thu Oct 27 09:53:36 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 09:53:36.318140 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0851bfd3-e956-4a71-a36d-514fa5c271e7 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:53:36.330199 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0851bfd3-e956-4a71-a36d-514fa5c271e7 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:53:36.337265 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7941d90e-91af-4747-951c-0bb2bec8a61b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:53:36.338424 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7941d90e-91af-4747-951c-0bb2bec8a61b admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:53:36.338749 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7941d90e-91af-4747-951c-0bb2bec8a61b admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:53:36.339174 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7941d90e-91af-4747-951c-0bb2bec8a61b admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:53:36.339839 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7941d90e-91af-4747-951c-0bb2bec8a61b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:53:36.341510 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7941d90e-91af-4747-951c-0bb2bec8a61b admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:53:36.353636 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 790/1580] 10.222.0.65 () {58 vars in 1122 bytes} [Thu Oct 27 09:53:36 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 09:53:36.357842 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87666ed-c7f4-4e0b-b673-ff8fe26c7ec6 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:53:36.368220 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87666ed-c7f4-4e0b-b673-ff8fe26c7ec6 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:53:36.373152 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2aaa2ef-5bf4-4010-bf51-95be7583f51b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:53:36.373843 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2aaa2ef-5bf4-4010-bf51-95be7583f51b admin admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:53:36.374215 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2aaa2ef-5bf4-4010-bf51-95be7583f51b admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:53:36.374507 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2aaa2ef-5bf4-4010-bf51-95be7583f51b admin admin] PATH_INFO: `/v3/projects/02e4205edde14df2aa5fa36f30cb84b3/users/cd2ad84166e34a6cb8facc273170e772/roles/43543ce1450245af9661cb017bac17bd` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:53:36.391074 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2aaa2ef-5bf4-4010-bf51-95be7583f51b admin admin] RBAC: Authorizing `identity:create_grant(project_id=02e4205edde14df2aa5fa36f30cb84b3, user_id=cd2ad84166e34a6cb8facc273170e772, role_id=43543ce1450245af9661cb017bac17bd)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:53:36.393806 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2aaa2ef-5bf4-4010-bf51-95be7583f51b admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:53:36.411278 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7941d90e-91af-4747-951c-0bb2bec8a61b admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:53:36.415330 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-7941d90e-91af-4747-951c-0bb2bec8a61b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:53:36.444358 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7941d90e-91af-4747-951c-0bb2bec8a61b admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:53:36.444358 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103edb64-3f40-4ea8-b320-1b7ad7edbff0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:53:36.444358 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103edb64-3f40-4ea8-b320-1b7ad7edbff0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:53:36.444358 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103edb64-3f40-4ea8-b320-1b7ad7edbff0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:53:36.445314 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103edb64-3f40-4ea8-b320-1b7ad7edbff0 admin admin] PATH_INFO: `/v3/projects/314b9f8df52a462b835cb5e1717e93ef` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:53:36.445314 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103edb64-3f40-4ea8-b320-1b7ad7edbff0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=314b9f8df52a462b835cb5e1717e93ef)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:53:36.454219 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103edb64-3f40-4ea8-b320-1b7ad7edbff0 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:53:36.491636 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 791/1581] 10.222.0.65 () {60 vars in 1483 bytes} [Thu Oct 27 09:53:36 2022] PUT /identity/v3/projects/02e4205edde14df2aa5fa36f30cb84b3/users/cd2ad84166e34a6cb8facc273170e772/roles/43543ce1450245af9661cb017bac17bd => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 09:53:36.494219 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2daec9c7-1fe6-47ba-b727-9ec80dff0ffd None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:53:36.494824 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2daec9c7-1fe6-47ba-b727-9ec80dff0ffd None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:53:36.495245 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2daec9c7-1fe6-47ba-b727-9ec80dff0ffd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:53:36.528118 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-2daec9c7-1fe6-47ba-b727-9ec80dff0ffd None None] MFA Rules not processed for user `cd2ad84166e34a6cb8facc273170e772`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:53:36.531865 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-2daec9c7-1fe6-47ba-b727-9ec80dff0ffd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:53:36.615892 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 792/1582] 10.222.0.65 () {58 vars in 958 bytes} [Thu Oct 27 09:53:36 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 09:53:36.617822 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-103edb64-3f40-4ea8-b320-1b7ad7edbff0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '314b9f8df52a462b835cb5e1717e93ef', 'request_id': 'req-103edb64-3f40-4ea8-b320-1b7ad7edbff0'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:53:36.621097 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2daec9c7-1fe6-47ba-b727-9ec80dff0ffd None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:53:36.635687 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-103edb64-3f40-4ea8-b320-1b7ad7edbff0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '314b9f8df52a462b835cb5e1717e93ef', 'request_id': 'req-103edb64-3f40-4ea8-b320-1b7ad7edbff0'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:53:36.716378 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2daec9c7-1fe6-47ba-b727-9ec80dff0ffd None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:53:36.721244 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:53:36.796506 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28dc8b5b-33a3-4d6a-8bb0-bec78f3c5c2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:53:36.796506 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dc8b5b-33a3-4d6a-8bb0-bec78f3c5c2c admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:53:36.796506 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dc8b5b-33a3-4d6a-8bb0-bec78f3c5c2c admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:53:36.796506 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dc8b5b-33a3-4d6a-8bb0-bec78f3c5c2c admin admin] PATH_INFO: `/v3/projects` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:53:36.796874 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28dc8b5b-33a3-4d6a-8bb0-bec78f3c5c2c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:53:36.796874 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28dc8b5b-33a3-4d6a-8bb0-bec78f3c5c2c admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:53:37.089112 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-103edb64-3f40-4ea8-b320-1b7ad7edbff0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '314b9f8df52a462b835cb5e1717e93ef', 'request_id': 'req-103edb64-3f40-4ea8-b320-1b7ad7edbff0'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:53:37.101738 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-103edb64-3f40-4ea8-b320-1b7ad7edbff0 admin admin] The token cache is being invalidate because project 314b9f8df52a462b835cb5e1717e93ef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 09:53:37.102077 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-103edb64-3f40-4ea8-b320-1b7ad7edbff0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:53:37.102864 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-103edb64-3f40-4ea8-b320-1b7ad7edbff0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:53:37.107463 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 791/1583] 10.222.0.65 () {58 vars in 1233 bytes} [Thu Oct 27 09:53:36 2022] DELETE /identity/v3/projects/314b9f8df52a462b835cb5e1717e93ef => generated 0 bytes in 694 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 09:53:37.108605 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103edb64-3f40-4ea8-b320-1b7ad7edbff0 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:53:37.110044 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-103edb64-3f40-4ea8-b320-1b7ad7edbff0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:53:37.124429 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103edb64-3f40-4ea8-b320-1b7ad7edbff0 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:53:37.130601 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33400b94-2833-473a-9ec4-0586d855390e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:53:37.134752 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33400b94-2833-473a-9ec4-0586d855390e admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:53:37.134752 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33400b94-2833-473a-9ec4-0586d855390e admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:53:37.134752 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33400b94-2833-473a-9ec4-0586d855390e admin admin] PATH_INFO: `/v3/users/7925fdd0b6bd4854a8eab07674d7aa21` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:53:37.134752 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33400b94-2833-473a-9ec4-0586d855390e admin admin] RBAC: Authorizing `identity:delete_user(user_id=7925fdd0b6bd4854a8eab07674d7aa21)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:53:37.136139 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33400b94-2833-473a-9ec4-0586d855390e admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:53:37.136390 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 793/1584] 10.222.0.65 () {60 vars in 1153 bytes} [Thu Oct 27 09:53:36 2022] POST /identity/v3/projects => generated 373 bytes in 520 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 09:53:37.140973 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28dc8b5b-33a3-4d6a-8bb0-bec78f3c5c2c admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:53:37.142747 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-28dc8b5b-33a3-4d6a-8bb0-bec78f3c5c2c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:53:37.223764 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28dc8b5b-33a3-4d6a-8bb0-bec78f3c5c2c admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:53:37.229286 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be7653a-a60e-4d89-9c53-1f44a56c8820 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:53:37.230081 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be7653a-a60e-4d89-9c53-1f44a56c8820 admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:53:37.230543 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be7653a-a60e-4d89-9c53-1f44a56c8820 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:53:37.230916 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be7653a-a60e-4d89-9c53-1f44a56c8820 admin admin] PATH_INFO: `/v3/users` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:53:37.231695 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be7653a-a60e-4d89-9c53-1f44a56c8820 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:53:37.233837 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be7653a-a60e-4d89-9c53-1f44a56c8820 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:53:37.344187 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 794/1585] 10.222.0.65 () {60 vars in 1144 bytes} [Thu Oct 27 09:53:37 2022] POST /identity/v3/users => generated 293 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 09:53:37.352623 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be7653a-a60e-4d89-9c53-1f44a56c8820 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:53:37.366354 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be7653a-a60e-4d89-9c53-1f44a56c8820 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:53:37.371764 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73df791f-92a1-45d8-962d-46606d187bde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:53:37.372460 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73df791f-92a1-45d8-962d-46606d187bde admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:53:37.372772 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73df791f-92a1-45d8-962d-46606d187bde admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:53:37.373043 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73df791f-92a1-45d8-962d-46606d187bde admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:53:37.373728 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73df791f-92a1-45d8-962d-46606d187bde admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:53:37.381578 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73df791f-92a1-45d8-962d-46606d187bde admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:53:37.387255 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 795/1586] 10.222.0.65 () {58 vars in 1122 bytes} [Thu Oct 27 09:53:37 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 09:53:37.391673 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73df791f-92a1-45d8-962d-46606d187bde admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:53:37.396767 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-33400b94-2833-473a-9ec4-0586d855390e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7925fdd0b6bd4854a8eab07674d7aa21'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:53:37.397505 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-33400b94-2833-473a-9ec4-0586d855390e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7925fdd0b6bd4854a8eab07674d7aa21'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:53:37.405111 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-33400b94-2833-473a-9ec4-0586d855390e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7925fdd0b6bd4854a8eab07674d7aa21'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:53:37.406032 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-33400b94-2833-473a-9ec4-0586d855390e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7925fdd0b6bd4854a8eab07674d7aa21'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:53:37.406484 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73df791f-92a1-45d8-962d-46606d187bde admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:53:37.411286 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5404eeae-de40-4d8b-ad84-5dd374ffdf78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:53:37.412476 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5404eeae-de40-4d8b-ad84-5dd374ffdf78 admin admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:53:37.412792 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5404eeae-de40-4d8b-ad84-5dd374ffdf78 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:53:37.413035 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5404eeae-de40-4d8b-ad84-5dd374ffdf78 admin admin] PATH_INFO: `/v3/projects/cd620bfa76ac454a9fdcf644551c9f24/users/3ae69108c5344f358cfb89196993240d/roles/6ad17b9f9dea4b66ab2da3677d7e715d` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:53:37.419046 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-33400b94-2833-473a-9ec4-0586d855390e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7925fdd0b6bd4854a8eab07674d7aa21'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:53:37.429388 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5404eeae-de40-4d8b-ad84-5dd374ffdf78 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cd620bfa76ac454a9fdcf644551c9f24, user_id=3ae69108c5344f358cfb89196993240d, role_id=6ad17b9f9dea4b66ab2da3677d7e715d)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:53:37.432140 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5404eeae-de40-4d8b-ad84-5dd374ffdf78 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:53:37.491467 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 796/1587] 10.222.0.65 () {60 vars in 1483 bytes} [Thu Oct 27 09:53:37 2022] PUT /identity/v3/projects/cd620bfa76ac454a9fdcf644551c9f24/users/3ae69108c5344f358cfb89196993240d/roles/6ad17b9f9dea4b66ab2da3677d7e715d => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 09:53:37.495476 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5404eeae-de40-4d8b-ad84-5dd374ffdf78 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:53:37.497297 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-5404eeae-de40-4d8b-ad84-5dd374ffdf78 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:53:37.510459 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 792/1588] 10.222.0.65 () {58 vars in 1224 bytes} [Thu Oct 27 09:53:37 2022] DELETE /identity/v3/users/7925fdd0b6bd4854a8eab07674d7aa21 => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 09:53:37.586921 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5404eeae-de40-4d8b-ad84-5dd374ffdf78 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:53:37.664044 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94143b94-e3e9-407f-9a57-c786130e9b0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:53:37.664911 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94143b94-e3e9-407f-9a57-c786130e9b0c admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:53:37.665366 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94143b94-e3e9-407f-9a57-c786130e9b0c admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:53:37.665930 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94143b94-e3e9-407f-9a57-c786130e9b0c admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:53:37.671879 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94143b94-e3e9-407f-9a57-c786130e9b0c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:53:37.674252 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94143b94-e3e9-407f-9a57-c786130e9b0c admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:53:37.684789 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:DELETE=15,keystone:SELECT=83,keystone:INSERT=2 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:53:37.694008 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 797/1589] 10.222.0.65 () {58 vars in 1122 bytes} [Thu Oct 27 09:53:37 2022] GET /identity/v3/roles => generated 1420 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 09:53:37.699177 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33400b94-2833-473a-9ec4-0586d855390e admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:53:37.718945 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33400b94-2833-473a-9ec4-0586d855390e admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:53:37.725281 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0260be0-bc25-44c9-bfe0-be7f83467a8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:53:37.726101 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0260be0-bc25-44c9-bfe0-be7f83467a8b admin admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:53:37.726491 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0260be0-bc25-44c9-bfe0-be7f83467a8b admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:53:37.726904 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0260be0-bc25-44c9-bfe0-be7f83467a8b admin admin] PATH_INFO: `/v3/projects/cd620bfa76ac454a9fdcf644551c9f24/users/3ae69108c5344f358cfb89196993240d/roles/6ad17b9f9dea4b66ab2da3677d7e715d` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:53:37.729105 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0260be0-bc25-44c9-bfe0-be7f83467a8b admin admin] RBAC: Authorizing `identity:create_grant(project_id=cd620bfa76ac454a9fdcf644551c9f24, user_id=3ae69108c5344f358cfb89196993240d, role_id=6ad17b9f9dea4b66ab2da3677d7e715d)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:53:37.732142 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0260be0-bc25-44c9-bfe0-be7f83467a8b admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:53:37.745477 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 793/1590] 10.222.0.65 () {60 vars in 1483 bytes} [Thu Oct 27 09:53:37 2022] PUT /identity/v3/projects/cd620bfa76ac454a9fdcf644551c9f24/users/3ae69108c5344f358cfb89196993240d/roles/6ad17b9f9dea4b66ab2da3677d7e715d => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 09:53:37.762329 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345fe112-cdcc-423c-a324-2be085320f17 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:53:37.762329 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345fe112-cdcc-423c-a324-2be085320f17 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:53:37.762329 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345fe112-cdcc-423c-a324-2be085320f17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:53:37.807747 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-345fe112-cdcc-423c-a324-2be085320f17 None None] MFA Rules not processed for user `3ae69108c5344f358cfb89196993240d`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:53:37.809019 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-345fe112-cdcc-423c-a324-2be085320f17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:53:37.951406 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 798/1591] 10.222.0.65 () {58 vars in 958 bytes} [Thu Oct 27 09:53:37 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 09:53:37.955309 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0260be0-bc25-44c9-bfe0-be7f83467a8b admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:53:37.962504 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-b0260be0-bc25-44c9-bfe0-be7f83467a8b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:53:38.033258 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0260be0-bc25-44c9-bfe0-be7f83467a8b admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:53:38.037840 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faef275b-0a41-44f3-b628-d62b00f40970 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8e5d5f04c4741bb86ca4a0f667d4ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc2e3a7a1bcc480891c0b433291c00b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:53:38.039109 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faef275b-0a41-44f3-b628-d62b00f40970 service cinder] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:53:38.039500 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faef275b-0a41-44f3-b628-d62b00f40970 service cinder] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:53:38.039890 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faef275b-0a41-44f3-b628-d62b00f40970 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:53:38.042003 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-faef275b-0a41-44f3-b628-d62b00f40970 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:53:38.130164 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faef275b-0a41-44f3-b628-d62b00f40970 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:53:38.132362 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faef275b-0a41-44f3-b628-d62b00f40970 service cinder] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:53:38.144027 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 794/1592] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Oct 27 09:53:37 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 09:53:38.389169 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345fe112-cdcc-423c-a324-2be085320f17 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:53:38.390820 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-345fe112-cdcc-423c-a324-2be085320f17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:53:38.412775 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:53:38.473702 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345fe112-cdcc-423c-a324-2be085320f17 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:53:38.478595 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d237d71c-62a0-4bd9-bd8c-f54cd35c8ddd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:53:38.479228 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d237d71c-62a0-4bd9-bd8c-f54cd35c8ddd admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:53:38.479512 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d237d71c-62a0-4bd9-bd8c-f54cd35c8ddd admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:53:38.479828 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d237d71c-62a0-4bd9-bd8c-f54cd35c8ddd admin admin] PATH_INFO: `/v3/projects/7d9085fb7bf040238dad59135705daef` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:53:38.480909 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d237d71c-62a0-4bd9-bd8c-f54cd35c8ddd admin admin] RBAC: Authorizing `identity:delete_project(project_id=7d9085fb7bf040238dad59135705daef)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:53:38.482896 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d237d71c-62a0-4bd9-bd8c-f54cd35c8ddd admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:53:38.634578 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-d237d71c-62a0-4bd9-bd8c-f54cd35c8ddd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7d9085fb7bf040238dad59135705daef', 'request_id': 'req-d237d71c-62a0-4bd9-bd8c-f54cd35c8ddd'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:53:38.747595 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-d237d71c-62a0-4bd9-bd8c-f54cd35c8ddd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7d9085fb7bf040238dad59135705daef', 'request_id': 'req-d237d71c-62a0-4bd9-bd8c-f54cd35c8ddd'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:53:38.754794 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-d237d71c-62a0-4bd9-bd8c-f54cd35c8ddd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7d9085fb7bf040238dad59135705daef', 'request_id': 'req-d237d71c-62a0-4bd9-bd8c-f54cd35c8ddd'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:53:38.767792 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-d237d71c-62a0-4bd9-bd8c-f54cd35c8ddd admin admin] The token cache is being invalidate because project 7d9085fb7bf040238dad59135705daef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 09:53:38.770066 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-d237d71c-62a0-4bd9-bd8c-f54cd35c8ddd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:53:38.770066 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-d237d71c-62a0-4bd9-bd8c-f54cd35c8ddd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:53:38.770267 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 799/1593] 10.222.0.65 () {58 vars in 1233 bytes} [Thu Oct 27 09:53:38 2022] DELETE /identity/v3/projects/7d9085fb7bf040238dad59135705daef => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 09:53:38.775664 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e59c5b-82e0-4c97-b866-9c7ca06a8db1 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:53:38.776200 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e59c5b-82e0-4c97-b866-9c7ca06a8db1 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:53:38.776200 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e59c5b-82e0-4c97-b866-9c7ca06a8db1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:53:38.798446 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-d9e59c5b-82e0-4c97-b866-9c7ca06a8db1 None None] MFA Rules not processed for user `b5065084bf664b99bdeac46067cb0f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:53:38.799832 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-d9e59c5b-82e0-4c97-b866-9c7ca06a8db1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:53:38.878366 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 795/1594] 10.222.0.65 () {58 vars in 958 bytes} [Thu Oct 27 09:53:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 09:53:38.888858 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c72cc5d-254e-458a-a2d7-56e80f4815d3 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:53:38.889070 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c72cc5d-254e-458a-a2d7-56e80f4815d3 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:53:38.889346 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c72cc5d-254e-458a-a2d7-56e80f4815d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:53:38.911351 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-4c72cc5d-254e-458a-a2d7-56e80f4815d3 None None] MFA Rules not processed for user `b5065084bf664b99bdeac46067cb0f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:53:38.913824 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-4c72cc5d-254e-458a-a2d7-56e80f4815d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:53:38.923867 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 800/1595] 10.222.0.65 () {58 vars in 958 bytes} [Thu Oct 27 09:53:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 09:53:38.929393 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e59c5b-82e0-4c97-b866-9c7ca06a8db1 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:53:38.948691 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e59c5b-82e0-4c97-b866-9c7ca06a8db1 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:53:38.956478 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fef1fd-4b4f-427d-a36b-4be3619796dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:53:38.957114 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fef1fd-4b4f-427d-a36b-4be3619796dc admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:53:38.957472 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fef1fd-4b4f-427d-a36b-4be3619796dc admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:53:38.957749 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fef1fd-4b4f-427d-a36b-4be3619796dc admin admin] PATH_INFO: `/v3/domains` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:53:38.958410 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01fef1fd-4b4f-427d-a36b-4be3619796dc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 09:53:38.959169 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01fef1fd-4b4f-427d-a36b-4be3619796dc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:53:38.961229 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01fef1fd-4b4f-427d-a36b-4be3619796dc admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:53:38.978691 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 796/1596] 10.222.0.65 () {58 vars in 1153 bytes} [Thu Oct 27 09:53:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 09:53:38.982266 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c72cc5d-254e-458a-a2d7-56e80f4815d3 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:53:38.992025 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c72cc5d-254e-458a-a2d7-56e80f4815d3 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:53:38.999717 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51500f66-1acc-45aa-a377-2881a945dd22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:53:39.000349 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51500f66-1acc-45aa-a377-2881a945dd22 admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:53:39.000634 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51500f66-1acc-45aa-a377-2881a945dd22 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:53:39.001622 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51500f66-1acc-45aa-a377-2881a945dd22 admin admin] PATH_INFO: `/v3/projects` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:53:39.001622 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51500f66-1acc-45aa-a377-2881a945dd22 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:53:39.003581 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51500f66-1acc-45aa-a377-2881a945dd22 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:53:39.184796 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 801/1597] 10.222.0.65 () {60 vars in 1153 bytes} [Thu Oct 27 09:53:38 2022] POST /identity/v3/projects => generated 387 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 09:53:39.185985 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fef1fd-4b4f-427d-a36b-4be3619796dc admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:53:39.201352 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fef1fd-4b4f-427d-a36b-4be3619796dc admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:53:39.290864 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce6c772-c9f9-401f-bcd1-015f3bc396b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:53:39.291541 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce6c772-c9f9-401f-bcd1-015f3bc396b2 admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:53:39.291804 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce6c772-c9f9-401f-bcd1-015f3bc396b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:53:39.292066 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce6c772-c9f9-401f-bcd1-015f3bc396b2 admin admin] PATH_INFO: `/v3/users` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:53:39.292859 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce6c772-c9f9-401f-bcd1-015f3bc396b2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:53:39.295846 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce6c772-c9f9-401f-bcd1-015f3bc396b2 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:53:39.442144 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 797/1598] 10.222.0.65 () {60 vars in 1144 bytes} [Thu Oct 27 09:53:39 2022] POST /identity/v3/users => generated 294 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 09:53:39.443970 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51500f66-1acc-45aa-a377-2881a945dd22 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:53:39.456980 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51500f66-1acc-45aa-a377-2881a945dd22 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:53:39.466007 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6327ae18-22de-4d31-bf3f-bacc89a688ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:53:39.466007 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6327ae18-22de-4d31-bf3f-bacc89a688ab admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:53:39.466007 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6327ae18-22de-4d31-bf3f-bacc89a688ab admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:53:39.466007 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6327ae18-22de-4d31-bf3f-bacc89a688ab admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:53:39.466297 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6327ae18-22de-4d31-bf3f-bacc89a688ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:53:39.466297 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6327ae18-22de-4d31-bf3f-bacc89a688ab admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:53:39.482451 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 802/1599] 10.222.0.65 () {58 vars in 1122 bytes} [Thu Oct 27 09:53:39 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 09:53:39.487328 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce6c772-c9f9-401f-bcd1-015f3bc396b2 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:53:39.499734 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce6c772-c9f9-401f-bcd1-015f3bc396b2 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:53:39.506675 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3bde5f-7bf2-48cf-850f-39fef2d9f950 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:53:39.507644 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3bde5f-7bf2-48cf-850f-39fef2d9f950 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:53:39.507644 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3bde5f-7bf2-48cf-850f-39fef2d9f950 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:53:39.514608 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3bde5f-7bf2-48cf-850f-39fef2d9f950 admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:53:39.515378 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3bde5f-7bf2-48cf-850f-39fef2d9f950 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:53:39.517128 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3bde5f-7bf2-48cf-850f-39fef2d9f950 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:53:39.533901 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 798/1600] 10.222.0.65 () {58 vars in 1122 bytes} [Thu Oct 27 09:53:39 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 09:53:39.535071 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6327ae18-22de-4d31-bf3f-bacc89a688ab admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:53:39.546284 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6327ae18-22de-4d31-bf3f-bacc89a688ab admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:53:39.551812 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c30b57-e25e-4d04-bfa3-2e47cd624db8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:53:39.553212 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c30b57-e25e-4d04-bfa3-2e47cd624db8 admin admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:53:39.553504 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c30b57-e25e-4d04-bfa3-2e47cd624db8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:53:39.553782 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c30b57-e25e-4d04-bfa3-2e47cd624db8 admin admin] PATH_INFO: `/v3/projects/615f9974a3bc4169b2464b4cfa74c330/users/a8c34d2a6bef42c1becd863fa890cf46/roles/43543ce1450245af9661cb017bac17bd` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:53:39.571110 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c30b57-e25e-4d04-bfa3-2e47cd624db8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=615f9974a3bc4169b2464b4cfa74c330, user_id=a8c34d2a6bef42c1becd863fa890cf46, role_id=43543ce1450245af9661cb017bac17bd)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:53:39.573781 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c30b57-e25e-4d04-bfa3-2e47cd624db8 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:53:39.644076 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 803/1601] 10.222.0.65 () {60 vars in 1483 bytes} [Thu Oct 27 09:53:39 2022] PUT /identity/v3/projects/615f9974a3bc4169b2464b4cfa74c330/users/a8c34d2a6bef42c1becd863fa890cf46/roles/43543ce1450245af9661cb017bac17bd => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 09:53:39.654810 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15153fd0-5970-4aca-a1f9-850e316fe334 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:53:39.655100 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15153fd0-5970-4aca-a1f9-850e316fe334 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:53:39.655644 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15153fd0-5970-4aca-a1f9-850e316fe334 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:53:39.684751 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-15153fd0-5970-4aca-a1f9-850e316fe334 None None] MFA Rules not processed for user `a8c34d2a6bef42c1becd863fa890cf46`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:53:39.685962 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-15153fd0-5970-4aca-a1f9-850e316fe334 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:53:39.762396 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 799/1602] 10.222.0.65 () {58 vars in 958 bytes} [Thu Oct 27 09:53:39 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 09:53:39.766654 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c30b57-e25e-4d04-bfa3-2e47cd624db8 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:53:39.841794 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c30b57-e25e-4d04-bfa3-2e47cd624db8 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:53:39.846533 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3e77ea-a11b-4b08-98e1-67d5dc5f627d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:53:39.847165 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3e77ea-a11b-4b08-98e1-67d5dc5f627d admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:53:39.847450 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3e77ea-a11b-4b08-98e1-67d5dc5f627d admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:53:39.847727 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3e77ea-a11b-4b08-98e1-67d5dc5f627d admin admin] PATH_INFO: `/v3/projects` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:53:39.848377 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3e77ea-a11b-4b08-98e1-67d5dc5f627d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:53:39.851121 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3e77ea-a11b-4b08-98e1-67d5dc5f627d admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:53:39.982280 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 804/1603] 10.222.0.65 () {60 vars in 1153 bytes} [Thu Oct 27 09:53:39 2022] POST /identity/v3/projects => generated 383 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 09:53:39.986016 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15153fd0-5970-4aca-a1f9-850e316fe334 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:53:39.999719 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15153fd0-5970-4aca-a1f9-850e316fe334 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:53:40.036376 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=82,keystone:DELETE=12,keystone:INSERT=6 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:53:40.104580 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1beb46-b4f0-44aa-aa5f-762272c004c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:53:40.105462 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1beb46-b4f0-44aa-aa5f-762272c004c4 admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:53:40.105921 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1beb46-b4f0-44aa-aa5f-762272c004c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:53:40.106597 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1beb46-b4f0-44aa-aa5f-762272c004c4 admin admin] PATH_INFO: `/v3/users` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:53:40.107260 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1beb46-b4f0-44aa-aa5f-762272c004c4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:53:40.109200 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1beb46-b4f0-44aa-aa5f-762272c004c4 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:53:40.203324 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 800/1604] 10.222.0.65 () {60 vars in 1144 bytes} [Thu Oct 27 09:53:39 2022] POST /identity/v3/users => generated 298 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 09:53:40.204631 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3e77ea-a11b-4b08-98e1-67d5dc5f627d admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:53:40.217141 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3e77ea-a11b-4b08-98e1-67d5dc5f627d admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:53:40.222224 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84d3e21-2c33-438f-b04a-8c0bfd3a7221 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:53:40.223147 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84d3e21-2c33-438f-b04a-8c0bfd3a7221 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:53:40.223666 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84d3e21-2c33-438f-b04a-8c0bfd3a7221 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:53:40.224005 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84d3e21-2c33-438f-b04a-8c0bfd3a7221 admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:53:40.225403 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84d3e21-2c33-438f-b04a-8c0bfd3a7221 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:53:40.227227 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84d3e21-2c33-438f-b04a-8c0bfd3a7221 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:53:40.243097 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 805/1605] 10.222.0.65 () {58 vars in 1122 bytes} [Thu Oct 27 09:53:40 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 09:53:40.247320 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1beb46-b4f0-44aa-aa5f-762272c004c4 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:53:40.257313 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1beb46-b4f0-44aa-aa5f-762272c004c4 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:53:40.261894 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a839e3-4478-4cee-aba7-60fd8bc6b5b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:53:40.262589 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a839e3-4478-4cee-aba7-60fd8bc6b5b0 admin admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:53:40.263084 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a839e3-4478-4cee-aba7-60fd8bc6b5b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:53:40.263528 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a839e3-4478-4cee-aba7-60fd8bc6b5b0 admin admin] PATH_INFO: `/v3/projects/80203b971a284c5b8e51030d0c8c0829/users/afe28d4aaf7b40d6a15b09e85fb43542/roles/6ad17b9f9dea4b66ab2da3677d7e715d` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:53:40.282592 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a839e3-4478-4cee-aba7-60fd8bc6b5b0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=80203b971a284c5b8e51030d0c8c0829, user_id=afe28d4aaf7b40d6a15b09e85fb43542, role_id=6ad17b9f9dea4b66ab2da3677d7e715d)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:53:40.286183 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a839e3-4478-4cee-aba7-60fd8bc6b5b0 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:53:40.404042 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 801/1606] 10.222.0.65 () {60 vars in 1483 bytes} [Thu Oct 27 09:53:40 2022] PUT /identity/v3/projects/80203b971a284c5b8e51030d0c8c0829/users/afe28d4aaf7b40d6a15b09e85fb43542/roles/6ad17b9f9dea4b66ab2da3677d7e715d => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 09:53:40.408816 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84d3e21-2c33-438f-b04a-8c0bfd3a7221 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:53:40.442320 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84d3e21-2c33-438f-b04a-8c0bfd3a7221 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:53:40.520270 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7b4ad0-e815-48c9-bb77-96d63a370da5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:53:40.522276 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7b4ad0-e815-48c9-bb77-96d63a370da5 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:53:40.522752 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7b4ad0-e815-48c9-bb77-96d63a370da5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:53:40.523612 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7b4ad0-e815-48c9-bb77-96d63a370da5 admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:53:40.523841 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7b4ad0-e815-48c9-bb77-96d63a370da5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:53:40.525545 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7b4ad0-e815-48c9-bb77-96d63a370da5 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:53:40.537520 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 806/1607] 10.222.0.65 () {58 vars in 1122 bytes} [Thu Oct 27 09:53:40 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 09:53:40.542628 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a839e3-4478-4cee-aba7-60fd8bc6b5b0 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:53:40.555462 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a839e3-4478-4cee-aba7-60fd8bc6b5b0 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:53:40.561892 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17409157-d69a-43b0-bb7b-c5734ab46e5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:53:40.562749 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17409157-d69a-43b0-bb7b-c5734ab46e5a admin admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:53:40.563073 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17409157-d69a-43b0-bb7b-c5734ab46e5a admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:53:40.563543 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17409157-d69a-43b0-bb7b-c5734ab46e5a admin admin] PATH_INFO: `/v3/projects/80203b971a284c5b8e51030d0c8c0829/users/afe28d4aaf7b40d6a15b09e85fb43542/roles/6ad17b9f9dea4b66ab2da3677d7e715d` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:53:40.565723 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17409157-d69a-43b0-bb7b-c5734ab46e5a admin admin] RBAC: Authorizing `identity:create_grant(project_id=80203b971a284c5b8e51030d0c8c0829, user_id=afe28d4aaf7b40d6a15b09e85fb43542, role_id=6ad17b9f9dea4b66ab2da3677d7e715d)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:53:40.569736 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17409157-d69a-43b0-bb7b-c5734ab46e5a admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:53:40.591635 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 802/1608] 10.222.0.65 () {60 vars in 1483 bytes} [Thu Oct 27 09:53:40 2022] PUT /identity/v3/projects/80203b971a284c5b8e51030d0c8c0829/users/afe28d4aaf7b40d6a15b09e85fb43542/roles/6ad17b9f9dea4b66ab2da3677d7e715d => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 09:53:40.596230 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f3dd36-7332-4e6a-a65e-4dfc194f3b31 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:53:40.596522 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f3dd36-7332-4e6a-a65e-4dfc194f3b31 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:53:40.596801 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f3dd36-7332-4e6a-a65e-4dfc194f3b31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:53:40.648963 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-c2f3dd36-7332-4e6a-a65e-4dfc194f3b31 None None] MFA Rules not processed for user `afe28d4aaf7b40d6a15b09e85fb43542`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:53:40.650576 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-c2f3dd36-7332-4e6a-a65e-4dfc194f3b31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:53:40.740152 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 807/1609] 10.222.0.65 () {58 vars in 958 bytes} [Thu Oct 27 09:53:40 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 09:53:40.751428 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17409157-d69a-43b0-bb7b-c5734ab46e5a admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:53:40.756047 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-17409157-d69a-43b0-bb7b-c5734ab46e5a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:53:40.813952 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17409157-d69a-43b0-bb7b-c5734ab46e5a admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:53:40.818853 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07114075-e711-4130-827a-d9f8ed710540 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8e5d5f04c4741bb86ca4a0f667d4ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc2e3a7a1bcc480891c0b433291c00b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:53:40.819517 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07114075-e711-4130-827a-d9f8ed710540 service cinder] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:53:40.819789 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07114075-e711-4130-827a-d9f8ed710540 service cinder] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:53:40.820105 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07114075-e711-4130-827a-d9f8ed710540 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:53:40.829888 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07114075-e711-4130-827a-d9f8ed710540 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:53:40.831429 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07114075-e711-4130-827a-d9f8ed710540 service cinder] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:53:40.841676 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 803/1610] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Oct 27 09:53:40 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 09:53:41.009545 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:53:41.494849 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f3dd36-7332-4e6a-a65e-4dfc194f3b31 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:53:41.496438 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-c2f3dd36-7332-4e6a-a65e-4dfc194f3b31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:53:41.589546 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f3dd36-7332-4e6a-a65e-4dfc194f3b31 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:53:41.594903 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed55a7a-3fb9-4ca3-ae88-5ba31b81d89c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:53:41.595662 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed55a7a-3fb9-4ca3-ae88-5ba31b81d89c admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:53:41.595989 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed55a7a-3fb9-4ca3-ae88-5ba31b81d89c admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:53:41.596269 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed55a7a-3fb9-4ca3-ae88-5ba31b81d89c admin admin] PATH_INFO: `/v3/users/cd2ad84166e34a6cb8facc273170e772` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:53:41.597475 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed55a7a-3fb9-4ca3-ae88-5ba31b81d89c admin admin] RBAC: Authorizing `identity:delete_user(user_id=cd2ad84166e34a6cb8facc273170e772)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:53:41.599753 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed55a7a-3fb9-4ca3-ae88-5ba31b81d89c admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:53:41.835537 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-4ed55a7a-3fb9-4ca3-ae88-5ba31b81d89c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cd2ad84166e34a6cb8facc273170e772'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:53:41.867156 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-4ed55a7a-3fb9-4ca3-ae88-5ba31b81d89c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cd2ad84166e34a6cb8facc273170e772'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:53:41.868650 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-4ed55a7a-3fb9-4ca3-ae88-5ba31b81d89c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cd2ad84166e34a6cb8facc273170e772'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:53:41.891319 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-4ed55a7a-3fb9-4ca3-ae88-5ba31b81d89c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cd2ad84166e34a6cb8facc273170e772'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:53:41.987886 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-4ed55a7a-3fb9-4ca3-ae88-5ba31b81d89c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cd2ad84166e34a6cb8facc273170e772'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:53:41.998831 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 808/1611] 10.222.0.65 () {58 vars in 1224 bytes} [Thu Oct 27 09:53:41 2022] DELETE /identity/v3/users/cd2ad84166e34a6cb8facc273170e772 => generated 0 bytes in 504 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 09:53:42.003598 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb292955-e40f-4a15-bc58-d32b6a094720 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:53:42.004037 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb292955-e40f-4a15-bc58-d32b6a094720 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:53:42.004327 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb292955-e40f-4a15-bc58-d32b6a094720 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:53:42.026288 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-fb292955-e40f-4a15-bc58-d32b6a094720 None None] MFA Rules not processed for user `b5065084bf664b99bdeac46067cb0f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:53:42.027731 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-fb292955-e40f-4a15-bc58-d32b6a094720 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:53:42.130838 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 804/1612] 10.222.0.65 () {58 vars in 958 bytes} [Thu Oct 27 09:53:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 09:53:42.132256 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed55a7a-3fb9-4ca3-ae88-5ba31b81d89c admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:53:42.133783 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-4ed55a7a-3fb9-4ca3-ae88-5ba31b81d89c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:53:42.198974 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed55a7a-3fb9-4ca3-ae88-5ba31b81d89c admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:53:42.204397 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78fbfe0-70ff-4246-9cd4-e560c4673de2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6191cc41efa74f46b49022cf387f7a4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc2e3a7a1bcc480891c0b433291c00b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:53:42.205319 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78fbfe0-70ff-4246-9cd4-e560c4673de2 service neutron] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:53:42.205616 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78fbfe0-70ff-4246-9cd4-e560c4673de2 service neutron] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:53:42.205909 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78fbfe0-70ff-4246-9cd4-e560c4673de2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:53:42.231296 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78fbfe0-70ff-4246-9cd4-e560c4673de2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:53:42.234024 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78fbfe0-70ff-4246-9cd4-e560c4673de2 service neutron] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:53:42.247131 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 809/1613] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Oct 27 09:53:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 09:53:42.267266 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:53:42.535535 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb292955-e40f-4a15-bc58-d32b6a094720 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:53:42.538158 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-fb292955-e40f-4a15-bc58-d32b6a094720 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:53:42.556126 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb292955-e40f-4a15-bc58-d32b6a094720 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:53:42.579056 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc66df1-0209-4093-9229-f322ec7124c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:53:42.580506 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc66df1-0209-4093-9229-f322ec7124c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:53:42.581018 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc66df1-0209-4093-9229-f322ec7124c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:53:42.581492 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc66df1-0209-4093-9229-f322ec7124c6 admin admin] PATH_INFO: `/v3/users/a8c34d2a6bef42c1becd863fa890cf46` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:53:42.583683 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc66df1-0209-4093-9229-f322ec7124c6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a8c34d2a6bef42c1becd863fa890cf46)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:53:42.586359 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc66df1-0209-4093-9229-f322ec7124c6 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:53:42.862149 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-2cc66df1-0209-4093-9229-f322ec7124c6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a8c34d2a6bef42c1becd863fa890cf46'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:53:42.863007 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-2cc66df1-0209-4093-9229-f322ec7124c6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a8c34d2a6bef42c1becd863fa890cf46'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:53:42.876370 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-2cc66df1-0209-4093-9229-f322ec7124c6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a8c34d2a6bef42c1becd863fa890cf46'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:53:42.877455 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-2cc66df1-0209-4093-9229-f322ec7124c6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a8c34d2a6bef42c1becd863fa890cf46'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:53:42.890442 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-2cc66df1-0209-4093-9229-f322ec7124c6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a8c34d2a6bef42c1becd863fa890cf46'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:53:42.917375 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:53:42.969604 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 805/1614] 10.222.0.65 () {58 vars in 1224 bytes} [Thu Oct 27 09:53:42 2022] DELETE /identity/v3/users/a8c34d2a6bef42c1becd863fa890cf46 => generated 0 bytes in 435 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 09:53:42.974189 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebea474-afeb-4ec2-ab4c-9f416bb3aeb2 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:53:42.974716 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebea474-afeb-4ec2-ab4c-9f416bb3aeb2 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:53:42.977742 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebea474-afeb-4ec2-ab4c-9f416bb3aeb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:53:42.999242 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-cebea474-afeb-4ec2-ab4c-9f416bb3aeb2 None None] MFA Rules not processed for user `b5065084bf664b99bdeac46067cb0f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:53:43.000602 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-cebea474-afeb-4ec2-ab4c-9f416bb3aeb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:53:43.078613 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 810/1615] 10.222.0.65 () {58 vars in 958 bytes} [Thu Oct 27 09:53:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 09:53:43.096996 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc66df1-0209-4093-9229-f322ec7124c6 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:53:43.098647 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-2cc66df1-0209-4093-9229-f322ec7124c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:53:43.166608 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc66df1-0209-4093-9229-f322ec7124c6 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:53:43.170378 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c0454a-17c8-49b5-b003-d7a046fa1568 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6191cc41efa74f46b49022cf387f7a4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc2e3a7a1bcc480891c0b433291c00b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:53:43.171029 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c0454a-17c8-49b5-b003-d7a046fa1568 service neutron] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:53:43.171311 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c0454a-17c8-49b5-b003-d7a046fa1568 service neutron] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:53:43.171586 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c0454a-17c8-49b5-b003-d7a046fa1568 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:53:43.181959 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c0454a-17c8-49b5-b003-d7a046fa1568 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:53:43.184402 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c0454a-17c8-49b5-b003-d7a046fa1568 service neutron] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:53:43.197877 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 806/1616] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Oct 27 09:53:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 09:53:43.261417 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:53:43.739925 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebea474-afeb-4ec2-ab4c-9f416bb3aeb2 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:53:43.744937 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-cebea474-afeb-4ec2-ab4c-9f416bb3aeb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:53:43.766875 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebea474-afeb-4ec2-ab4c-9f416bb3aeb2 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:53:43.773257 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce7097f-53f2-428e-b3be-63bc41724d05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:53:43.774391 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce7097f-53f2-428e-b3be-63bc41724d05 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:53:43.774734 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce7097f-53f2-428e-b3be-63bc41724d05 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:53:43.775342 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce7097f-53f2-428e-b3be-63bc41724d05 admin admin] PATH_INFO: `/v3/projects/615f9974a3bc4169b2464b4cfa74c330` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:53:43.776429 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce7097f-53f2-428e-b3be-63bc41724d05 admin admin] RBAC: Authorizing `identity:delete_project(project_id=615f9974a3bc4169b2464b4cfa74c330)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:53:43.778478 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce7097f-53f2-428e-b3be-63bc41724d05 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:53:43.822124 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c0454a-17c8-49b5-b003-d7a046fa1568 service neutron] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:53:43.823712 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-62c0454a-17c8-49b5-b003-d7a046fa1568 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:53:43.849143 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c0454a-17c8-49b5-b003-d7a046fa1568 service neutron] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:53:43.878209 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef628eac-8e39-44fc-99d6-42cb004f15cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:53:43.878875 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef628eac-8e39-44fc-99d6-42cb004f15cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:53:43.879156 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef628eac-8e39-44fc-99d6-42cb004f15cc admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:53:43.879484 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef628eac-8e39-44fc-99d6-42cb004f15cc admin admin] PATH_INFO: `/v3/projects/02e4205edde14df2aa5fa36f30cb84b3` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:53:43.882169 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef628eac-8e39-44fc-99d6-42cb004f15cc admin admin] RBAC: Authorizing `identity:delete_project(project_id=02e4205edde14df2aa5fa36f30cb84b3)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:53:43.888369 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef628eac-8e39-44fc-99d6-42cb004f15cc admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:53:43.931081 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-4ce7097f-53f2-428e-b3be-63bc41724d05 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '615f9974a3bc4169b2464b4cfa74c330', 'request_id': 'req-4ce7097f-53f2-428e-b3be-63bc41724d05'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:53:44.009927 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:53:44.012936 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-4ce7097f-53f2-428e-b3be-63bc41724d05 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '615f9974a3bc4169b2464b4cfa74c330', 'request_id': 'req-4ce7097f-53f2-428e-b3be-63bc41724d05'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:53:44.019607 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-4ce7097f-53f2-428e-b3be-63bc41724d05 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '615f9974a3bc4169b2464b4cfa74c330', 'request_id': 'req-4ce7097f-53f2-428e-b3be-63bc41724d05'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:53:44.045893 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-ef628eac-8e39-44fc-99d6-42cb004f15cc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '02e4205edde14df2aa5fa36f30cb84b3', 'request_id': 'req-ef628eac-8e39-44fc-99d6-42cb004f15cc'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:53:44.048082 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-4ce7097f-53f2-428e-b3be-63bc41724d05 admin admin] The token cache is being invalidate because project 615f9974a3bc4169b2464b4cfa74c330 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 09:53:44.048592 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-4ce7097f-53f2-428e-b3be-63bc41724d05 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:53:44.049931 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-4ce7097f-53f2-428e-b3be-63bc41724d05 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:53:44.055056 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 811/1617] 10.222.0.65 () {58 vars in 1233 bytes} [Thu Oct 27 09:53:43 2022] DELETE /identity/v3/projects/615f9974a3bc4169b2464b4cfa74c330 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 09:53:44.058106 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-ef628eac-8e39-44fc-99d6-42cb004f15cc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '02e4205edde14df2aa5fa36f30cb84b3', 'request_id': 'req-ef628eac-8e39-44fc-99d6-42cb004f15cc'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:53:44.060147 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce7097f-53f2-428e-b3be-63bc41724d05 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:53:44.063308 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-4ce7097f-53f2-428e-b3be-63bc41724d05 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:53:44.148631 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-ef628eac-8e39-44fc-99d6-42cb004f15cc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '02e4205edde14df2aa5fa36f30cb84b3', 'request_id': 'req-ef628eac-8e39-44fc-99d6-42cb004f15cc'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:53:44.160952 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce7097f-53f2-428e-b3be-63bc41724d05 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:53:44.163897 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-ef628eac-8e39-44fc-99d6-42cb004f15cc admin admin] The token cache is being invalidate because project 02e4205edde14df2aa5fa36f30cb84b3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 09:53:44.165677 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-ef628eac-8e39-44fc-99d6-42cb004f15cc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:53:44.165677 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-ef628eac-8e39-44fc-99d6-42cb004f15cc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:53:44.167257 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 807/1618] 10.222.0.65 () {58 vars in 1233 bytes} [Thu Oct 27 09:53:43 2022] DELETE /identity/v3/projects/02e4205edde14df2aa5fa36f30cb84b3 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 09:53:44.172948 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef628eac-8e39-44fc-99d6-42cb004f15cc admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:53:44.175763 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-ef628eac-8e39-44fc-99d6-42cb004f15cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:53:44.260490 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f506227-0f6a-4409-97e1-84f606e2425f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:53:44.261310 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f506227-0f6a-4409-97e1-84f606e2425f admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:53:44.261686 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f506227-0f6a-4409-97e1-84f606e2425f admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:53:44.262093 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f506227-0f6a-4409-97e1-84f606e2425f admin admin] PATH_INFO: `/v3/users/afe28d4aaf7b40d6a15b09e85fb43542` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:53:44.263597 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f506227-0f6a-4409-97e1-84f606e2425f admin admin] RBAC: Authorizing `identity:delete_user(user_id=afe28d4aaf7b40d6a15b09e85fb43542)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:53:44.266348 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f506227-0f6a-4409-97e1-84f606e2425f admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:53:44.272791 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef628eac-8e39-44fc-99d6-42cb004f15cc admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:53:44.285871 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b21083-2e6c-4d51-8cf3-0da3ac768655 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:53:44.286882 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b21083-2e6c-4d51-8cf3-0da3ac768655 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:53:44.287194 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b21083-2e6c-4d51-8cf3-0da3ac768655 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:53:44.287602 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b21083-2e6c-4d51-8cf3-0da3ac768655 admin admin] PATH_INFO: `/v3/users/3ae69108c5344f358cfb89196993240d` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:53:44.289121 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b21083-2e6c-4d51-8cf3-0da3ac768655 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3ae69108c5344f358cfb89196993240d)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:53:44.291555 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b21083-2e6c-4d51-8cf3-0da3ac768655 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:53:44.511249 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-8f506227-0f6a-4409-97e1-84f606e2425f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'afe28d4aaf7b40d6a15b09e85fb43542'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:53:44.526414 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:53:44.527670 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-8f506227-0f6a-4409-97e1-84f606e2425f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'afe28d4aaf7b40d6a15b09e85fb43542'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:53:44.532531 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-8f506227-0f6a-4409-97e1-84f606e2425f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'afe28d4aaf7b40d6a15b09e85fb43542'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:53:44.546446 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-11b21083-2e6c-4d51-8cf3-0da3ac768655 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3ae69108c5344f358cfb89196993240d'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:53:44.547242 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-11b21083-2e6c-4d51-8cf3-0da3ac768655 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3ae69108c5344f358cfb89196993240d'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:53:44.551738 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-8f506227-0f6a-4409-97e1-84f606e2425f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'afe28d4aaf7b40d6a15b09e85fb43542'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:53:44.561143 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-11b21083-2e6c-4d51-8cf3-0da3ac768655 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3ae69108c5344f358cfb89196993240d'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:53:44.564578 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-11b21083-2e6c-4d51-8cf3-0da3ac768655 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3ae69108c5344f358cfb89196993240d'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:53:44.575480 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-11b21083-2e6c-4d51-8cf3-0da3ac768655 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3ae69108c5344f358cfb89196993240d'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:53:44.681033 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-8f506227-0f6a-4409-97e1-84f606e2425f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'afe28d4aaf7b40d6a15b09e85fb43542'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:53:44.694728 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 812/1619] 10.222.0.65 () {58 vars in 1224 bytes} [Thu Oct 27 09:53:44 2022] DELETE /identity/v3/users/afe28d4aaf7b40d6a15b09e85fb43542 => generated 0 bytes in 632 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 09:53:44.782907 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 808/1620] 10.222.0.65 () {58 vars in 1224 bytes} [Thu Oct 27 09:53:44 2022] DELETE /identity/v3/users/3ae69108c5344f358cfb89196993240d => generated 0 bytes in 610 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 09:53:45.167861 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:53:45.469502 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f506227-0f6a-4409-97e1-84f606e2425f admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:53:45.469985 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-8f506227-0f6a-4409-97e1-84f606e2425f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:53:45.575140 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f506227-0f6a-4409-97e1-84f606e2425f admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:53:45.580404 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b21083-2e6c-4d51-8cf3-0da3ac768655 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:53:45.582270 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-11b21083-2e6c-4d51-8cf3-0da3ac768655 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:53:45.618965 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:53:45.744253 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b21083-2e6c-4d51-8cf3-0da3ac768655 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:53:45.746703 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfe598e-db95-4af6-9868-9d2aac1520c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:53:45.747606 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfe598e-db95-4af6-9868-9d2aac1520c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:53:45.747967 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfe598e-db95-4af6-9868-9d2aac1520c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:53:45.748320 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfe598e-db95-4af6-9868-9d2aac1520c0 admin admin] PATH_INFO: `/v3/projects/80203b971a284c5b8e51030d0c8c0829` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:53:45.750089 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfe598e-db95-4af6-9868-9d2aac1520c0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=80203b971a284c5b8e51030d0c8c0829)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:53:45.752627 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfe598e-db95-4af6-9868-9d2aac1520c0 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:53:45.775418 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3193130-1860-418b-a14b-99b7e78bf7f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:53:45.776279 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3193130-1860-418b-a14b-99b7e78bf7f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:53:45.776629 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3193130-1860-418b-a14b-99b7e78bf7f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:53:45.776972 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3193130-1860-418b-a14b-99b7e78bf7f5 admin admin] PATH_INFO: `/v3/projects/cd620bfa76ac454a9fdcf644551c9f24` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:53:45.782471 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3193130-1860-418b-a14b-99b7e78bf7f5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cd620bfa76ac454a9fdcf644551c9f24)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:53:45.784730 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3193130-1860-418b-a14b-99b7e78bf7f5 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:53:45.910247 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-edfe598e-db95-4af6-9868-9d2aac1520c0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '80203b971a284c5b8e51030d0c8c0829', 'request_id': 'req-edfe598e-db95-4af6-9868-9d2aac1520c0'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:53:45.944347 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-c3193130-1860-418b-a14b-99b7e78bf7f5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cd620bfa76ac454a9fdcf644551c9f24', 'request_id': 'req-c3193130-1860-418b-a14b-99b7e78bf7f5'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:53:45.954086 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-c3193130-1860-418b-a14b-99b7e78bf7f5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cd620bfa76ac454a9fdcf644551c9f24', 'request_id': 'req-c3193130-1860-418b-a14b-99b7e78bf7f5'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:53:45.976256 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-edfe598e-db95-4af6-9868-9d2aac1520c0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '80203b971a284c5b8e51030d0c8c0829', 'request_id': 'req-edfe598e-db95-4af6-9868-9d2aac1520c0'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:53:45.983303 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-edfe598e-db95-4af6-9868-9d2aac1520c0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '80203b971a284c5b8e51030d0c8c0829', 'request_id': 'req-edfe598e-db95-4af6-9868-9d2aac1520c0'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:53:45.999830 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-edfe598e-db95-4af6-9868-9d2aac1520c0 admin admin] The token cache is being invalidate because project 80203b971a284c5b8e51030d0c8c0829 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 09:53:46.000625 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-edfe598e-db95-4af6-9868-9d2aac1520c0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:53:46.001086 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-edfe598e-db95-4af6-9868-9d2aac1520c0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:53:46.006907 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 813/1621] 10.222.0.65 () {58 vars in 1233 bytes} [Thu Oct 27 09:53:45 2022] DELETE /identity/v3/projects/80203b971a284c5b8e51030d0c8c0829 => generated 0 bytes in 535 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 09:53:46.008356 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56400d24-b3a2-4438-a247-85c11d15a0f8 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:53:46.008652 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56400d24-b3a2-4438-a247-85c11d15a0f8 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:53:46.009001 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56400d24-b3a2-4438-a247-85c11d15a0f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:53:46.036458 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-56400d24-b3a2-4438-a247-85c11d15a0f8 None None] MFA Rules not processed for user `b5065084bf664b99bdeac46067cb0f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:53:46.039620 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-56400d24-b3a2-4438-a247-85c11d15a0f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:53:46.054016 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-c3193130-1860-418b-a14b-99b7e78bf7f5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cd620bfa76ac454a9fdcf644551c9f24', 'request_id': 'req-c3193130-1860-418b-a14b-99b7e78bf7f5'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:53:46.061228 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-c3193130-1860-418b-a14b-99b7e78bf7f5 admin admin] The token cache is being invalidate because project cd620bfa76ac454a9fdcf644551c9f24 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 09:53:46.061594 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-c3193130-1860-418b-a14b-99b7e78bf7f5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:53:46.062337 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-c3193130-1860-418b-a14b-99b7e78bf7f5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:53:46.065110 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 809/1622] 10.222.0.65 () {58 vars in 1233 bytes} [Thu Oct 27 09:53:45 2022] DELETE /identity/v3/projects/cd620bfa76ac454a9fdcf644551c9f24 => generated 0 bytes in 485 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 09:53:46.072712 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00fc725-8fd5-4959-9634-ea02f107a073 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:53:46.077704 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:53:46.077704 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00fc725-8fd5-4959-9634-ea02f107a073 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:53:46.077704 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00fc725-8fd5-4959-9634-ea02f107a073 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:53:46.106569 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-f00fc725-8fd5-4959-9634-ea02f107a073 None None] MFA Rules not processed for user `b5065084bf664b99bdeac46067cb0f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:53:46.107360 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-f00fc725-8fd5-4959-9634-ea02f107a073 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:53:46.123274 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 814/1623] 10.222.0.65 () {58 vars in 958 bytes} [Thu Oct 27 09:53:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 09:53:46.132733 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876d1fa2-7028-4c3d-8c98-c3e3280d2779 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:53:46.133082 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876d1fa2-7028-4c3d-8c98-c3e3280d2779 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:53:46.134406 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876d1fa2-7028-4c3d-8c98-c3e3280d2779 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:53:46.157588 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-876d1fa2-7028-4c3d-8c98-c3e3280d2779 None None] MFA Rules not processed for user `b5065084bf664b99bdeac46067cb0f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:53:46.159120 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-876d1fa2-7028-4c3d-8c98-c3e3280d2779 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:53:46.176054 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 815/1624] 10.222.0.65 () {58 vars in 958 bytes} [Thu Oct 27 09:53:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 09:53:46.177492 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876d1fa2-7028-4c3d-8c98-c3e3280d2779 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:53:46.185872 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 810/1625] 10.222.0.65 () {58 vars in 958 bytes} [Thu Oct 27 09:53:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 09:53:46.189356 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876d1fa2-7028-4c3d-8c98-c3e3280d2779 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:53:46.194052 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9491c7a-6ce9-4f1a-b276-9b7d9131fcf8 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:53:46.194475 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9491c7a-6ce9-4f1a-b276-9b7d9131fcf8 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:53:46.194794 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9491c7a-6ce9-4f1a-b276-9b7d9131fcf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:53:46.196149 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27130ed5-9096-4647-8249-4adfd1333d4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:53:46.196916 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27130ed5-9096-4647-8249-4adfd1333d4a admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:53:46.197296 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27130ed5-9096-4647-8249-4adfd1333d4a admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:53:46.198074 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27130ed5-9096-4647-8249-4adfd1333d4a admin admin] PATH_INFO: `/v3/domains` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:53:46.198605 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27130ed5-9096-4647-8249-4adfd1333d4a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 09:53:46.198907 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27130ed5-9096-4647-8249-4adfd1333d4a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:53:46.200988 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27130ed5-9096-4647-8249-4adfd1333d4a admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:53:46.222465 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 816/1626] 10.222.0.65 () {58 vars in 1153 bytes} [Thu Oct 27 09:53:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 09:53:46.224013 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27130ed5-9096-4647-8249-4adfd1333d4a admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:53:46.228848 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-b9491c7a-6ce9-4f1a-b276-9b7d9131fcf8 None None] MFA Rules not processed for user `b5065084bf664b99bdeac46067cb0f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:53:46.230497 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-b9491c7a-6ce9-4f1a-b276-9b7d9131fcf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:53:46.239083 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27130ed5-9096-4647-8249-4adfd1333d4a admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:53:46.240925 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 811/1627] 10.222.0.65 () {58 vars in 958 bytes} [Thu Oct 27 09:53:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 09:53:46.245840 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9491c7a-6ce9-4f1a-b276-9b7d9131fcf8 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:53:46.254635 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13ac49b-8259-4a59-aea9-2d7924a95fd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:53:46.254933 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13ac49b-8259-4a59-aea9-2d7924a95fd4 admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:53:46.255125 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13ac49b-8259-4a59-aea9-2d7924a95fd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:53:46.255398 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13ac49b-8259-4a59-aea9-2d7924a95fd4 admin admin] PATH_INFO: `/v3/projects` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:53:46.256071 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13ac49b-8259-4a59-aea9-2d7924a95fd4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:53:46.258462 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13ac49b-8259-4a59-aea9-2d7924a95fd4 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:53:46.301078 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9491c7a-6ce9-4f1a-b276-9b7d9131fcf8 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:53:46.301078 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115c5a14-5a25-4b9c-9671-27138baf761d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:53:46.301078 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115c5a14-5a25-4b9c-9671-27138baf761d admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:53:46.301078 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115c5a14-5a25-4b9c-9671-27138baf761d admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:53:46.301662 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115c5a14-5a25-4b9c-9671-27138baf761d admin admin] PATH_INFO: `/v3/domains` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:53:46.301662 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115c5a14-5a25-4b9c-9671-27138baf761d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 09:53:46.301662 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115c5a14-5a25-4b9c-9671-27138baf761d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:53:46.301662 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115c5a14-5a25-4b9c-9671-27138baf761d admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:53:46.311139 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 812/1628] 10.222.0.65 () {58 vars in 1153 bytes} [Thu Oct 27 09:53:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 09:53:46.316748 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115c5a14-5a25-4b9c-9671-27138baf761d admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:53:46.353987 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115c5a14-5a25-4b9c-9671-27138baf761d admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:53:46.368387 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cad24e-eb3f-4aac-8694-8ebb5df9b0cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:53:46.369025 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cad24e-eb3f-4aac-8694-8ebb5df9b0cf admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:53:46.369448 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cad24e-eb3f-4aac-8694-8ebb5df9b0cf admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:53:46.369650 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cad24e-eb3f-4aac-8694-8ebb5df9b0cf admin admin] PATH_INFO: `/v3/projects` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:53:46.370353 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9cad24e-eb3f-4aac-8694-8ebb5df9b0cf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:53:46.373389 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9cad24e-eb3f-4aac-8694-8ebb5df9b0cf admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:53:46.410713 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:53:46.451558 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 817/1629] 10.222.0.65 () {60 vars in 1153 bytes} [Thu Oct 27 09:53:46 2022] POST /identity/v3/projects => generated 377 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 09:53:46.452691 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13ac49b-8259-4a59-aea9-2d7924a95fd4 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:53:46.485511 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 813/1630] 10.222.0.65 () {60 vars in 1153 bytes} [Thu Oct 27 09:53:46 2022] POST /identity/v3/projects => generated 385 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 09:53:46.486545 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cad24e-eb3f-4aac-8694-8ebb5df9b0cf admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:53:46.641754 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13ac49b-8259-4a59-aea9-2d7924a95fd4 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:53:46.675376 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cad24e-eb3f-4aac-8694-8ebb5df9b0cf admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:53:46.681938 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2ad412-869e-4d5d-bbd9-4cf9d857b472 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:53:46.682796 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2ad412-869e-4d5d-bbd9-4cf9d857b472 admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:53:46.683084 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2ad412-869e-4d5d-bbd9-4cf9d857b472 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:53:46.684169 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2ad412-869e-4d5d-bbd9-4cf9d857b472 admin admin] PATH_INFO: `/v3/users` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:53:46.684451 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2ad412-869e-4d5d-bbd9-4cf9d857b472 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:53:46.687239 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2ad412-869e-4d5d-bbd9-4cf9d857b472 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:53:46.749874 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4255f7-9475-474f-8b9f-87ae216b152f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:53:46.750667 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4255f7-9475-474f-8b9f-87ae216b152f admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:53:46.751045 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4255f7-9475-474f-8b9f-87ae216b152f admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:53:46.751415 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4255f7-9475-474f-8b9f-87ae216b152f admin admin] PATH_INFO: `/v3/users` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:53:46.752776 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4255f7-9475-474f-8b9f-87ae216b152f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:53:46.754857 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4255f7-9475-474f-8b9f-87ae216b152f admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:53:46.888125 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 814/1631] 10.222.0.65 () {60 vars in 1144 bytes} [Thu Oct 27 09:53:46 2022] POST /identity/v3/users => generated 293 bytes in 399 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 09:53:46.889101 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2ad412-869e-4d5d-bbd9-4cf9d857b472 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:53:46.901952 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2ad412-869e-4d5d-bbd9-4cf9d857b472 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:53:46.926996 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 818/1632] 10.222.0.65 () {60 vars in 1144 bytes} [Thu Oct 27 09:53:46 2022] POST /identity/v3/users => generated 289 bytes in 474 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 09:53:46.927135 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e490af-381b-4e0b-b77c-59a631199a2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:53:46.928066 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e490af-381b-4e0b-b77c-59a631199a2e admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:53:46.928468 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e490af-381b-4e0b-b77c-59a631199a2e admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:53:46.928958 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e490af-381b-4e0b-b77c-59a631199a2e admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:53:46.930662 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4255f7-9475-474f-8b9f-87ae216b152f admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:53:46.932037 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e490af-381b-4e0b-b77c-59a631199a2e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:53:46.939769 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e490af-381b-4e0b-b77c-59a631199a2e admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:53:46.964066 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4255f7-9475-474f-8b9f-87ae216b152f admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:53:46.983072 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eeeaa66-2cae-48e0-b63f-391fe5c9f27d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:53:46.983918 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eeeaa66-2cae-48e0-b63f-391fe5c9f27d admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:53:46.984231 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eeeaa66-2cae-48e0-b63f-391fe5c9f27d admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:53:46.984613 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eeeaa66-2cae-48e0-b63f-391fe5c9f27d admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:53:46.985414 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eeeaa66-2cae-48e0-b63f-391fe5c9f27d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:53:46.985621 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 815/1633] 10.222.0.65 () {58 vars in 1122 bytes} [Thu Oct 27 09:53:46 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 09:53:46.986771 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e490af-381b-4e0b-b77c-59a631199a2e admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:53:46.988554 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eeeaa66-2cae-48e0-b63f-391fe5c9f27d admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:53:47.029237 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e490af-381b-4e0b-b77c-59a631199a2e admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:53:47.039320 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 819/1634] 10.222.0.65 () {58 vars in 1122 bytes} [Thu Oct 27 09:53:46 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 09:53:47.050800 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eeeaa66-2cae-48e0-b63f-391fe5c9f27d admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:53:47.058577 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7a04cb-8f2b-4f9e-b39e-cd53911c0aee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:53:47.059349 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7a04cb-8f2b-4f9e-b39e-cd53911c0aee admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:53:47.059741 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7a04cb-8f2b-4f9e-b39e-cd53911c0aee admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:53:47.060336 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7a04cb-8f2b-4f9e-b39e-cd53911c0aee admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:53:47.062126 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7a04cb-8f2b-4f9e-b39e-cd53911c0aee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:53:47.066171 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7a04cb-8f2b-4f9e-b39e-cd53911c0aee admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:53:47.079858 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eeeaa66-2cae-48e0-b63f-391fe5c9f27d admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:53:47.096315 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9886a6b-95fa-4325-9b4c-041ba43ebc0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:53:47.096315 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9886a6b-95fa-4325-9b4c-041ba43ebc0c admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:53:47.096315 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9886a6b-95fa-4325-9b4c-041ba43ebc0c admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:53:47.096315 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9886a6b-95fa-4325-9b4c-041ba43ebc0c admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:53:47.100887 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9886a6b-95fa-4325-9b4c-041ba43ebc0c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:53:47.103226 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9886a6b-95fa-4325-9b4c-041ba43ebc0c admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:53:47.103802 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 816/1635] 10.222.0.65 () {58 vars in 1122 bytes} [Thu Oct 27 09:53:46 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 09:53:47.104882 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7a04cb-8f2b-4f9e-b39e-cd53911c0aee admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:53:47.125143 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 820/1636] 10.222.0.65 () {58 vars in 1122 bytes} [Thu Oct 27 09:53:47 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 09:53:47.127659 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7a04cb-8f2b-4f9e-b39e-cd53911c0aee admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:53:47.129856 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9886a6b-95fa-4325-9b4c-041ba43ebc0c admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:53:47.144094 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6635b7-0516-44dc-a08a-ef14bfca8c19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:53:47.144921 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6635b7-0516-44dc-a08a-ef14bfca8c19 admin admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:53:47.145293 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6635b7-0516-44dc-a08a-ef14bfca8c19 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:53:47.145684 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6635b7-0516-44dc-a08a-ef14bfca8c19 admin admin] PATH_INFO: `/v3/projects/179672b48d84497d9adc32b6e2b9dd9f/users/bbbab01f8007402085fedfb7bcf109ca/roles/43543ce1450245af9661cb017bac17bd` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:53:47.160045 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9886a6b-95fa-4325-9b4c-041ba43ebc0c admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:53:47.166786 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5224866a-b284-4362-8a1b-6a4fe5aee288 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:53:47.167569 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5224866a-b284-4362-8a1b-6a4fe5aee288 admin admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:53:47.167944 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5224866a-b284-4362-8a1b-6a4fe5aee288 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:53:47.168313 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5224866a-b284-4362-8a1b-6a4fe5aee288 admin admin] PATH_INFO: `/v3/projects/f2c999efd73543da8736ca998375b085/users/8c0690d934044d25ad1769e1a012ff29/roles/43543ce1450245af9661cb017bac17bd` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:53:47.186448 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6635b7-0516-44dc-a08a-ef14bfca8c19 admin admin] RBAC: Authorizing `identity:create_grant(project_id=179672b48d84497d9adc32b6e2b9dd9f, user_id=bbbab01f8007402085fedfb7bcf109ca, role_id=43543ce1450245af9661cb017bac17bd)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:53:47.189541 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6635b7-0516-44dc-a08a-ef14bfca8c19 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:53:47.203967 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5224866a-b284-4362-8a1b-6a4fe5aee288 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f2c999efd73543da8736ca998375b085, user_id=8c0690d934044d25ad1769e1a012ff29, role_id=43543ce1450245af9661cb017bac17bd)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:53:47.207212 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5224866a-b284-4362-8a1b-6a4fe5aee288 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:53:47.323671 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 821/1637] 10.222.0.65 () {60 vars in 1483 bytes} [Thu Oct 27 09:53:47 2022] PUT /identity/v3/projects/f2c999efd73543da8736ca998375b085/users/8c0690d934044d25ad1769e1a012ff29/roles/43543ce1450245af9661cb017bac17bd => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 09:53:47.325118 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 817/1638] 10.222.0.65 () {60 vars in 1483 bytes} [Thu Oct 27 09:53:47 2022] PUT /identity/v3/projects/179672b48d84497d9adc32b6e2b9dd9f/users/bbbab01f8007402085fedfb7bcf109ca/roles/43543ce1450245af9661cb017bac17bd => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 09:53:47.329845 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc31cb1-f3ef-42d5-9ff3-91cf10cb012b None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:53:47.330305 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac7c713-7b42-4e03-a24d-07043067bb88 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:53:47.330612 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac7c713-7b42-4e03-a24d-07043067bb88 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:53:47.330901 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac7c713-7b42-4e03-a24d-07043067bb88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:53:47.331838 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc31cb1-f3ef-42d5-9ff3-91cf10cb012b None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:53:47.331997 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc31cb1-f3ef-42d5-9ff3-91cf10cb012b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:53:47.376631 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-3ac7c713-7b42-4e03-a24d-07043067bb88 None None] MFA Rules not processed for user `bbbab01f8007402085fedfb7bcf109ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:53:47.378149 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-3ac7c713-7b42-4e03-a24d-07043067bb88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:53:47.379364 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-9dc31cb1-f3ef-42d5-9ff3-91cf10cb012b None None] MFA Rules not processed for user `8c0690d934044d25ad1769e1a012ff29`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:53:47.380640 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-9dc31cb1-f3ef-42d5-9ff3-91cf10cb012b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:53:47.507643 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 818/1639] 10.222.0.65 () {58 vars in 958 bytes} [Thu Oct 27 09:53:47 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 09:53:47.512091 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac7c713-7b42-4e03-a24d-07043067bb88 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:53:47.536141 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 822/1640] 10.222.0.65 () {58 vars in 958 bytes} [Thu Oct 27 09:53:47 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 09:53:47.551950 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc31cb1-f3ef-42d5-9ff3-91cf10cb012b None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:53:47.554347 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-9dc31cb1-f3ef-42d5-9ff3-91cf10cb012b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:53:47.689603 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac7c713-7b42-4e03-a24d-07043067bb88 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:53:47.701870 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cb04e8-223d-4e94-a0d1-be1683179615 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:53:47.702686 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cb04e8-223d-4e94-a0d1-be1683179615 admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:53:47.702962 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cb04e8-223d-4e94-a0d1-be1683179615 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:53:47.703241 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cb04e8-223d-4e94-a0d1-be1683179615 admin admin] PATH_INFO: `/v3/projects` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:53:47.703888 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35cb04e8-223d-4e94-a0d1-be1683179615 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:53:47.713144 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35cb04e8-223d-4e94-a0d1-be1683179615 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:53:47.741724 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc31cb1-f3ef-42d5-9ff3-91cf10cb012b None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:53:47.746294 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479470f6-37e2-4581-bc28-a1bfd86b6960 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4b0886666584397be686ee02a505269', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc2e3a7a1bcc480891c0b433291c00b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:53:47.747002 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479470f6-37e2-4581-bc28-a1bfd86b6960 service glance] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:53:47.748603 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479470f6-37e2-4581-bc28-a1bfd86b6960 service glance] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:53:47.748603 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479470f6-37e2-4581-bc28-a1bfd86b6960 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:53:47.760411 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479470f6-37e2-4581-bc28-a1bfd86b6960 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:53:47.762110 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479470f6-37e2-4581-bc28-a1bfd86b6960 service glance] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:53:47.784385 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 823/1641] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Oct 27 09:53:47 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 09:53:47.828892 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 819/1642] 10.222.0.65 () {60 vars in 1153 bytes} [Thu Oct 27 09:53:47 2022] POST /identity/v3/projects => generated 385 bytes in 317 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 09:53:47.832689 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479470f6-37e2-4581-bc28-a1bfd86b6960 service glance] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:53:47.852778 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479470f6-37e2-4581-bc28-a1bfd86b6960 service glance] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:53:47.951440 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cd515b-94a7-4a7d-8be8-3bdab1d49b90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:53:47.952073 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cd515b-94a7-4a7d-8be8-3bdab1d49b90 admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:53:47.952357 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cd515b-94a7-4a7d-8be8-3bdab1d49b90 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:53:47.952634 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cd515b-94a7-4a7d-8be8-3bdab1d49b90 admin admin] PATH_INFO: `/v3/users` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:53:47.953496 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64cd515b-94a7-4a7d-8be8-3bdab1d49b90 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:53:47.955356 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64cd515b-94a7-4a7d-8be8-3bdab1d49b90 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:53:48.075297 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 824/1643] 10.222.0.65 () {60 vars in 1144 bytes} [Thu Oct 27 09:53:47 2022] POST /identity/v3/users => generated 293 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 09:53:48.076239 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cb04e8-223d-4e94-a0d1-be1683179615 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:53:48.096528 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cb04e8-223d-4e94-a0d1-be1683179615 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:53:48.106766 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f72f4a3-7d9c-463a-8021-b6bc5b87f97d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:53:48.112651 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f72f4a3-7d9c-463a-8021-b6bc5b87f97d admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:53:48.112651 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f72f4a3-7d9c-463a-8021-b6bc5b87f97d admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:53:48.112651 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f72f4a3-7d9c-463a-8021-b6bc5b87f97d admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:53:48.112651 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f72f4a3-7d9c-463a-8021-b6bc5b87f97d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:53:48.114024 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f72f4a3-7d9c-463a-8021-b6bc5b87f97d admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:53:48.135643 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cd515b-94a7-4a7d-8be8-3bdab1d49b90 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:53:48.145167 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 820/1644] 10.222.0.65 () {58 vars in 1122 bytes} [Thu Oct 27 09:53:48 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 09:53:48.152409 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cd515b-94a7-4a7d-8be8-3bdab1d49b90 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:53:48.157594 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516805eb-1d07-4bad-95aa-fc88d3c92289 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:53:48.158422 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516805eb-1d07-4bad-95aa-fc88d3c92289 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:53:48.158789 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516805eb-1d07-4bad-95aa-fc88d3c92289 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:53:48.162765 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516805eb-1d07-4bad-95aa-fc88d3c92289 admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:53:48.162765 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516805eb-1d07-4bad-95aa-fc88d3c92289 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:53:48.162765 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516805eb-1d07-4bad-95aa-fc88d3c92289 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:53:48.178294 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f72f4a3-7d9c-463a-8021-b6bc5b87f97d admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:53:48.191305 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 825/1645] 10.222.0.65 () {58 vars in 1122 bytes} [Thu Oct 27 09:53:48 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 09:53:48.191414 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f72f4a3-7d9c-463a-8021-b6bc5b87f97d admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:53:48.195751 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8df1f5-eb31-4b4b-80ba-00a05ec1e607 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:53:48.196533 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8df1f5-eb31-4b4b-80ba-00a05ec1e607 admin admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:53:48.196926 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8df1f5-eb31-4b4b-80ba-00a05ec1e607 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:53:48.197290 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8df1f5-eb31-4b4b-80ba-00a05ec1e607 admin admin] PATH_INFO: `/v3/projects/fa607de9739042b4b271957c9c6d5090/users/18230c4332064db696a2b66de170c2d6/roles/43543ce1450245af9661cb017bac17bd` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:53:48.215737 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8df1f5-eb31-4b4b-80ba-00a05ec1e607 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fa607de9739042b4b271957c9c6d5090, user_id=18230c4332064db696a2b66de170c2d6, role_id=43543ce1450245af9661cb017bac17bd)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:53:48.219498 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8df1f5-eb31-4b4b-80ba-00a05ec1e607 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:53:48.239641 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:53:48.340842 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 821/1646] 10.222.0.65 () {60 vars in 1483 bytes} [Thu Oct 27 09:53:48 2022] PUT /identity/v3/projects/fa607de9739042b4b271957c9c6d5090/users/18230c4332064db696a2b66de170c2d6/roles/43543ce1450245af9661cb017bac17bd => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 09:53:48.353010 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5ddb63-ff95-4587-ac52-c40e7e817b68 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:53:48.353905 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5ddb63-ff95-4587-ac52-c40e7e817b68 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:53:48.353905 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5ddb63-ff95-4587-ac52-c40e7e817b68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:53:48.400628 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-ca5ddb63-ff95-4587-ac52-c40e7e817b68 None None] MFA Rules not processed for user `18230c4332064db696a2b66de170c2d6`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:53:48.401793 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-ca5ddb63-ff95-4587-ac52-c40e7e817b68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:53:48.493436 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 826/1647] 10.222.0.65 () {58 vars in 958 bytes} [Thu Oct 27 09:53:48 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 09:53:48.498702 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8df1f5-eb31-4b4b-80ba-00a05ec1e607 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:53:48.567021 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8df1f5-eb31-4b4b-80ba-00a05ec1e607 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:53:48.576686 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d1ca73-993c-46bd-8f70-a85749f9759f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:53:48.577748 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d1ca73-993c-46bd-8f70-a85749f9759f admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:53:48.578196 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d1ca73-993c-46bd-8f70-a85749f9759f admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:53:48.579142 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d1ca73-993c-46bd-8f70-a85749f9759f admin admin] PATH_INFO: `/v3/projects` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:53:48.580116 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d1ca73-993c-46bd-8f70-a85749f9759f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:53:48.584932 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d1ca73-993c-46bd-8f70-a85749f9759f admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:53:48.738154 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 822/1648] 10.222.0.65 () {60 vars in 1153 bytes} [Thu Oct 27 09:53:48 2022] POST /identity/v3/projects => generated 385 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 09:53:48.743281 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5ddb63-ff95-4587-ac52-c40e7e817b68 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:53:48.753790 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:53:48.760976 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5ddb63-ff95-4587-ac52-c40e7e817b68 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:53:48.845973 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15b7d99-aa52-4472-ba81-69b913d7b4cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:53:48.846756 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15b7d99-aa52-4472-ba81-69b913d7b4cf admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:53:48.847026 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15b7d99-aa52-4472-ba81-69b913d7b4cf admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:53:48.847294 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15b7d99-aa52-4472-ba81-69b913d7b4cf admin admin] PATH_INFO: `/v3/users` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:53:48.847938 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15b7d99-aa52-4472-ba81-69b913d7b4cf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:53:48.851359 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15b7d99-aa52-4472-ba81-69b913d7b4cf admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:53:48.979024 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 827/1649] 10.222.0.65 () {60 vars in 1144 bytes} [Thu Oct 27 09:53:48 2022] POST /identity/v3/users => generated 299 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 09:53:48.983452 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d1ca73-993c-46bd-8f70-a85749f9759f admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:53:48.997110 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d1ca73-993c-46bd-8f70-a85749f9759f admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:53:49.004566 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87290c7-ca0f-412e-829b-d7496512029c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:53:49.004566 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87290c7-ca0f-412e-829b-d7496512029c admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:53:49.004566 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87290c7-ca0f-412e-829b-d7496512029c admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:53:49.004566 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87290c7-ca0f-412e-829b-d7496512029c admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:53:49.004889 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87290c7-ca0f-412e-829b-d7496512029c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:53:49.006615 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87290c7-ca0f-412e-829b-d7496512029c admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:53:49.028718 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 823/1650] 10.222.0.65 () {58 vars in 1122 bytes} [Thu Oct 27 09:53:48 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 09:53:49.033056 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15b7d99-aa52-4472-ba81-69b913d7b4cf admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:53:49.043862 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15b7d99-aa52-4472-ba81-69b913d7b4cf admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:53:49.049434 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5776349-3a40-4644-8e08-da2e2bf55924 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:53:49.050150 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5776349-3a40-4644-8e08-da2e2bf55924 admin admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:53:49.050442 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5776349-3a40-4644-8e08-da2e2bf55924 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:53:49.050755 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5776349-3a40-4644-8e08-da2e2bf55924 admin admin] PATH_INFO: `/v3/projects/d6336667576941d0aa83991a18b40a85/users/1029afd1accb46bf9f7f57c027ab5af6/roles/6ad17b9f9dea4b66ab2da3677d7e715d` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:53:49.066890 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5776349-3a40-4644-8e08-da2e2bf55924 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d6336667576941d0aa83991a18b40a85, user_id=1029afd1accb46bf9f7f57c027ab5af6, role_id=6ad17b9f9dea4b66ab2da3677d7e715d)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:53:49.070035 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5776349-3a40-4644-8e08-da2e2bf55924 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:53:49.164426 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 828/1651] 10.222.0.65 () {60 vars in 1483 bytes} [Thu Oct 27 09:53:49 2022] PUT /identity/v3/projects/d6336667576941d0aa83991a18b40a85/users/1029afd1accb46bf9f7f57c027ab5af6/roles/6ad17b9f9dea4b66ab2da3677d7e715d => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 09:53:49.168695 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87290c7-ca0f-412e-829b-d7496512029c admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:53:49.179645 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87290c7-ca0f-412e-829b-d7496512029c admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:53:49.240789 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72546f37-80db-47b6-8feb-43a90dc2f389 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:53:49.242168 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72546f37-80db-47b6-8feb-43a90dc2f389 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:53:49.242448 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72546f37-80db-47b6-8feb-43a90dc2f389 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:53:49.242764 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72546f37-80db-47b6-8feb-43a90dc2f389 admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:53:49.243430 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72546f37-80db-47b6-8feb-43a90dc2f389 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:53:49.245066 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72546f37-80db-47b6-8feb-43a90dc2f389 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:53:49.257186 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 824/1652] 10.222.0.65 () {58 vars in 1122 bytes} [Thu Oct 27 09:53:49 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 09:53:49.261655 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5776349-3a40-4644-8e08-da2e2bf55924 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:53:49.273595 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5776349-3a40-4644-8e08-da2e2bf55924 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:53:49.278412 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33040e5c-96dc-4046-8f11-88cf1954f3d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:53:49.279263 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33040e5c-96dc-4046-8f11-88cf1954f3d0 admin admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:53:49.279969 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33040e5c-96dc-4046-8f11-88cf1954f3d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:53:49.280247 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33040e5c-96dc-4046-8f11-88cf1954f3d0 admin admin] PATH_INFO: `/v3/projects/d6336667576941d0aa83991a18b40a85/users/1029afd1accb46bf9f7f57c027ab5af6/roles/6ad17b9f9dea4b66ab2da3677d7e715d` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:53:49.282331 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33040e5c-96dc-4046-8f11-88cf1954f3d0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d6336667576941d0aa83991a18b40a85, user_id=1029afd1accb46bf9f7f57c027ab5af6, role_id=6ad17b9f9dea4b66ab2da3677d7e715d)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:53:49.285056 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33040e5c-96dc-4046-8f11-88cf1954f3d0 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:53:49.297725 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 829/1653] 10.222.0.65 () {60 vars in 1483 bytes} [Thu Oct 27 09:53:49 2022] PUT /identity/v3/projects/d6336667576941d0aa83991a18b40a85/users/1029afd1accb46bf9f7f57c027ab5af6/roles/6ad17b9f9dea4b66ab2da3677d7e715d => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 09:53:49.308786 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ffbf5e-ddb8-4a90-a835-9d74143bdd57 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:53:49.309311 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ffbf5e-ddb8-4a90-a835-9d74143bdd57 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:53:49.309593 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ffbf5e-ddb8-4a90-a835-9d74143bdd57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:53:49.342771 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-46ffbf5e-ddb8-4a90-a835-9d74143bdd57 None None] MFA Rules not processed for user `1029afd1accb46bf9f7f57c027ab5af6`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:53:49.344169 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-46ffbf5e-ddb8-4a90-a835-9d74143bdd57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:53:49.424136 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 825/1654] 10.222.0.65 () {58 vars in 958 bytes} [Thu Oct 27 09:53:49 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 09:53:49.436246 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33040e5c-96dc-4046-8f11-88cf1954f3d0 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:53:49.438020 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-33040e5c-96dc-4046-8f11-88cf1954f3d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:53:49.503051 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33040e5c-96dc-4046-8f11-88cf1954f3d0 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:53:49.507556 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3d768e-7ae3-4f5e-bd9b-f2ce53007e07 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8e5d5f04c4741bb86ca4a0f667d4ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc2e3a7a1bcc480891c0b433291c00b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:53:49.508544 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3d768e-7ae3-4f5e-bd9b-f2ce53007e07 service cinder] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:53:49.508826 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3d768e-7ae3-4f5e-bd9b-f2ce53007e07 service cinder] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:53:49.509207 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3d768e-7ae3-4f5e-bd9b-f2ce53007e07 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:53:49.581288 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3d768e-7ae3-4f5e-bd9b-f2ce53007e07 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:53:49.582954 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3d768e-7ae3-4f5e-bd9b-f2ce53007e07 service cinder] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:53:49.593654 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 830/1655] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Oct 27 09:53:49 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 09:53:50.216616 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:53:50.516975 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:53:51.415667 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ffbf5e-ddb8-4a90-a835-9d74143bdd57 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:53:51.417371 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-46ffbf5e-ddb8-4a90-a835-9d74143bdd57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:53:51.487907 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ffbf5e-ddb8-4a90-a835-9d74143bdd57 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:53:51.494092 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264e8309-db6e-4524-8c64-5d00409b088d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:53:51.494760 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264e8309-db6e-4524-8c64-5d00409b088d admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:53:51.495048 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264e8309-db6e-4524-8c64-5d00409b088d admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:53:51.495319 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264e8309-db6e-4524-8c64-5d00409b088d admin admin] PATH_INFO: `/v3/users/74902827ee10461b8630727739b9e65c` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:53:51.496454 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264e8309-db6e-4524-8c64-5d00409b088d admin admin] RBAC: Authorizing `identity:delete_user(user_id=74902827ee10461b8630727739b9e65c)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:53:51.498382 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264e8309-db6e-4524-8c64-5d00409b088d admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:53:51.754265 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-264e8309-db6e-4524-8c64-5d00409b088d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '74902827ee10461b8630727739b9e65c'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:53:51.754905 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-264e8309-db6e-4524-8c64-5d00409b088d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '74902827ee10461b8630727739b9e65c'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:53:51.763232 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-264e8309-db6e-4524-8c64-5d00409b088d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '74902827ee10461b8630727739b9e65c'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:53:51.763996 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-264e8309-db6e-4524-8c64-5d00409b088d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '74902827ee10461b8630727739b9e65c'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:53:51.777216 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-264e8309-db6e-4524-8c64-5d00409b088d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '74902827ee10461b8630727739b9e65c'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:53:51.856793 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 826/1656] 10.222.0.65 () {58 vars in 1224 bytes} [Thu Oct 27 09:53:51 2022] DELETE /identity/v3/users/74902827ee10461b8630727739b9e65c => generated 0 bytes in 442 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 09:53:51.861367 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be44b5d0-2ffc-45b8-a281-4d169595e014 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:53:51.861898 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be44b5d0-2ffc-45b8-a281-4d169595e014 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:53:51.861898 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be44b5d0-2ffc-45b8-a281-4d169595e014 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:53:51.883879 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-be44b5d0-2ffc-45b8-a281-4d169595e014 None None] MFA Rules not processed for user `b5065084bf664b99bdeac46067cb0f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:53:51.890951 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-be44b5d0-2ffc-45b8-a281-4d169595e014 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:53:51.962557 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 831/1657] 10.222.0.65 () {58 vars in 958 bytes} [Thu Oct 27 09:53:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 09:53:51.973051 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264e8309-db6e-4524-8c64-5d00409b088d admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:53:51.974883 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-264e8309-db6e-4524-8c64-5d00409b088d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:53:52.021731 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:53:52.042510 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264e8309-db6e-4524-8c64-5d00409b088d admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:53:52.046180 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e197c7-e614-45a6-8366-458f815bc895 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6191cc41efa74f46b49022cf387f7a4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc2e3a7a1bcc480891c0b433291c00b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:53:52.046952 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e197c7-e614-45a6-8366-458f815bc895 service neutron] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:53:52.047228 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e197c7-e614-45a6-8366-458f815bc895 service neutron] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:53:52.047507 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e197c7-e614-45a6-8366-458f815bc895 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:53:52.057502 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e197c7-e614-45a6-8366-458f815bc895 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:53:52.058989 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e197c7-e614-45a6-8366-458f815bc895 service neutron] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:53:52.069894 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 827/1658] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Oct 27 09:53:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 09:53:52.136455 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:53:52.594049 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be44b5d0-2ffc-45b8-a281-4d169595e014 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:53:52.596075 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-be44b5d0-2ffc-45b8-a281-4d169595e014 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:53:52.611797 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be44b5d0-2ffc-45b8-a281-4d169595e014 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:53:52.620099 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34f4189-e473-416e-ba7d-887a1af8bad4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:53:52.620786 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34f4189-e473-416e-ba7d-887a1af8bad4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:53:52.621072 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34f4189-e473-416e-ba7d-887a1af8bad4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:53:52.621338 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34f4189-e473-416e-ba7d-887a1af8bad4 admin admin] PATH_INFO: `/v3/projects/7cf647f7c8fb4b31b577fbafa32e3808` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:53:52.623979 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34f4189-e473-416e-ba7d-887a1af8bad4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7cf647f7c8fb4b31b577fbafa32e3808)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:53:52.626671 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34f4189-e473-416e-ba7d-887a1af8bad4 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:53:52.670667 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=80,keystone:DELETE=17,keystone:INSERT=3 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:53:52.771506 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-f34f4189-e473-416e-ba7d-887a1af8bad4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7cf647f7c8fb4b31b577fbafa32e3808', 'request_id': 'req-f34f4189-e473-416e-ba7d-887a1af8bad4'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:53:52.913949 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-f34f4189-e473-416e-ba7d-887a1af8bad4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7cf647f7c8fb4b31b577fbafa32e3808', 'request_id': 'req-f34f4189-e473-416e-ba7d-887a1af8bad4'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:53:52.920579 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-f34f4189-e473-416e-ba7d-887a1af8bad4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7cf647f7c8fb4b31b577fbafa32e3808', 'request_id': 'req-f34f4189-e473-416e-ba7d-887a1af8bad4'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:53:52.933979 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-f34f4189-e473-416e-ba7d-887a1af8bad4 admin admin] The token cache is being invalidate because project 7cf647f7c8fb4b31b577fbafa32e3808 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 09:53:52.934300 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-f34f4189-e473-416e-ba7d-887a1af8bad4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:53:52.935084 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-f34f4189-e473-416e-ba7d-887a1af8bad4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:53:52.936587 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 832/1659] 10.222.0.65 () {58 vars in 1233 bytes} [Thu Oct 27 09:53:52 2022] DELETE /identity/v3/projects/7cf647f7c8fb4b31b577fbafa32e3808 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 09:53:52.941788 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbe5f12-4885-4f30-a97c-b6dfe65a5068 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:53:52.942141 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbe5f12-4885-4f30-a97c-b6dfe65a5068 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:53:52.942606 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbe5f12-4885-4f30-a97c-b6dfe65a5068 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:53:52.970325 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-6bbe5f12-4885-4f30-a97c-b6dfe65a5068 None None] MFA Rules not processed for user `b5065084bf664b99bdeac46067cb0f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:53:52.971699 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-6bbe5f12-4885-4f30-a97c-b6dfe65a5068 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:53:52.989379 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34f4189-e473-416e-ba7d-887a1af8bad4 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:53:52.989379 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-f34f4189-e473-416e-ba7d-887a1af8bad4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:53:53.046028 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:53:53.048373 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 828/1660] 10.222.0.65 () {58 vars in 958 bytes} [Thu Oct 27 09:53:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 09:53:53.058227 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9981d4-253b-4848-bb74-13c2e6fd56b5 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:53:53.058535 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9981d4-253b-4848-bb74-13c2e6fd56b5 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:53:53.058759 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34f4189-e473-416e-ba7d-887a1af8bad4 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:53:53.058973 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9981d4-253b-4848-bb74-13c2e6fd56b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:53:53.063483 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d13038-cebd-4ace-83b9-5d52aa5229ce service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8e5d5f04c4741bb86ca4a0f667d4ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc2e3a7a1bcc480891c0b433291c00b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:53:53.064540 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d13038-cebd-4ace-83b9-5d52aa5229ce service cinder] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:53:53.064923 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d13038-cebd-4ace-83b9-5d52aa5229ce service cinder] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:53:53.065320 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d13038-cebd-4ace-83b9-5d52aa5229ce service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:53:53.067301 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-08d13038-cebd-4ace-83b9-5d52aa5229ce service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:53:53.082835 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-ce9981d4-253b-4848-bb74-13c2e6fd56b5 None None] MFA Rules not processed for user `b5065084bf664b99bdeac46067cb0f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:53:53.084542 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-ce9981d4-253b-4848-bb74-13c2e6fd56b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:53:53.093096 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 829/1661] 10.222.0.65 () {58 vars in 958 bytes} [Thu Oct 27 09:53:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 09:53:53.097470 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9981d4-253b-4848-bb74-13c2e6fd56b5 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:53:53.109487 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9981d4-253b-4848-bb74-13c2e6fd56b5 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:53:53.115834 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fb7f18-dd8b-4bda-a7d4-2ff6c4d8ceee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:53:53.116713 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fb7f18-dd8b-4bda-a7d4-2ff6c4d8ceee admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:53:53.117057 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fb7f18-dd8b-4bda-a7d4-2ff6c4d8ceee admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:53:53.117391 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fb7f18-dd8b-4bda-a7d4-2ff6c4d8ceee admin admin] PATH_INFO: `/v3/domains` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:53:53.118278 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06fb7f18-dd8b-4bda-a7d4-2ff6c4d8ceee admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 09:53:53.118719 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06fb7f18-dd8b-4bda-a7d4-2ff6c4d8ceee admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:53:53.120490 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06fb7f18-dd8b-4bda-a7d4-2ff6c4d8ceee admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:53:53.137538 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 830/1662] 10.222.0.65 () {58 vars in 1153 bytes} [Thu Oct 27 09:53:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 09:53:53.137771 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d13038-cebd-4ace-83b9-5d52aa5229ce service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:53:53.137995 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d13038-cebd-4ace-83b9-5d52aa5229ce service cinder] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:53:53.138740 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fb7f18-dd8b-4bda-a7d4-2ff6c4d8ceee admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:53:53.148626 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 833/1663] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Oct 27 09:53:52 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 09:53:53.149447 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fb7f18-dd8b-4bda-a7d4-2ff6c4d8ceee admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:53:53.154952 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f1780d-9fcd-4cf6-ac75-f3f961b1222b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:53:53.155548 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f1780d-9fcd-4cf6-ac75-f3f961b1222b admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:53:53.155826 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f1780d-9fcd-4cf6-ac75-f3f961b1222b admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:53:53.156097 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f1780d-9fcd-4cf6-ac75-f3f961b1222b admin admin] PATH_INFO: `/v3/projects` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:53:53.156733 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f1780d-9fcd-4cf6-ac75-f3f961b1222b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:53:53.158722 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f1780d-9fcd-4cf6-ac75-f3f961b1222b admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:53:53.336539 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 831/1664] 10.222.0.65 () {60 vars in 1153 bytes} [Thu Oct 27 09:53:53 2022] POST /identity/v3/projects => generated 377 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 09:53:53.341239 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d13038-cebd-4ace-83b9-5d52aa5229ce service cinder] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:53:53.357692 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d13038-cebd-4ace-83b9-5d52aa5229ce service cinder] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:53:53.439367 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:53:53.457842 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf5d9e6-de64-44c2-a106-6ec9c8c1fd62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:53:53.459647 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf5d9e6-de64-44c2-a106-6ec9c8c1fd62 admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:53:53.460327 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf5d9e6-de64-44c2-a106-6ec9c8c1fd62 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:53:53.460807 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf5d9e6-de64-44c2-a106-6ec9c8c1fd62 admin admin] PATH_INFO: `/v3/users` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:53:53.461937 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf5d9e6-de64-44c2-a106-6ec9c8c1fd62 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:53:53.466552 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf5d9e6-de64-44c2-a106-6ec9c8c1fd62 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:53:53.565165 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 834/1665] 10.222.0.65 () {60 vars in 1144 bytes} [Thu Oct 27 09:53:53 2022] POST /identity/v3/users => generated 289 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 09:53:53.569964 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f1780d-9fcd-4cf6-ac75-f3f961b1222b admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:53:53.581977 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f1780d-9fcd-4cf6-ac75-f3f961b1222b admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:53:53.587778 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acd6651-9081-488a-bbb3-e07937f661b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:53:53.588823 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acd6651-9081-488a-bbb3-e07937f661b4 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:53:53.589111 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acd6651-9081-488a-bbb3-e07937f661b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:53:53.589423 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acd6651-9081-488a-bbb3-e07937f661b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:53:53.590207 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5acd6651-9081-488a-bbb3-e07937f661b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:53:53.591926 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5acd6651-9081-488a-bbb3-e07937f661b4 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:53:53.606232 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 832/1666] 10.222.0.65 () {58 vars in 1122 bytes} [Thu Oct 27 09:53:53 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 09:53:53.607891 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf5d9e6-de64-44c2-a106-6ec9c8c1fd62 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:53:53.618684 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf5d9e6-de64-44c2-a106-6ec9c8c1fd62 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:53:53.623527 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3a917d-4a83-463f-a9fc-05e2d5752553 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:53:53.624258 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3a917d-4a83-463f-a9fc-05e2d5752553 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:53:53.624509 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3a917d-4a83-463f-a9fc-05e2d5752553 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:53:53.624704 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3a917d-4a83-463f-a9fc-05e2d5752553 admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:53:53.625416 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3a917d-4a83-463f-a9fc-05e2d5752553 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:53:53.627054 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3a917d-4a83-463f-a9fc-05e2d5752553 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:53:53.638553 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 835/1667] 10.222.0.65 () {58 vars in 1122 bytes} [Thu Oct 27 09:53:53 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 09:53:53.642672 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acd6651-9081-488a-bbb3-e07937f661b4 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:53:53.654655 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acd6651-9081-488a-bbb3-e07937f661b4 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:53:53.659584 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fc7c9f-54b6-4061-9818-c7f5450ae831 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:53:53.660254 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fc7c9f-54b6-4061-9818-c7f5450ae831 admin admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:53:53.660532 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fc7c9f-54b6-4061-9818-c7f5450ae831 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:53:53.660806 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fc7c9f-54b6-4061-9818-c7f5450ae831 admin admin] PATH_INFO: `/v3/projects/a2566bb617124991993f086275f1967c/users/843d4c9661864015a5d5a4dcb5eb7e2e/roles/43543ce1450245af9661cb017bac17bd` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:53:53.679137 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6fc7c9f-54b6-4061-9818-c7f5450ae831 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a2566bb617124991993f086275f1967c, user_id=843d4c9661864015a5d5a4dcb5eb7e2e, role_id=43543ce1450245af9661cb017bac17bd)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:53:53.681941 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6fc7c9f-54b6-4061-9818-c7f5450ae831 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:53:53.782626 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 833/1668] 10.222.0.65 () {60 vars in 1483 bytes} [Thu Oct 27 09:53:53 2022] PUT /identity/v3/projects/a2566bb617124991993f086275f1967c/users/843d4c9661864015a5d5a4dcb5eb7e2e/roles/43543ce1450245af9661cb017bac17bd => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 09:53:53.796956 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e052e786-f474-4961-ad3d-18d551582150 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:53:53.797269 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e052e786-f474-4961-ad3d-18d551582150 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:53:53.797522 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e052e786-f474-4961-ad3d-18d551582150 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:53:53.845752 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-e052e786-f474-4961-ad3d-18d551582150 None None] MFA Rules not processed for user `843d4c9661864015a5d5a4dcb5eb7e2e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:53:53.847098 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-e052e786-f474-4961-ad3d-18d551582150 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:53:53.862026 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:53:53.923238 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 836/1669] 10.222.0.65 () {58 vars in 958 bytes} [Thu Oct 27 09:53:53 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 09:53:53.928038 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fc7c9f-54b6-4061-9818-c7f5450ae831 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:53:53.995408 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fc7c9f-54b6-4061-9818-c7f5450ae831 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:53:54.000236 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d08439a-10cf-482b-98c3-f718a39a757f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:53:54.000807 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d08439a-10cf-482b-98c3-f718a39a757f admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:53:54.001088 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d08439a-10cf-482b-98c3-f718a39a757f admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:53:54.001356 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d08439a-10cf-482b-98c3-f718a39a757f admin admin] PATH_INFO: `/v3/projects` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:53:54.002092 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d08439a-10cf-482b-98c3-f718a39a757f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:53:54.004027 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d08439a-10cf-482b-98c3-f718a39a757f admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:53:54.118424 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:53:54.131678 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 834/1670] 10.222.0.65 () {60 vars in 1153 bytes} [Thu Oct 27 09:53:53 2022] POST /identity/v3/projects => generated 375 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 09:53:54.134033 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e052e786-f474-4961-ad3d-18d551582150 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:53:54.145638 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e052e786-f474-4961-ad3d-18d551582150 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:53:54.205545 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32dee85c-7f8f-4d88-bfca-a97044bd1807 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:53:54.209628 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dee85c-7f8f-4d88-bfca-a97044bd1807 admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:53:54.209628 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dee85c-7f8f-4d88-bfca-a97044bd1807 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:53:54.209628 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dee85c-7f8f-4d88-bfca-a97044bd1807 admin admin] PATH_INFO: `/v3/users` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:53:54.209628 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32dee85c-7f8f-4d88-bfca-a97044bd1807 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:53:54.209628 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32dee85c-7f8f-4d88-bfca-a97044bd1807 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:53:54.284510 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 837/1671] 10.222.0.65 () {60 vars in 1144 bytes} [Thu Oct 27 09:53:54 2022] POST /identity/v3/users => generated 288 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 09:53:54.288706 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d08439a-10cf-482b-98c3-f718a39a757f admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:53:54.299451 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d08439a-10cf-482b-98c3-f718a39a757f admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:53:54.306276 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4004302e-9c22-4867-8784-d912c2c8f2ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:53:54.306957 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4004302e-9c22-4867-8784-d912c2c8f2ab admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:53:54.307241 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4004302e-9c22-4867-8784-d912c2c8f2ab admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:53:54.307514 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4004302e-9c22-4867-8784-d912c2c8f2ab admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:53:54.308344 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4004302e-9c22-4867-8784-d912c2c8f2ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:53:54.309993 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4004302e-9c22-4867-8784-d912c2c8f2ab admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:53:54.323909 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 835/1672] 10.222.0.65 () {58 vars in 1122 bytes} [Thu Oct 27 09:53:54 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 09:53:54.328349 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32dee85c-7f8f-4d88-bfca-a97044bd1807 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:53:54.345875 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32dee85c-7f8f-4d88-bfca-a97044bd1807 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:53:54.353965 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f032ec-6977-48b6-b94f-4037861de9ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:53:54.354632 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f032ec-6977-48b6-b94f-4037861de9ae admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:53:54.355009 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f032ec-6977-48b6-b94f-4037861de9ae admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:53:54.355239 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f032ec-6977-48b6-b94f-4037861de9ae admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:53:54.355881 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f032ec-6977-48b6-b94f-4037861de9ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:53:54.357558 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f032ec-6977-48b6-b94f-4037861de9ae admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:53:54.369200 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 838/1673] 10.222.0.65 () {58 vars in 1122 bytes} [Thu Oct 27 09:53:54 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 09:53:54.373696 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4004302e-9c22-4867-8784-d912c2c8f2ab admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:53:54.384383 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4004302e-9c22-4867-8784-d912c2c8f2ab admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:53:54.388910 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343f9613-46de-443b-9cbb-b7eb8b4ec69d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:53:54.389551 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343f9613-46de-443b-9cbb-b7eb8b4ec69d admin admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:53:54.393638 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343f9613-46de-443b-9cbb-b7eb8b4ec69d admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:53:54.393638 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343f9613-46de-443b-9cbb-b7eb8b4ec69d admin admin] PATH_INFO: `/v3/projects/3c638a7be3f144f2b313c78bc863aeca/users/2172709e4a44411eb713c7739e2d3507/roles/43543ce1450245af9661cb017bac17bd` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:53:54.406156 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343f9613-46de-443b-9cbb-b7eb8b4ec69d admin admin] RBAC: Authorizing `identity:create_grant(project_id=3c638a7be3f144f2b313c78bc863aeca, user_id=2172709e4a44411eb713c7739e2d3507, role_id=43543ce1450245af9661cb017bac17bd)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:53:54.408914 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343f9613-46de-443b-9cbb-b7eb8b4ec69d admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:53:54.501064 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 836/1674] 10.222.0.65 () {60 vars in 1483 bytes} [Thu Oct 27 09:53:54 2022] PUT /identity/v3/projects/3c638a7be3f144f2b313c78bc863aeca/users/2172709e4a44411eb713c7739e2d3507/roles/43543ce1450245af9661cb017bac17bd => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 09:53:54.507922 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3b37c4-0219-4074-afbf-a54a85d7ff71 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:53:54.511223 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3b37c4-0219-4074-afbf-a54a85d7ff71 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:53:54.511223 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3b37c4-0219-4074-afbf-a54a85d7ff71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:53:54.539722 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-ad3b37c4-0219-4074-afbf-a54a85d7ff71 None None] MFA Rules not processed for user `2172709e4a44411eb713c7739e2d3507`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:53:54.540981 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-ad3b37c4-0219-4074-afbf-a54a85d7ff71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:53:54.626937 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 839/1675] 10.222.0.65 () {58 vars in 958 bytes} [Thu Oct 27 09:53:54 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 09:53:54.631985 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343f9613-46de-443b-9cbb-b7eb8b4ec69d admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:53:54.700939 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:53:54.704384 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3b37c4-0219-4074-afbf-a54a85d7ff71 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:53:54.709425 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343f9613-46de-443b-9cbb-b7eb8b4ec69d admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:53:54.715462 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3804f0a2-1966-46b7-9fff-d13f2e79f53c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:53:54.716117 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3804f0a2-1966-46b7-9fff-d13f2e79f53c admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:53:54.716468 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3804f0a2-1966-46b7-9fff-d13f2e79f53c admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:53:54.716806 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3804f0a2-1966-46b7-9fff-d13f2e79f53c admin admin] PATH_INFO: `/v3/projects` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:53:54.717516 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3804f0a2-1966-46b7-9fff-d13f2e79f53c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:53:54.719702 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3804f0a2-1966-46b7-9fff-d13f2e79f53c admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:53:54.781774 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3b37c4-0219-4074-afbf-a54a85d7ff71 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:53:54.789840 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b946c70-3def-4548-aee0-4889902bc603 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8e5d5f04c4741bb86ca4a0f667d4ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc2e3a7a1bcc480891c0b433291c00b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:53:54.790578 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b946c70-3def-4548-aee0-4889902bc603 service cinder] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:53:54.790875 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b946c70-3def-4548-aee0-4889902bc603 service cinder] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:53:54.791157 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b946c70-3def-4548-aee0-4889902bc603 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:53:54.792997 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-6b946c70-3def-4548-aee0-4889902bc603 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:53:54.857848 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 837/1676] 10.222.0.65 () {60 vars in 1153 bytes} [Thu Oct 27 09:53:54 2022] POST /identity/v3/projects => generated 375 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 09:53:54.861867 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3804f0a2-1966-46b7-9fff-d13f2e79f53c admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:53:54.876092 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b946c70-3def-4548-aee0-4889902bc603 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:53:54.877528 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b946c70-3def-4548-aee0-4889902bc603 service cinder] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:53:54.888153 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 840/1677] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Oct 27 09:53:54 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 09:53:54.929417 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3804f0a2-1966-46b7-9fff-d13f2e79f53c admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:53:54.934314 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d74b42-356f-403d-b690-e3572b537f28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:53:54.934986 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d74b42-356f-403d-b690-e3572b537f28 admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:53:54.935318 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d74b42-356f-403d-b690-e3572b537f28 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:53:54.935591 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d74b42-356f-403d-b690-e3572b537f28 admin admin] PATH_INFO: `/v3/users` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:53:54.936248 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d74b42-356f-403d-b690-e3572b537f28 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:53:54.938195 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d74b42-356f-403d-b690-e3572b537f28 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:53:55.048538 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:53:55.056867 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 838/1678] 10.222.0.65 () {60 vars in 1144 bytes} [Thu Oct 27 09:53:54 2022] POST /identity/v3/users => generated 294 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 09:53:55.060930 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b946c70-3def-4548-aee0-4889902bc603 service cinder] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:53:55.072739 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b946c70-3def-4548-aee0-4889902bc603 service cinder] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:53:55.077672 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a77a75b-61bc-43b5-81b4-fb9df8fa5fdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:53:55.078291 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a77a75b-61bc-43b5-81b4-fb9df8fa5fdf admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:53:55.078661 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a77a75b-61bc-43b5-81b4-fb9df8fa5fdf admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:53:55.078949 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a77a75b-61bc-43b5-81b4-fb9df8fa5fdf admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:53:55.079607 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a77a75b-61bc-43b5-81b4-fb9df8fa5fdf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:53:55.081215 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a77a75b-61bc-43b5-81b4-fb9df8fa5fdf admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:53:55.094664 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 841/1679] 10.222.0.65 () {58 vars in 1122 bytes} [Thu Oct 27 09:53:55 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 09:53:55.102011 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d74b42-356f-403d-b690-e3572b537f28 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:53:55.113241 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d74b42-356f-403d-b690-e3572b537f28 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:53:55.119328 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2c78f3-3702-40e5-9b80-47c83cd8ca4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:53:55.120117 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2c78f3-3702-40e5-9b80-47c83cd8ca4a admin admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:53:55.120629 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2c78f3-3702-40e5-9b80-47c83cd8ca4a admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:53:55.121391 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2c78f3-3702-40e5-9b80-47c83cd8ca4a admin admin] PATH_INFO: `/v3/projects/03781435d25c4cdaae24140ea7934f8d/users/8ccc87d7e287432d98549bf2f08eebb8/roles/6ad17b9f9dea4b66ab2da3677d7e715d` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:53:55.141161 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2c78f3-3702-40e5-9b80-47c83cd8ca4a admin admin] RBAC: Authorizing `identity:create_grant(project_id=03781435d25c4cdaae24140ea7934f8d, user_id=8ccc87d7e287432d98549bf2f08eebb8, role_id=6ad17b9f9dea4b66ab2da3677d7e715d)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:53:55.144003 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2c78f3-3702-40e5-9b80-47c83cd8ca4a admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:53:55.249618 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 839/1680] 10.222.0.65 () {60 vars in 1483 bytes} [Thu Oct 27 09:53:55 2022] PUT /identity/v3/projects/03781435d25c4cdaae24140ea7934f8d/users/8ccc87d7e287432d98549bf2f08eebb8/roles/6ad17b9f9dea4b66ab2da3677d7e715d => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 09:53:55.253713 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a77a75b-61bc-43b5-81b4-fb9df8fa5fdf admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:53:55.264989 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a77a75b-61bc-43b5-81b4-fb9df8fa5fdf admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:53:55.324392 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3056c1c1-f51f-4007-a0f5-c5d70a6a3852 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:53:55.325007 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3056c1c1-f51f-4007-a0f5-c5d70a6a3852 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:53:55.325291 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3056c1c1-f51f-4007-a0f5-c5d70a6a3852 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:53:55.325570 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3056c1c1-f51f-4007-a0f5-c5d70a6a3852 admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:53:55.326215 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3056c1c1-f51f-4007-a0f5-c5d70a6a3852 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:53:55.327934 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3056c1c1-f51f-4007-a0f5-c5d70a6a3852 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:53:55.338705 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 842/1681] 10.222.0.65 () {58 vars in 1122 bytes} [Thu Oct 27 09:53:55 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 09:53:55.343538 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2c78f3-3702-40e5-9b80-47c83cd8ca4a admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:53:55.354563 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2c78f3-3702-40e5-9b80-47c83cd8ca4a admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:53:55.359421 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d03691a-838b-4894-9193-a364d2460083 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:53:55.360149 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d03691a-838b-4894-9193-a364d2460083 admin admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:53:55.360449 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d03691a-838b-4894-9193-a364d2460083 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:53:55.360720 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d03691a-838b-4894-9193-a364d2460083 admin admin] PATH_INFO: `/v3/projects/03781435d25c4cdaae24140ea7934f8d/users/8ccc87d7e287432d98549bf2f08eebb8/roles/6ad17b9f9dea4b66ab2da3677d7e715d` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:53:55.362811 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d03691a-838b-4894-9193-a364d2460083 admin admin] RBAC: Authorizing `identity:create_grant(project_id=03781435d25c4cdaae24140ea7934f8d, user_id=8ccc87d7e287432d98549bf2f08eebb8, role_id=6ad17b9f9dea4b66ab2da3677d7e715d)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:53:55.366291 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d03691a-838b-4894-9193-a364d2460083 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:53:55.377944 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 840/1682] 10.222.0.65 () {60 vars in 1483 bytes} [Thu Oct 27 09:53:55 2022] PUT /identity/v3/projects/03781435d25c4cdaae24140ea7934f8d/users/8ccc87d7e287432d98549bf2f08eebb8/roles/6ad17b9f9dea4b66ab2da3677d7e715d => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 09:53:55.388936 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd075db-845a-46a6-ba8c-9a2118cd6ae6 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:53:55.389227 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd075db-845a-46a6-ba8c-9a2118cd6ae6 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:53:55.389510 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd075db-845a-46a6-ba8c-9a2118cd6ae6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:53:55.422329 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-3dd075db-845a-46a6-ba8c-9a2118cd6ae6 None None] MFA Rules not processed for user `8ccc87d7e287432d98549bf2f08eebb8`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:53:55.424015 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-3dd075db-845a-46a6-ba8c-9a2118cd6ae6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:53:55.510240 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 843/1683] 10.222.0.65 () {58 vars in 958 bytes} [Thu Oct 27 09:53:55 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 09:53:55.528886 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d03691a-838b-4894-9193-a364d2460083 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:53:55.531608 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-9d03691a-838b-4894-9193-a364d2460083 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:53:55.601084 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d03691a-838b-4894-9193-a364d2460083 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:53:55.605060 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f79f8f7-b4bf-41ce-8c1e-653d180c4069 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8e5d5f04c4741bb86ca4a0f667d4ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc2e3a7a1bcc480891c0b433291c00b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:53:55.605686 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f79f8f7-b4bf-41ce-8c1e-653d180c4069 service cinder] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:53:55.605970 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f79f8f7-b4bf-41ce-8c1e-653d180c4069 service cinder] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:53:55.606245 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f79f8f7-b4bf-41ce-8c1e-653d180c4069 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:53:55.683164 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f79f8f7-b4bf-41ce-8c1e-653d180c4069 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:53:55.685188 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f79f8f7-b4bf-41ce-8c1e-653d180c4069 service cinder] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:53:55.696487 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 841/1684] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Oct 27 09:53:55 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 09:53:56.167609 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:53:57.300919 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:DELETE=17,keystone:SELECT=81,keystone:INSERT=2 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:53:57.884630 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd075db-845a-46a6-ba8c-9a2118cd6ae6 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:53:57.895444 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd075db-845a-46a6-ba8c-9a2118cd6ae6 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:53:57.899590 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6a7a39-fe08-4307-a755-9669eb0f0ac2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8e5d5f04c4741bb86ca4a0f667d4ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc2e3a7a1bcc480891c0b433291c00b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:53:57.900162 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6a7a39-fe08-4307-a755-9669eb0f0ac2 service cinder] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:53:57.900617 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6a7a39-fe08-4307-a755-9669eb0f0ac2 service cinder] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:53:57.901059 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6a7a39-fe08-4307-a755-9669eb0f0ac2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:53:58.000031 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6a7a39-fe08-4307-a755-9669eb0f0ac2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:53:58.002482 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6a7a39-fe08-4307-a755-9669eb0f0ac2 service cinder] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:53:58.015839 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 844/1685] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Oct 27 09:53:57 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 09:53:58.140870 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:53:59.562025 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:53:59.786766 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:53:59.903106 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f79f8f7-b4bf-41ce-8c1e-653d180c4069 service cinder] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:53:59.912661 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f79f8f7-b4bf-41ce-8c1e-653d180c4069 service cinder] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:53:59.916862 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb894993-590f-4ede-9bfc-7f5b63d5b6d2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8e5d5f04c4741bb86ca4a0f667d4ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc2e3a7a1bcc480891c0b433291c00b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:53:59.918438 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb894993-590f-4ede-9bfc-7f5b63d5b6d2 service cinder] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:53:59.918438 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb894993-590f-4ede-9bfc-7f5b63d5b6d2 service cinder] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:53:59.918438 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb894993-590f-4ede-9bfc-7f5b63d5b6d2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:53:59.928728 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb894993-590f-4ede-9bfc-7f5b63d5b6d2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:53:59.930198 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb894993-590f-4ede-9bfc-7f5b63d5b6d2 service cinder] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:53:59.940821 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 842/1686] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Oct 27 09:53:59 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 09:54:00.096997 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6a7a39-fe08-4307-a755-9669eb0f0ac2 service cinder] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:54:00.098459 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-cc6a7a39-fe08-4307-a755-9669eb0f0ac2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:54:00.171911 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6a7a39-fe08-4307-a755-9669eb0f0ac2 service cinder] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:54:00.178016 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85de1b9-33e1-4f82-8ab6-bcb073e18616 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:54:00.178804 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85de1b9-33e1-4f82-8ab6-bcb073e18616 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:54:00.179091 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85de1b9-33e1-4f82-8ab6-bcb073e18616 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:54:00.179554 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85de1b9-33e1-4f82-8ab6-bcb073e18616 admin admin] PATH_INFO: `/v3/users/bbbab01f8007402085fedfb7bcf109ca` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:54:00.180724 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85de1b9-33e1-4f82-8ab6-bcb073e18616 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bbbab01f8007402085fedfb7bcf109ca)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:54:00.183224 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85de1b9-33e1-4f82-8ab6-bcb073e18616 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:54:00.426778 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-f85de1b9-33e1-4f82-8ab6-bcb073e18616 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bbbab01f8007402085fedfb7bcf109ca'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:54:00.472693 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-f85de1b9-33e1-4f82-8ab6-bcb073e18616 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bbbab01f8007402085fedfb7bcf109ca'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:54:00.473453 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-f85de1b9-33e1-4f82-8ab6-bcb073e18616 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bbbab01f8007402085fedfb7bcf109ca'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:54:00.484685 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-f85de1b9-33e1-4f82-8ab6-bcb073e18616 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bbbab01f8007402085fedfb7bcf109ca'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:54:00.567277 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-f85de1b9-33e1-4f82-8ab6-bcb073e18616 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bbbab01f8007402085fedfb7bcf109ca'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:54:00.574618 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 845/1687] 10.222.0.65 () {58 vars in 1224 bytes} [Thu Oct 27 09:54:00 2022] DELETE /identity/v3/users/bbbab01f8007402085fedfb7bcf109ca => generated 0 bytes in 478 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 09:54:00.582276 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c924bae3-2b90-4386-8d18-49fb91853db4 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:54:00.583518 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c924bae3-2b90-4386-8d18-49fb91853db4 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:54:00.583901 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c924bae3-2b90-4386-8d18-49fb91853db4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:54:00.606100 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-c924bae3-2b90-4386-8d18-49fb91853db4 None None] MFA Rules not processed for user `b5065084bf664b99bdeac46067cb0f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:54:00.607428 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-c924bae3-2b90-4386-8d18-49fb91853db4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:54:00.679718 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 843/1688] 10.222.0.65 () {58 vars in 958 bytes} [Thu Oct 27 09:54:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 09:54:00.694814 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85de1b9-33e1-4f82-8ab6-bcb073e18616 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:54:00.696350 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-f85de1b9-33e1-4f82-8ab6-bcb073e18616 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:54:00.780179 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85de1b9-33e1-4f82-8ab6-bcb073e18616 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:54:00.784056 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d94abb-9bca-495a-b146-c8570b484823 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6191cc41efa74f46b49022cf387f7a4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc2e3a7a1bcc480891c0b433291c00b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:54:00.784666 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d94abb-9bca-495a-b146-c8570b484823 service neutron] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:54:00.784964 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d94abb-9bca-495a-b146-c8570b484823 service neutron] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:54:00.785223 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d94abb-9bca-495a-b146-c8570b484823 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:54:00.805522 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d94abb-9bca-495a-b146-c8570b484823 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:54:00.805522 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d94abb-9bca-495a-b146-c8570b484823 service neutron] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:54:00.815017 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 846/1689] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Oct 27 09:54:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 09:54:01.175077 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a3bfdb-e418-4d05-b304-ad03dcfc7300 None None] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:54:01.175345 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a3bfdb-e418-4d05-b304-ad03dcfc7300 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:54:01.176399 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a3bfdb-e418-4d05-b304-ad03dcfc7300 None None] PATH_INFO: `/` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:54:01.177234 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 844/1690] 10.222.0.65 () {54 vars in 921 bytes} [Thu Oct 27 09:54:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 09:54:01.223896 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d30dd0a-4196-4c37-9f90-f79128b58eaf None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:54:01.224494 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d30dd0a-4196-4c37-9f90-f79128b58eaf None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:54:01.225035 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d30dd0a-4196-4c37-9f90-f79128b58eaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:54:01.254899 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-9d30dd0a-4196-4c37-9f90-f79128b58eaf None None] MFA Rules not processed for user `f8c47ff5d72943f6bab09b5df6198d64`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:54:01.257222 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-9d30dd0a-4196-4c37-9f90-f79128b58eaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:54:01.343305 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 847/1691] 10.222.0.65 () {58 vars in 1018 bytes} [Thu Oct 27 09:54:01 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 09:54:01.355658 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2a3081-7df6-4329-8705-258674b68ad0 None None] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:54:01.356325 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2a3081-7df6-4329-8705-258674b68ad0 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:54:01.356620 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2a3081-7df6-4329-8705-258674b68ad0 None None] PATH_INFO: `/` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:54:01.358004 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 845/1692] 10.222.0.65 () {54 vars in 961 bytes} [Thu Oct 27 09:54:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 09:54:01.363506 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7856456d-d4d6-422a-9abf-5db3ad6bb19f None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:54:01.363799 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7856456d-d4d6-422a-9abf-5db3ad6bb19f None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:54:01.364081 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7856456d-d4d6-422a-9abf-5db3ad6bb19f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:54:01.386434 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-7856456d-d4d6-422a-9abf-5db3ad6bb19f None None] MFA Rules not processed for user `f8c47ff5d72943f6bab09b5df6198d64`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:54:01.387703 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-7856456d-d4d6-422a-9abf-5db3ad6bb19f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:54:01.399313 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 848/1693] 10.222.0.65 () {58 vars in 1058 bytes} [Thu Oct 27 09:54:01 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 09:54:01.405565 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2a3081-7df6-4329-8705-258674b68ad0 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:54:01.407485 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-4e2a3081-7df6-4329-8705-258674b68ad0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:54:01.409535 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7856456d-d4d6-422a-9abf-5db3ad6bb19f None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:54:01.421746 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7856456d-d4d6-422a-9abf-5db3ad6bb19f None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:54:01.430160 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2a3081-7df6-4329-8705-258674b68ad0 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:54:01.437088 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb72ce8-dd0d-4a42-adbb-fef5d1f7f3df service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8c47ff5d72943f6bab09b5df6198d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc2e3a7a1bcc480891c0b433291c00b1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:54:01.437410 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413bf7fb-7adc-405f-aee7-7633afa61b5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:54:01.437876 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb72ce8-dd0d-4a42-adbb-fef5d1f7f3df service placement] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:54:01.438044 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413bf7fb-7adc-405f-aee7-7633afa61b5a admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:54:01.438148 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb72ce8-dd0d-4a42-adbb-fef5d1f7f3df service placement] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:54:01.438323 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413bf7fb-7adc-405f-aee7-7633afa61b5a admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:54:01.438415 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb72ce8-dd0d-4a42-adbb-fef5d1f7f3df service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:54:01.438630 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413bf7fb-7adc-405f-aee7-7633afa61b5a admin admin] PATH_INFO: `/v3/users/622419e7b1a54c5caba91e1b68faa8b9` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:54:01.439824 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413bf7fb-7adc-405f-aee7-7633afa61b5a admin admin] RBAC: Authorizing `identity:delete_user(user_id=622419e7b1a54c5caba91e1b68faa8b9)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:54:01.441854 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413bf7fb-7adc-405f-aee7-7633afa61b5a admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:54:01.448078 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb72ce8-dd0d-4a42-adbb-fef5d1f7f3df service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:54:01.449673 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb72ce8-dd0d-4a42-adbb-fef5d1f7f3df service placement] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:54:01.460794 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 849/1694] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Oct 27 09:54:01 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 09:54:01.559848 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb72ce8-dd0d-4a42-adbb-fef5d1f7f3df service placement] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:54:01.559848 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-5bb72ce8-dd0d-4a42-adbb-fef5d1f7f3df service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:54:01.572244 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb72ce8-dd0d-4a42-adbb-fef5d1f7f3df service placement] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:54:01.577515 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3eeac5-38de-4292-be73-498911858fe7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:54:01.578220 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3eeac5-38de-4292-be73-498911858fe7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:54:01.578787 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3eeac5-38de-4292-be73-498911858fe7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:54:01.579130 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3eeac5-38de-4292-be73-498911858fe7 admin admin] PATH_INFO: `/v3/projects/179672b48d84497d9adc32b6e2b9dd9f` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:54:01.580870 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3eeac5-38de-4292-be73-498911858fe7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=179672b48d84497d9adc32b6e2b9dd9f)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:54:01.580971 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:54:01.583557 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3eeac5-38de-4292-be73-498911858fe7 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:54:01.663462 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-413bf7fb-7adc-405f-aee7-7633afa61b5a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '622419e7b1a54c5caba91e1b68faa8b9'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:54:01.664145 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-413bf7fb-7adc-405f-aee7-7633afa61b5a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '622419e7b1a54c5caba91e1b68faa8b9'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:54:01.671183 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-413bf7fb-7adc-405f-aee7-7633afa61b5a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '622419e7b1a54c5caba91e1b68faa8b9'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:54:01.671841 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-413bf7fb-7adc-405f-aee7-7633afa61b5a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '622419e7b1a54c5caba91e1b68faa8b9'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:54:01.683840 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-413bf7fb-7adc-405f-aee7-7633afa61b5a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '622419e7b1a54c5caba91e1b68faa8b9'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:54:01.741158 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-9b3eeac5-38de-4292-be73-498911858fe7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '179672b48d84497d9adc32b6e2b9dd9f', 'request_id': 'req-9b3eeac5-38de-4292-be73-498911858fe7'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:54:01.792897 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 846/1695] 10.222.0.65 () {58 vars in 1224 bytes} [Thu Oct 27 09:54:01 2022] DELETE /identity/v3/users/622419e7b1a54c5caba91e1b68faa8b9 => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 09:54:01.821274 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:54:01.851018 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-9b3eeac5-38de-4292-be73-498911858fe7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '179672b48d84497d9adc32b6e2b9dd9f', 'request_id': 'req-9b3eeac5-38de-4292-be73-498911858fe7'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:54:01.860404 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-9b3eeac5-38de-4292-be73-498911858fe7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '179672b48d84497d9adc32b6e2b9dd9f', 'request_id': 'req-9b3eeac5-38de-4292-be73-498911858fe7'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:54:01.873881 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-9b3eeac5-38de-4292-be73-498911858fe7 admin admin] The token cache is being invalidate because project 179672b48d84497d9adc32b6e2b9dd9f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 09:54:01.874180 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-9b3eeac5-38de-4292-be73-498911858fe7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:54:01.874936 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-9b3eeac5-38de-4292-be73-498911858fe7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:54:01.876751 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 850/1696] 10.222.0.65 () {58 vars in 1233 bytes} [Thu Oct 27 09:54:01 2022] DELETE /identity/v3/projects/179672b48d84497d9adc32b6e2b9dd9f => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 09:54:01.881312 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413bf7fb-7adc-405f-aee7-7633afa61b5a admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:54:01.882917 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-413bf7fb-7adc-405f-aee7-7633afa61b5a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:54:01.963181 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413bf7fb-7adc-405f-aee7-7633afa61b5a admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:54:01.968477 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21464f76-6c76-44d3-9ff7-c60d3a98e393 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:54:01.969354 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21464f76-6c76-44d3-9ff7-c60d3a98e393 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:54:01.969773 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21464f76-6c76-44d3-9ff7-c60d3a98e393 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:54:01.970081 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21464f76-6c76-44d3-9ff7-c60d3a98e393 admin admin] PATH_INFO: `/v3/users/18230c4332064db696a2b66de170c2d6` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:54:01.971315 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21464f76-6c76-44d3-9ff7-c60d3a98e393 admin admin] RBAC: Authorizing `identity:delete_user(user_id=18230c4332064db696a2b66de170c2d6)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:54:01.973260 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21464f76-6c76-44d3-9ff7-c60d3a98e393 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:54:02.103550 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3eeac5-38de-4292-be73-498911858fe7 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:54:02.105119 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-9b3eeac5-38de-4292-be73-498911858fe7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:54:02.188331 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3eeac5-38de-4292-be73-498911858fe7 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:54:02.193467 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51177992-0bfb-486f-8308-f3c6e6facd6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:54:02.194101 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51177992-0bfb-486f-8308-f3c6e6facd6f admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:54:02.194385 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51177992-0bfb-486f-8308-f3c6e6facd6f admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:54:02.194701 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51177992-0bfb-486f-8308-f3c6e6facd6f admin admin] PATH_INFO: `/v3/projects/2f875efc6bb84d0fbf57ce3cf68a6ce8` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:54:02.195851 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51177992-0bfb-486f-8308-f3c6e6facd6f admin admin] RBAC: Authorizing `identity:delete_project(project_id=2f875efc6bb84d0fbf57ce3cf68a6ce8)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:54:02.197768 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51177992-0bfb-486f-8308-f3c6e6facd6f admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:54:02.201294 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-21464f76-6c76-44d3-9ff7-c60d3a98e393 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '18230c4332064db696a2b66de170c2d6'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:54:02.201459 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-21464f76-6c76-44d3-9ff7-c60d3a98e393 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '18230c4332064db696a2b66de170c2d6'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:54:02.209211 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-21464f76-6c76-44d3-9ff7-c60d3a98e393 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '18230c4332064db696a2b66de170c2d6'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:54:02.209927 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-21464f76-6c76-44d3-9ff7-c60d3a98e393 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '18230c4332064db696a2b66de170c2d6'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:54:02.223046 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-21464f76-6c76-44d3-9ff7-c60d3a98e393 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '18230c4332064db696a2b66de170c2d6'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:54:02.317069 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-51177992-0bfb-486f-8308-f3c6e6facd6f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2f875efc6bb84d0fbf57ce3cf68a6ce8', 'request_id': 'req-51177992-0bfb-486f-8308-f3c6e6facd6f'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:54:02.340879 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 847/1697] 10.222.0.65 () {58 vars in 1224 bytes} [Thu Oct 27 09:54:01 2022] DELETE /identity/v3/users/18230c4332064db696a2b66de170c2d6 => generated 0 bytes in 461 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 09:54:02.448492 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-51177992-0bfb-486f-8308-f3c6e6facd6f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2f875efc6bb84d0fbf57ce3cf68a6ce8', 'request_id': 'req-51177992-0bfb-486f-8308-f3c6e6facd6f'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:54:02.462979 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-51177992-0bfb-486f-8308-f3c6e6facd6f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2f875efc6bb84d0fbf57ce3cf68a6ce8', 'request_id': 'req-51177992-0bfb-486f-8308-f3c6e6facd6f'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:54:02.477363 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-51177992-0bfb-486f-8308-f3c6e6facd6f admin admin] The token cache is being invalidate because project 2f875efc6bb84d0fbf57ce3cf68a6ce8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 09:54:02.477994 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-51177992-0bfb-486f-8308-f3c6e6facd6f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:54:02.478941 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-51177992-0bfb-486f-8308-f3c6e6facd6f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:54:02.481457 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 851/1698] 10.222.0.65 () {58 vars in 1233 bytes} [Thu Oct 27 09:54:02 2022] DELETE /identity/v3/projects/2f875efc6bb84d0fbf57ce3cf68a6ce8 => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 09:54:02.486367 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb915dca-6ef7-48c5-a7d5-94c91c407161 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:54:02.487128 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb915dca-6ef7-48c5-a7d5-94c91c407161 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:54:02.488046 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb915dca-6ef7-48c5-a7d5-94c91c407161 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:54:02.518062 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-bb915dca-6ef7-48c5-a7d5-94c91c407161 None None] MFA Rules not processed for user `b5065084bf664b99bdeac46067cb0f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:54:02.519343 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-bb915dca-6ef7-48c5-a7d5-94c91c407161 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:54:02.575261 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:54:02.595952 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 848/1699] 10.222.0.65 () {58 vars in 958 bytes} [Thu Oct 27 09:54:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 09:54:02.603781 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a19a3eb-fdb4-41d3-86cf-570287feec81 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:54:02.608682 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a19a3eb-fdb4-41d3-86cf-570287feec81 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:54:02.608682 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a19a3eb-fdb4-41d3-86cf-570287feec81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:54:02.627087 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-8a19a3eb-fdb4-41d3-86cf-570287feec81 None None] MFA Rules not processed for user `b5065084bf664b99bdeac46067cb0f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:54:02.636765 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-8a19a3eb-fdb4-41d3-86cf-570287feec81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:54:02.637161 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 852/1700] 10.222.0.65 () {58 vars in 958 bytes} [Thu Oct 27 09:54:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 09:54:02.641302 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb915dca-6ef7-48c5-a7d5-94c91c407161 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:54:02.651221 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb915dca-6ef7-48c5-a7d5-94c91c407161 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:54:02.656359 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f54eaf-7292-4640-bfdd-9b10119d522b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:54:02.656972 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f54eaf-7292-4640-bfdd-9b10119d522b admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:54:02.657248 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f54eaf-7292-4640-bfdd-9b10119d522b admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:54:02.657514 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f54eaf-7292-4640-bfdd-9b10119d522b admin admin] PATH_INFO: `/v3/domains` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:54:02.658160 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f54eaf-7292-4640-bfdd-9b10119d522b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 09:54:02.658465 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f54eaf-7292-4640-bfdd-9b10119d522b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:54:02.660097 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f54eaf-7292-4640-bfdd-9b10119d522b admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:54:02.673242 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 849/1701] 10.222.0.65 () {58 vars in 1153 bytes} [Thu Oct 27 09:54:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 09:54:02.678231 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a19a3eb-fdb4-41d3-86cf-570287feec81 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:54:02.687751 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a19a3eb-fdb4-41d3-86cf-570287feec81 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:54:02.692542 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648aa120-c527-4c79-a904-48882cb6b98e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:54:02.693195 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648aa120-c527-4c79-a904-48882cb6b98e admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:54:02.693651 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648aa120-c527-4c79-a904-48882cb6b98e admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:54:02.693924 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648aa120-c527-4c79-a904-48882cb6b98e admin admin] PATH_INFO: `/v3/projects` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:54:02.694591 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648aa120-c527-4c79-a904-48882cb6b98e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:54:02.696499 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648aa120-c527-4c79-a904-48882cb6b98e admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:54:02.782314 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f54eaf-7292-4640-bfdd-9b10119d522b admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:54:02.782900 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 853/1702] 10.222.0.65 () {60 vars in 1153 bytes} [Thu Oct 27 09:54:02 2022] POST /identity/v3/projects => generated 405 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 09:54:02.784487 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-13f54eaf-7292-4640-bfdd-9b10119d522b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:54:02.787314 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648aa120-c527-4c79-a904-48882cb6b98e admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:54:02.800318 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f54eaf-7292-4640-bfdd-9b10119d522b admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:54:02.870589 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648aa120-c527-4c79-a904-48882cb6b98e admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:54:02.871174 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6880dccc-a1d7-40dd-b2c1-95af25cc07f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:54:02.871585 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6880dccc-a1d7-40dd-b2c1-95af25cc07f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:54:02.871867 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6880dccc-a1d7-40dd-b2c1-95af25cc07f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:54:02.872163 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6880dccc-a1d7-40dd-b2c1-95af25cc07f2 admin admin] PATH_INFO: `/v3/projects/fa607de9739042b4b271957c9c6d5090` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:54:02.873324 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6880dccc-a1d7-40dd-b2c1-95af25cc07f2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fa607de9739042b4b271957c9c6d5090)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:54:02.875273 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6880dccc-a1d7-40dd-b2c1-95af25cc07f2 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:54:02.876069 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2b119d-e3ac-4af0-936c-58fa47eeeff3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:54:02.876735 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2b119d-e3ac-4af0-936c-58fa47eeeff3 admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:54:02.877013 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2b119d-e3ac-4af0-936c-58fa47eeeff3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:54:02.877326 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2b119d-e3ac-4af0-936c-58fa47eeeff3 admin admin] PATH_INFO: `/v3/users` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:54:02.877970 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2b119d-e3ac-4af0-936c-58fa47eeeff3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:54:02.880468 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2b119d-e3ac-4af0-936c-58fa47eeeff3 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:54:02.980541 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:54:02.986926 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 854/1703] 10.222.0.65 () {60 vars in 1144 bytes} [Thu Oct 27 09:54:02 2022] POST /identity/v3/users => generated 303 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 09:54:02.991941 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2b119d-e3ac-4af0-936c-58fa47eeeff3 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:54:03.001998 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2b119d-e3ac-4af0-936c-58fa47eeeff3 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:54:03.007517 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da2c98c-7353-48ff-a4fb-a61910f7f50c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:54:03.008271 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da2c98c-7353-48ff-a4fb-a61910f7f50c admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:54:03.008384 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da2c98c-7353-48ff-a4fb-a61910f7f50c admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:54:03.008721 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da2c98c-7353-48ff-a4fb-a61910f7f50c admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:54:03.009367 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da2c98c-7353-48ff-a4fb-a61910f7f50c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:54:03.011033 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da2c98c-7353-48ff-a4fb-a61910f7f50c admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:54:03.022125 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 855/1704] 10.222.0.65 () {58 vars in 1122 bytes} [Thu Oct 27 09:54:02 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 09:54:03.026121 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da2c98c-7353-48ff-a4fb-a61910f7f50c admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:54:03.037522 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da2c98c-7353-48ff-a4fb-a61910f7f50c admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:54:03.047725 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-6880dccc-a1d7-40dd-b2c1-95af25cc07f2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fa607de9739042b4b271957c9c6d5090', 'request_id': 'req-6880dccc-a1d7-40dd-b2c1-95af25cc07f2'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:54:03.054446 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-6880dccc-a1d7-40dd-b2c1-95af25cc07f2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fa607de9739042b4b271957c9c6d5090', 'request_id': 'req-6880dccc-a1d7-40dd-b2c1-95af25cc07f2'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:54:03.104366 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82baed47-4732-454a-bd97-caf35612fd99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:54:03.105313 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82baed47-4732-454a-bd97-caf35612fd99 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:54:03.105726 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82baed47-4732-454a-bd97-caf35612fd99 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:54:03.106059 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82baed47-4732-454a-bd97-caf35612fd99 admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:54:03.106994 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82baed47-4732-454a-bd97-caf35612fd99 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:54:03.111735 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82baed47-4732-454a-bd97-caf35612fd99 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:54:03.121750 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 856/1705] 10.222.0.65 () {58 vars in 1122 bytes} [Thu Oct 27 09:54:03 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 09:54:03.125694 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82baed47-4732-454a-bd97-caf35612fd99 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:54:03.136117 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82baed47-4732-454a-bd97-caf35612fd99 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:54:03.141110 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b25962f-5990-4c4b-8ea8-295f82544144 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:54:03.141824 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b25962f-5990-4c4b-8ea8-295f82544144 admin admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:54:03.142070 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b25962f-5990-4c4b-8ea8-295f82544144 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:54:03.142347 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b25962f-5990-4c4b-8ea8-295f82544144 admin admin] PATH_INFO: `/v3/projects/e28400376c2c40a48510bab75c0fa0b0/users/d0f89d0e4c8b4163b76b4915f2591865/roles/43543ce1450245af9661cb017bac17bd` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:54:03.159134 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b25962f-5990-4c4b-8ea8-295f82544144 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e28400376c2c40a48510bab75c0fa0b0, user_id=d0f89d0e4c8b4163b76b4915f2591865, role_id=43543ce1450245af9661cb017bac17bd)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:54:03.164949 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b25962f-5990-4c4b-8ea8-295f82544144 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:54:03.184337 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-6880dccc-a1d7-40dd-b2c1-95af25cc07f2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fa607de9739042b4b271957c9c6d5090', 'request_id': 'req-6880dccc-a1d7-40dd-b2c1-95af25cc07f2'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:54:03.195656 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-6880dccc-a1d7-40dd-b2c1-95af25cc07f2 admin admin] The token cache is being invalidate because project fa607de9739042b4b271957c9c6d5090 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 09:54:03.195881 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-6880dccc-a1d7-40dd-b2c1-95af25cc07f2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:54:03.196545 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-6880dccc-a1d7-40dd-b2c1-95af25cc07f2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:54:03.198082 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 850/1706] 10.222.0.65 () {58 vars in 1233 bytes} [Thu Oct 27 09:54:02 2022] DELETE /identity/v3/projects/fa607de9739042b4b271957c9c6d5090 => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 09:54:03.206742 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6880dccc-a1d7-40dd-b2c1-95af25cc07f2 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:54:03.208894 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-6880dccc-a1d7-40dd-b2c1-95af25cc07f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:54:03.221422 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6880dccc-a1d7-40dd-b2c1-95af25cc07f2 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:54:03.227021 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7c8609-d56c-4874-a173-22cf97118823 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:54:03.227673 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7c8609-d56c-4874-a173-22cf97118823 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:54:03.227957 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7c8609-d56c-4874-a173-22cf97118823 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:54:03.228230 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7c8609-d56c-4874-a173-22cf97118823 admin admin] PATH_INFO: `/v3/users/1029afd1accb46bf9f7f57c027ab5af6` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:54:03.229387 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7c8609-d56c-4874-a173-22cf97118823 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1029afd1accb46bf9f7f57c027ab5af6)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:54:03.231364 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7c8609-d56c-4874-a173-22cf97118823 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:54:03.282024 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 857/1707] 10.222.0.65 () {60 vars in 1483 bytes} [Thu Oct 27 09:54:03 2022] PUT /identity/v3/projects/e28400376c2c40a48510bab75c0fa0b0/users/d0f89d0e4c8b4163b76b4915f2591865/roles/43543ce1450245af9661cb017bac17bd => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 09:54:03.294169 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4de895-07f7-432e-a2fb-27963230265c None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:54:03.294586 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4de895-07f7-432e-a2fb-27963230265c None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:54:03.294869 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4de895-07f7-432e-a2fb-27963230265c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:54:03.328036 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-9c4de895-07f7-432e-a2fb-27963230265c None None] MFA Rules not processed for user `d0f89d0e4c8b4163b76b4915f2591865`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:54:03.329303 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-9c4de895-07f7-432e-a2fb-27963230265c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:54:03.363320 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:54:03.402370 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 858/1708] 10.222.0.65 () {58 vars in 958 bytes} [Thu Oct 27 09:54:03 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 09:54:03.407184 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4de895-07f7-432e-a2fb-27963230265c None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:54:03.408508 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-9c4de895-07f7-432e-a2fb-27963230265c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:54:03.474970 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4de895-07f7-432e-a2fb-27963230265c None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:54:03.479651 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8294f7-07a6-4d8c-bc71-237437711531 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:54:03.479820 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-ab7c8609-d56c-4874-a173-22cf97118823 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1029afd1accb46bf9f7f57c027ab5af6'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:54:03.480265 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8294f7-07a6-4d8c-bc71-237437711531 admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:54:03.480499 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-ab7c8609-d56c-4874-a173-22cf97118823 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1029afd1accb46bf9f7f57c027ab5af6'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:54:03.480607 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8294f7-07a6-4d8c-bc71-237437711531 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:54:03.480796 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8294f7-07a6-4d8c-bc71-237437711531 admin admin] PATH_INFO: `/v3/projects` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:54:03.481424 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8294f7-07a6-4d8c-bc71-237437711531 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:54:03.483379 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8294f7-07a6-4d8c-bc71-237437711531 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:54:03.488072 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-ab7c8609-d56c-4874-a173-22cf97118823 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1029afd1accb46bf9f7f57c027ab5af6'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:54:03.489293 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-ab7c8609-d56c-4874-a173-22cf97118823 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1029afd1accb46bf9f7f57c027ab5af6'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:54:03.522004 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-ab7c8609-d56c-4874-a173-22cf97118823 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1029afd1accb46bf9f7f57c027ab5af6'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:54:03.594100 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 859/1709] 10.222.0.65 () {60 vars in 1153 bytes} [Thu Oct 27 09:54:03 2022] POST /identity/v3/projects => generated 405 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 09:54:03.600539 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8294f7-07a6-4d8c-bc71-237437711531 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:54:03.603624 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-bc8294f7-07a6-4d8c-bc71-237437711531 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:54:03.618770 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 851/1710] 10.222.0.65 () {58 vars in 1224 bytes} [Thu Oct 27 09:54:03 2022] DELETE /identity/v3/users/1029afd1accb46bf9f7f57c027ab5af6 => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 09:54:03.697378 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8294f7-07a6-4d8c-bc71-237437711531 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:54:03.757885 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1146bda-86b0-4265-b01f-ca2a9cb1b4c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:54:03.758601 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1146bda-86b0-4265-b01f-ca2a9cb1b4c1 admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:54:03.758827 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1146bda-86b0-4265-b01f-ca2a9cb1b4c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:54:03.759105 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1146bda-86b0-4265-b01f-ca2a9cb1b4c1 admin admin] PATH_INFO: `/v3/users` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:54:03.759749 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1146bda-86b0-4265-b01f-ca2a9cb1b4c1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:54:03.761692 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1146bda-86b0-4265-b01f-ca2a9cb1b4c1 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:54:03.857099 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 860/1711] 10.222.0.65 () {60 vars in 1144 bytes} [Thu Oct 27 09:54:03 2022] POST /identity/v3/users => generated 309 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 09:54:03.857774 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7c8609-d56c-4874-a173-22cf97118823 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:54:03.869214 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7c8609-d56c-4874-a173-22cf97118823 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:54:03.874009 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3794704b-79ac-4ba5-8a0e-a42503e4f874 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:54:03.874653 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3794704b-79ac-4ba5-8a0e-a42503e4f874 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:54:03.874942 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3794704b-79ac-4ba5-8a0e-a42503e4f874 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:54:03.875223 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3794704b-79ac-4ba5-8a0e-a42503e4f874 admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:54:03.875952 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3794704b-79ac-4ba5-8a0e-a42503e4f874 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:54:03.877647 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3794704b-79ac-4ba5-8a0e-a42503e4f874 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:54:03.888556 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 852/1712] 10.222.0.65 () {58 vars in 1122 bytes} [Thu Oct 27 09:54:03 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 09:54:03.892802 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1146bda-86b0-4265-b01f-ca2a9cb1b4c1 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:54:03.903920 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1146bda-86b0-4265-b01f-ca2a9cb1b4c1 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:54:03.910021 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d6935e-9fbc-48f7-8621-e4663dd441b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:54:03.910021 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d6935e-9fbc-48f7-8621-e4663dd441b0 admin admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:54:03.910021 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d6935e-9fbc-48f7-8621-e4663dd441b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:54:03.910330 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d6935e-9fbc-48f7-8621-e4663dd441b0 admin admin] PATH_INFO: `/v3/projects/dba2a9b358d0461ab0e455968c3c9d84/users/7d8485f135094566a91d94c5321a66e7/roles/6ad17b9f9dea4b66ab2da3677d7e715d` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:54:03.927739 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d6935e-9fbc-48f7-8621-e4663dd441b0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dba2a9b358d0461ab0e455968c3c9d84, user_id=7d8485f135094566a91d94c5321a66e7, role_id=6ad17b9f9dea4b66ab2da3677d7e715d)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:54:03.930640 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d6935e-9fbc-48f7-8621-e4663dd441b0 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:54:04.032608 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 861/1713] 10.222.0.65 () {60 vars in 1483 bytes} [Thu Oct 27 09:54:03 2022] PUT /identity/v3/projects/dba2a9b358d0461ab0e455968c3c9d84/users/7d8485f135094566a91d94c5321a66e7/roles/6ad17b9f9dea4b66ab2da3677d7e715d => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 09:54:04.038051 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3794704b-79ac-4ba5-8a0e-a42503e4f874 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:54:04.048040 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3794704b-79ac-4ba5-8a0e-a42503e4f874 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:54:04.108163 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ee7c9b-741a-4789-92e4-c8cff94f97b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:54:04.108777 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ee7c9b-741a-4789-92e4-c8cff94f97b2 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:54:04.109063 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ee7c9b-741a-4789-92e4-c8cff94f97b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:54:04.109339 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ee7c9b-741a-4789-92e4-c8cff94f97b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:54:04.109978 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ee7c9b-741a-4789-92e4-c8cff94f97b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:54:04.111733 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ee7c9b-741a-4789-92e4-c8cff94f97b2 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:54:04.122319 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 853/1714] 10.222.0.65 () {58 vars in 1122 bytes} [Thu Oct 27 09:54:04 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 09:54:04.126626 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d6935e-9fbc-48f7-8621-e4663dd441b0 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:54:04.138884 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d6935e-9fbc-48f7-8621-e4663dd441b0 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:54:04.151270 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46eba2c8-e647-42fe-8ff9-80573c8a62ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:54:04.151954 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46eba2c8-e647-42fe-8ff9-80573c8a62ac admin admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:54:04.152237 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46eba2c8-e647-42fe-8ff9-80573c8a62ac admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:54:04.152514 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46eba2c8-e647-42fe-8ff9-80573c8a62ac admin admin] PATH_INFO: `/v3/projects/dba2a9b358d0461ab0e455968c3c9d84/users/7d8485f135094566a91d94c5321a66e7/roles/6ad17b9f9dea4b66ab2da3677d7e715d` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:54:04.154881 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46eba2c8-e647-42fe-8ff9-80573c8a62ac admin admin] RBAC: Authorizing `identity:create_grant(project_id=dba2a9b358d0461ab0e455968c3c9d84, user_id=7d8485f135094566a91d94c5321a66e7, role_id=6ad17b9f9dea4b66ab2da3677d7e715d)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:54:04.157527 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46eba2c8-e647-42fe-8ff9-80573c8a62ac admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:54:04.168743 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 862/1715] 10.222.0.65 () {60 vars in 1483 bytes} [Thu Oct 27 09:54:04 2022] PUT /identity/v3/projects/dba2a9b358d0461ab0e455968c3c9d84/users/7d8485f135094566a91d94c5321a66e7/roles/6ad17b9f9dea4b66ab2da3677d7e715d => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 09:54:04.176350 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ee7c9b-741a-4789-92e4-c8cff94f97b2 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:54:04.179044 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-c3ee7c9b-741a-4789-92e4-c8cff94f97b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:54:04.180662 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0d6ff2-a308-4488-97af-4da55246c238 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:54:04.180960 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0d6ff2-a308-4488-97af-4da55246c238 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:54:04.181262 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0d6ff2-a308-4488-97af-4da55246c238 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:54:04.205962 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ee7c9b-741a-4789-92e4-c8cff94f97b2 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:54:04.217533 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-9e0d6ff2-a308-4488-97af-4da55246c238 None None] MFA Rules not processed for user `7d8485f135094566a91d94c5321a66e7`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:54:04.219169 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-9e0d6ff2-a308-4488-97af-4da55246c238 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:54:04.280813 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec680ac-cd08-42de-b5af-6a2d1a6bf896 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:54:04.281456 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec680ac-cd08-42de-b5af-6a2d1a6bf896 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:54:04.281745 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec680ac-cd08-42de-b5af-6a2d1a6bf896 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:54:04.282022 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec680ac-cd08-42de-b5af-6a2d1a6bf896 admin admin] PATH_INFO: `/v3/projects/d6336667576941d0aa83991a18b40a85` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:54:04.282146 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:54:04.283517 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec680ac-cd08-42de-b5af-6a2d1a6bf896 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d6336667576941d0aa83991a18b40a85)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:54:04.285595 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec680ac-cd08-42de-b5af-6a2d1a6bf896 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:54:04.302650 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 863/1716] 10.222.0.65 () {58 vars in 958 bytes} [Thu Oct 27 09:54:04 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 09:54:04.313999 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0d6ff2-a308-4488-97af-4da55246c238 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:54:04.315935 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-9e0d6ff2-a308-4488-97af-4da55246c238 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:54:04.376557 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0d6ff2-a308-4488-97af-4da55246c238 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:54:04.380741 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6104305-44ee-43e6-92da-bbafaff9afad service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8e5d5f04c4741bb86ca4a0f667d4ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc2e3a7a1bcc480891c0b433291c00b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:54:04.381348 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6104305-44ee-43e6-92da-bbafaff9afad service cinder] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:54:04.381628 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6104305-44ee-43e6-92da-bbafaff9afad service cinder] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:54:04.381901 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6104305-44ee-43e6-92da-bbafaff9afad service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:54:04.391511 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6104305-44ee-43e6-92da-bbafaff9afad service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:54:04.392962 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6104305-44ee-43e6-92da-bbafaff9afad service cinder] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:54:04.403216 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 864/1717] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Oct 27 09:54:04 2022] GET /identity/v3/auth/tokens => generated 3349 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 09:54:04.439663 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-eec680ac-cd08-42de-b5af-6a2d1a6bf896 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd6336667576941d0aa83991a18b40a85', 'request_id': 'req-eec680ac-cd08-42de-b5af-6a2d1a6bf896'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:54:04.450146 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-eec680ac-cd08-42de-b5af-6a2d1a6bf896 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd6336667576941d0aa83991a18b40a85', 'request_id': 'req-eec680ac-cd08-42de-b5af-6a2d1a6bf896'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:54:04.548534 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6104305-44ee-43e6-92da-bbafaff9afad service cinder] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:54:04.556843 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-eec680ac-cd08-42de-b5af-6a2d1a6bf896 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd6336667576941d0aa83991a18b40a85', 'request_id': 'req-eec680ac-cd08-42de-b5af-6a2d1a6bf896'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:54:04.559682 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6104305-44ee-43e6-92da-bbafaff9afad service cinder] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:54:04.569413 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-eec680ac-cd08-42de-b5af-6a2d1a6bf896 admin admin] The token cache is being invalidate because project d6336667576941d0aa83991a18b40a85 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 09:54:04.569709 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-eec680ac-cd08-42de-b5af-6a2d1a6bf896 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:54:04.570389 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-eec680ac-cd08-42de-b5af-6a2d1a6bf896 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:54:04.571963 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 854/1718] 10.222.0.65 () {58 vars in 1233 bytes} [Thu Oct 27 09:54:04 2022] DELETE /identity/v3/projects/d6336667576941d0aa83991a18b40a85 => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 09:54:04.581836 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:54:04.625963 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b00370-8ce8-471b-a001-f64a50fd217c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:54:04.626609 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b00370-8ce8-471b-a001-f64a50fd217c admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:54:04.626897 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b00370-8ce8-471b-a001-f64a50fd217c admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:54:04.627174 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b00370-8ce8-471b-a001-f64a50fd217c admin admin] PATH_INFO: `/v3/users/d0f89d0e4c8b4163b76b4915f2591865` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:54:04.628341 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b00370-8ce8-471b-a001-f64a50fd217c admin admin] RBAC: Authorizing `identity:delete_user(user_id=d0f89d0e4c8b4163b76b4915f2591865)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:54:04.631308 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b00370-8ce8-471b-a001-f64a50fd217c admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:54:04.908016 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-70b00370-8ce8-471b-a001-f64a50fd217c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd0f89d0e4c8b4163b76b4915f2591865'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:54:04.934274 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-70b00370-8ce8-471b-a001-f64a50fd217c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd0f89d0e4c8b4163b76b4915f2591865'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:54:04.934274 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-70b00370-8ce8-471b-a001-f64a50fd217c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd0f89d0e4c8b4163b76b4915f2591865'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:54:04.940345 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-70b00370-8ce8-471b-a001-f64a50fd217c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd0f89d0e4c8b4163b76b4915f2591865'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:54:04.969722 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec680ac-cd08-42de-b5af-6a2d1a6bf896 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:54:04.971278 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-eec680ac-cd08-42de-b5af-6a2d1a6bf896 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:54:04.998105 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec680ac-cd08-42de-b5af-6a2d1a6bf896 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:54:05.003528 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8b97c9-2fcc-49ed-848d-85eaa0878604 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:54:05.004361 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8b97c9-2fcc-49ed-848d-85eaa0878604 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:54:05.004782 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8b97c9-2fcc-49ed-848d-85eaa0878604 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:54:05.004996 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8b97c9-2fcc-49ed-848d-85eaa0878604 admin admin] PATH_INFO: `/v3/users/843d4c9661864015a5d5a4dcb5eb7e2e` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:54:05.006188 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8b97c9-2fcc-49ed-848d-85eaa0878604 admin admin] RBAC: Authorizing `identity:delete_user(user_id=843d4c9661864015a5d5a4dcb5eb7e2e)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:54:05.008241 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8b97c9-2fcc-49ed-848d-85eaa0878604 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:54:05.100584 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-70b00370-8ce8-471b-a001-f64a50fd217c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd0f89d0e4c8b4163b76b4915f2591865'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:54:05.107149 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 865/1719] 10.222.0.65 () {58 vars in 1224 bytes} [Thu Oct 27 09:54:04 2022] DELETE /identity/v3/users/d0f89d0e4c8b4163b76b4915f2591865 => generated 0 bytes in 559 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 09:54:05.111673 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912a28a0-ba82-4029-be46-23abe66edcfc None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:54:05.111965 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912a28a0-ba82-4029-be46-23abe66edcfc None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:54:05.112243 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912a28a0-ba82-4029-be46-23abe66edcfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:54:05.134282 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-912a28a0-ba82-4029-be46-23abe66edcfc None None] MFA Rules not processed for user `b5065084bf664b99bdeac46067cb0f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:54:05.135459 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-912a28a0-ba82-4029-be46-23abe66edcfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:54:05.204002 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 866/1720] 10.222.0.65 () {58 vars in 958 bytes} [Thu Oct 27 09:54:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 09:54:05.210384 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:54:05.214430 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-6e8b97c9-2fcc-49ed-848d-85eaa0878604 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '843d4c9661864015a5d5a4dcb5eb7e2e'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:54:05.215061 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912a28a0-ba82-4029-be46-23abe66edcfc None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:54:05.215197 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-6e8b97c9-2fcc-49ed-848d-85eaa0878604 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '843d4c9661864015a5d5a4dcb5eb7e2e'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:54:05.216444 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-912a28a0-ba82-4029-be46-23abe66edcfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:54:05.222296 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-6e8b97c9-2fcc-49ed-848d-85eaa0878604 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '843d4c9661864015a5d5a4dcb5eb7e2e'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:54:05.223066 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-6e8b97c9-2fcc-49ed-848d-85eaa0878604 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '843d4c9661864015a5d5a4dcb5eb7e2e'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:54:05.236142 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-6e8b97c9-2fcc-49ed-848d-85eaa0878604 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '843d4c9661864015a5d5a4dcb5eb7e2e'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:54:05.277796 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912a28a0-ba82-4029-be46-23abe66edcfc None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:54:05.282221 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ab8489-8ce3-4d2b-9d87-91be3113122e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6191cc41efa74f46b49022cf387f7a4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc2e3a7a1bcc480891c0b433291c00b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:54:05.282971 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ab8489-8ce3-4d2b-9d87-91be3113122e service neutron] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:54:05.283337 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ab8489-8ce3-4d2b-9d87-91be3113122e service neutron] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:54:05.284293 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ab8489-8ce3-4d2b-9d87-91be3113122e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:54:05.286156 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-90ab8489-8ce3-4d2b-9d87-91be3113122e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:54:05.298830 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ab8489-8ce3-4d2b-9d87-91be3113122e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:54:05.300271 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ab8489-8ce3-4d2b-9d87-91be3113122e service neutron] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:54:05.304806 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 855/1721] 10.222.0.65 () {58 vars in 1224 bytes} [Thu Oct 27 09:54:04 2022] DELETE /identity/v3/users/843d4c9661864015a5d5a4dcb5eb7e2e => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 09:54:05.310960 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca117f80-6723-4564-a4b9-63a7e27b32c5 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:54:05.311252 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca117f80-6723-4564-a4b9-63a7e27b32c5 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:54:05.311532 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca117f80-6723-4564-a4b9-63a7e27b32c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:54:05.313277 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 867/1722] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Oct 27 09:54:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 09:54:05.316495 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:54:05.334387 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-ca117f80-6723-4564-a4b9-63a7e27b32c5 None None] MFA Rules not processed for user `b5065084bf664b99bdeac46067cb0f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:54:05.335790 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-ca117f80-6723-4564-a4b9-63a7e27b32c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:54:05.398926 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 856/1723] 10.222.0.65 () {58 vars in 958 bytes} [Thu Oct 27 09:54:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 09:54:05.409472 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ab8489-8ce3-4d2b-9d87-91be3113122e service neutron] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:54:05.411806 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-90ab8489-8ce3-4d2b-9d87-91be3113122e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:54:05.423492 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ab8489-8ce3-4d2b-9d87-91be3113122e service neutron] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:54:05.474239 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3fb1c3-747e-42b7-bea9-b68bfc9c6ea4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6191cc41efa74f46b49022cf387f7a4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc2e3a7a1bcc480891c0b433291c00b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:54:05.475016 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3fb1c3-747e-42b7-bea9-b68bfc9c6ea4 service neutron] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:54:05.475307 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3fb1c3-747e-42b7-bea9-b68bfc9c6ea4 service neutron] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:54:05.475580 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3fb1c3-747e-42b7-bea9-b68bfc9c6ea4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:54:05.484908 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3fb1c3-747e-42b7-bea9-b68bfc9c6ea4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:54:05.486349 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3fb1c3-747e-42b7-bea9-b68bfc9c6ea4 service neutron] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:54:05.496507 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 868/1724] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Oct 27 09:54:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 09:54:05.769049 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:54:05.790132 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca117f80-6723-4564-a4b9-63a7e27b32c5 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:54:05.791862 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-ca117f80-6723-4564-a4b9-63a7e27b32c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:54:05.816854 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca117f80-6723-4564-a4b9-63a7e27b32c5 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:54:05.826549 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0d11e8-0226-42cd-a1dd-173ef0ff10db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:54:05.828367 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0d11e8-0226-42cd-a1dd-173ef0ff10db admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:54:05.829364 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0d11e8-0226-42cd-a1dd-173ef0ff10db admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:54:05.830468 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0d11e8-0226-42cd-a1dd-173ef0ff10db admin admin] PATH_INFO: `/v3/projects/e28400376c2c40a48510bab75c0fa0b0` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:54:05.832442 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0d11e8-0226-42cd-a1dd-173ef0ff10db admin admin] RBAC: Authorizing `identity:delete_project(project_id=e28400376c2c40a48510bab75c0fa0b0)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:54:05.837028 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0d11e8-0226-42cd-a1dd-173ef0ff10db admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:54:05.866825 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:54:06.033223 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3fb1c3-747e-42b7-bea9-b68bfc9c6ea4 service neutron] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:54:06.035071 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-8f3fb1c3-747e-42b7-bea9-b68bfc9c6ea4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:54:06.054880 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3fb1c3-747e-42b7-bea9-b68bfc9c6ea4 service neutron] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:54:06.057734 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-ea0d11e8-0226-42cd-a1dd-173ef0ff10db admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e28400376c2c40a48510bab75c0fa0b0', 'request_id': 'req-ea0d11e8-0226-42cd-a1dd-173ef0ff10db'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:54:06.066283 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-ea0d11e8-0226-42cd-a1dd-173ef0ff10db admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e28400376c2c40a48510bab75c0fa0b0', 'request_id': 'req-ea0d11e8-0226-42cd-a1dd-173ef0ff10db'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:54:06.117975 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4647e86-eb6f-4968-9df5-ac36d51287ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:54:06.118706 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4647e86-eb6f-4968-9df5-ac36d51287ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:54:06.119021 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4647e86-eb6f-4968-9df5-ac36d51287ab admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:54:06.119309 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4647e86-eb6f-4968-9df5-ac36d51287ab admin admin] PATH_INFO: `/v3/projects/a2566bb617124991993f086275f1967c` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:54:06.120439 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4647e86-eb6f-4968-9df5-ac36d51287ab admin admin] RBAC: Authorizing `identity:delete_project(project_id=a2566bb617124991993f086275f1967c)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:54:06.122380 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4647e86-eb6f-4968-9df5-ac36d51287ab admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:54:06.140315 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-ea0d11e8-0226-42cd-a1dd-173ef0ff10db admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e28400376c2c40a48510bab75c0fa0b0', 'request_id': 'req-ea0d11e8-0226-42cd-a1dd-173ef0ff10db'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:54:06.154242 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-ea0d11e8-0226-42cd-a1dd-173ef0ff10db admin admin] The token cache is being invalidate because project e28400376c2c40a48510bab75c0fa0b0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 09:54:06.154563 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-ea0d11e8-0226-42cd-a1dd-173ef0ff10db admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:54:06.155246 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-ea0d11e8-0226-42cd-a1dd-173ef0ff10db admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:54:06.156766 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 857/1725] 10.222.0.65 () {58 vars in 1233 bytes} [Thu Oct 27 09:54:05 2022] DELETE /identity/v3/projects/e28400376c2c40a48510bab75c0fa0b0 => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 09:54:06.160739 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0d11e8-0226-42cd-a1dd-173ef0ff10db admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:54:06.162796 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-ea0d11e8-0226-42cd-a1dd-173ef0ff10db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:54:06.177270 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0d11e8-0226-42cd-a1dd-173ef0ff10db admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:54:06.181682 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf45ac4-68f7-4ec3-ab27-aaf7281fa460 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:54:06.182293 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf45ac4-68f7-4ec3-ab27-aaf7281fa460 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:54:06.182617 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf45ac4-68f7-4ec3-ab27-aaf7281fa460 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:54:06.182883 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf45ac4-68f7-4ec3-ab27-aaf7281fa460 admin admin] PATH_INFO: `/v3/users/7d8485f135094566a91d94c5321a66e7` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:54:06.184096 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf45ac4-68f7-4ec3-ab27-aaf7281fa460 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7d8485f135094566a91d94c5321a66e7)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:54:06.186285 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf45ac4-68f7-4ec3-ab27-aaf7281fa460 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:54:06.225431 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:54:06.243326 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-c4647e86-eb6f-4968-9df5-ac36d51287ab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a2566bb617124991993f086275f1967c', 'request_id': 'req-c4647e86-eb6f-4968-9df5-ac36d51287ab'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:54:06.340945 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-c4647e86-eb6f-4968-9df5-ac36d51287ab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a2566bb617124991993f086275f1967c', 'request_id': 'req-c4647e86-eb6f-4968-9df5-ac36d51287ab'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:54:06.347567 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-c4647e86-eb6f-4968-9df5-ac36d51287ab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a2566bb617124991993f086275f1967c', 'request_id': 'req-c4647e86-eb6f-4968-9df5-ac36d51287ab'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:54:06.361661 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-c4647e86-eb6f-4968-9df5-ac36d51287ab admin admin] The token cache is being invalidate because project a2566bb617124991993f086275f1967c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 09:54:06.361956 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-c4647e86-eb6f-4968-9df5-ac36d51287ab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:54:06.362697 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-c4647e86-eb6f-4968-9df5-ac36d51287ab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:54:06.364219 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 869/1726] 10.222.0.65 () {58 vars in 1233 bytes} [Thu Oct 27 09:54:06 2022] DELETE /identity/v3/projects/a2566bb617124991993f086275f1967c => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 09:54:06.369198 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4647e86-eb6f-4968-9df5-ac36d51287ab admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:54:06.371066 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-c4647e86-eb6f-4968-9df5-ac36d51287ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:54:06.413345 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-abf45ac4-68f7-4ec3-ab27-aaf7281fa460 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7d8485f135094566a91d94c5321a66e7'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:54:06.414207 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-abf45ac4-68f7-4ec3-ab27-aaf7281fa460 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7d8485f135094566a91d94c5321a66e7'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:54:06.422041 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-abf45ac4-68f7-4ec3-ab27-aaf7281fa460 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7d8485f135094566a91d94c5321a66e7'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:54:06.422982 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-abf45ac4-68f7-4ec3-ab27-aaf7281fa460 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7d8485f135094566a91d94c5321a66e7'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:54:06.427165 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:54:06.436840 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-abf45ac4-68f7-4ec3-ab27-aaf7281fa460 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7d8485f135094566a91d94c5321a66e7'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:54:06.452562 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4647e86-eb6f-4968-9df5-ac36d51287ab admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:54:06.457440 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60eb9a35-3f03-4f93-b8e0-579d1ce1ab93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:54:06.459007 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60eb9a35-3f03-4f93-b8e0-579d1ce1ab93 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:54:06.459301 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60eb9a35-3f03-4f93-b8e0-579d1ce1ab93 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:54:06.459584 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60eb9a35-3f03-4f93-b8e0-579d1ce1ab93 admin admin] PATH_INFO: `/v3/users/2172709e4a44411eb713c7739e2d3507` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:54:06.460745 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60eb9a35-3f03-4f93-b8e0-579d1ce1ab93 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2172709e4a44411eb713c7739e2d3507)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:54:06.462779 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60eb9a35-3f03-4f93-b8e0-579d1ce1ab93 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:54:06.521927 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 858/1727] 10.222.0.65 () {58 vars in 1224 bytes} [Thu Oct 27 09:54:06 2022] DELETE /identity/v3/users/7d8485f135094566a91d94c5321a66e7 => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 09:54:06.704524 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-60eb9a35-3f03-4f93-b8e0-579d1ce1ab93 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2172709e4a44411eb713c7739e2d3507'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:54:06.718236 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-60eb9a35-3f03-4f93-b8e0-579d1ce1ab93 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2172709e4a44411eb713c7739e2d3507'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:54:06.718984 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-60eb9a35-3f03-4f93-b8e0-579d1ce1ab93 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2172709e4a44411eb713c7739e2d3507'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:54:06.726549 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-60eb9a35-3f03-4f93-b8e0-579d1ce1ab93 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2172709e4a44411eb713c7739e2d3507'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:54:06.786743 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:54:06.808778 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-60eb9a35-3f03-4f93-b8e0-579d1ce1ab93 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2172709e4a44411eb713c7739e2d3507'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:54:06.816045 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 870/1728] 10.222.0.65 () {58 vars in 1224 bytes} [Thu Oct 27 09:54:06 2022] DELETE /identity/v3/users/2172709e4a44411eb713c7739e2d3507 => generated 0 bytes in 447 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 09:54:06.824119 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:54:07.040925 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf45ac4-68f7-4ec3-ab27-aaf7281fa460 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:54:07.042661 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-abf45ac4-68f7-4ec3-ab27-aaf7281fa460 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:54:07.121693 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf45ac4-68f7-4ec3-ab27-aaf7281fa460 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:54:07.182680 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3480bd42-a06a-443f-a8f3-e22849cd405c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:54:07.183440 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3480bd42-a06a-443f-a8f3-e22849cd405c admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:54:07.183732 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3480bd42-a06a-443f-a8f3-e22849cd405c admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:54:07.184017 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3480bd42-a06a-443f-a8f3-e22849cd405c admin admin] PATH_INFO: `/v3/projects/dba2a9b358d0461ab0e455968c3c9d84` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:54:07.185147 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3480bd42-a06a-443f-a8f3-e22849cd405c admin admin] RBAC: Authorizing `identity:delete_project(project_id=dba2a9b358d0461ab0e455968c3c9d84)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:54:07.187114 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3480bd42-a06a-443f-a8f3-e22849cd405c admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:54:07.311573 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:54:07.356308 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-3480bd42-a06a-443f-a8f3-e22849cd405c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dba2a9b358d0461ab0e455968c3c9d84', 'request_id': 'req-3480bd42-a06a-443f-a8f3-e22849cd405c'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:54:07.364226 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-3480bd42-a06a-443f-a8f3-e22849cd405c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dba2a9b358d0461ab0e455968c3c9d84', 'request_id': 'req-3480bd42-a06a-443f-a8f3-e22849cd405c'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:54:07.444674 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:54:07.472013 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-3480bd42-a06a-443f-a8f3-e22849cd405c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dba2a9b358d0461ab0e455968c3c9d84', 'request_id': 'req-3480bd42-a06a-443f-a8f3-e22849cd405c'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:54:07.480383 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60eb9a35-3f03-4f93-b8e0-579d1ce1ab93 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:54:07.482346 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-60eb9a35-3f03-4f93-b8e0-579d1ce1ab93 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:54:07.493829 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-3480bd42-a06a-443f-a8f3-e22849cd405c admin admin] The token cache is being invalidate because project dba2a9b358d0461ab0e455968c3c9d84 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 09:54:07.494171 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-3480bd42-a06a-443f-a8f3-e22849cd405c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:54:07.495372 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-3480bd42-a06a-443f-a8f3-e22849cd405c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:54:07.498450 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 859/1729] 10.222.0.65 () {58 vars in 1233 bytes} [Thu Oct 27 09:54:07 2022] DELETE /identity/v3/projects/dba2a9b358d0461ab0e455968c3c9d84 => generated 0 bytes in 458 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 09:54:07.503332 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44c061c-e1c7-4190-adcf-4210e51d36b9 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:54:07.503966 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44c061c-e1c7-4190-adcf-4210e51d36b9 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:54:07.504253 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44c061c-e1c7-4190-adcf-4210e51d36b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:54:07.513331 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60eb9a35-3f03-4f93-b8e0-579d1ce1ab93 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:54:07.540210 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-a44c061c-e1c7-4190-adcf-4210e51d36b9 None None] MFA Rules not processed for user `b5065084bf664b99bdeac46067cb0f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:54:07.541453 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-a44c061c-e1c7-4190-adcf-4210e51d36b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:54:07.582274 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d3f423-89fe-4082-84f3-821f994c6bad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:54:07.583910 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d3f423-89fe-4082-84f3-821f994c6bad admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:54:07.584236 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d3f423-89fe-4082-84f3-821f994c6bad admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:54:07.584736 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d3f423-89fe-4082-84f3-821f994c6bad admin admin] PATH_INFO: `/v3/projects/3c638a7be3f144f2b313c78bc863aeca` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:54:07.585960 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d3f423-89fe-4082-84f3-821f994c6bad admin admin] RBAC: Authorizing `identity:delete_project(project_id=3c638a7be3f144f2b313c78bc863aeca)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:54:07.587942 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d3f423-89fe-4082-84f3-821f994c6bad admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:54:07.605507 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 860/1730] 10.222.0.65 () {58 vars in 958 bytes} [Thu Oct 27 09:54:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 09:54:07.613385 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cc6841-6681-4117-9e0f-d67ca2611b19 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:54:07.614027 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cc6841-6681-4117-9e0f-d67ca2611b19 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:54:07.614434 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cc6841-6681-4117-9e0f-d67ca2611b19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:54:07.635700 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-79cc6841-6681-4117-9e0f-d67ca2611b19 None None] MFA Rules not processed for user `b5065084bf664b99bdeac46067cb0f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:54:07.636921 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-79cc6841-6681-4117-9e0f-d67ca2611b19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:54:07.646227 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 861/1731] 10.222.0.65 () {58 vars in 958 bytes} [Thu Oct 27 09:54:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 09:54:07.650327 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cc6841-6681-4117-9e0f-d67ca2611b19 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:54:07.659785 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cc6841-6681-4117-9e0f-d67ca2611b19 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:54:07.665408 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98957efc-0832-49ea-81ba-f70f0530cc39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:54:07.666874 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98957efc-0832-49ea-81ba-f70f0530cc39 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:54:07.666874 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98957efc-0832-49ea-81ba-f70f0530cc39 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:54:07.666874 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98957efc-0832-49ea-81ba-f70f0530cc39 admin admin] PATH_INFO: `/v3/domains` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:54:07.667280 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98957efc-0832-49ea-81ba-f70f0530cc39 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 09:54:07.667535 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98957efc-0832-49ea-81ba-f70f0530cc39 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:54:07.669119 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98957efc-0832-49ea-81ba-f70f0530cc39 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:54:07.681280 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 862/1732] 10.222.0.65 () {58 vars in 1153 bytes} [Thu Oct 27 09:54:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 09:54:07.685473 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98957efc-0832-49ea-81ba-f70f0530cc39 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:54:07.696844 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98957efc-0832-49ea-81ba-f70f0530cc39 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:54:07.707069 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-e5d3f423-89fe-4082-84f3-821f994c6bad admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3c638a7be3f144f2b313c78bc863aeca', 'request_id': 'req-e5d3f423-89fe-4082-84f3-821f994c6bad'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:54:07.756591 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7e98d6-bf03-4304-937d-4d724ae25114 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:54:07.757242 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7e98d6-bf03-4304-937d-4d724ae25114 admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:54:07.757524 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7e98d6-bf03-4304-937d-4d724ae25114 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:54:07.757797 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7e98d6-bf03-4304-937d-4d724ae25114 admin admin] PATH_INFO: `/v3/projects` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:54:07.758463 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7e98d6-bf03-4304-937d-4d724ae25114 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:54:07.760429 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7e98d6-bf03-4304-937d-4d724ae25114 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:54:07.789312 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-e5d3f423-89fe-4082-84f3-821f994c6bad admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3c638a7be3f144f2b313c78bc863aeca', 'request_id': 'req-e5d3f423-89fe-4082-84f3-821f994c6bad'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:54:07.795723 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-e5d3f423-89fe-4082-84f3-821f994c6bad admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3c638a7be3f144f2b313c78bc863aeca', 'request_id': 'req-e5d3f423-89fe-4082-84f3-821f994c6bad'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:54:07.807509 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-e5d3f423-89fe-4082-84f3-821f994c6bad admin admin] The token cache is being invalidate because project 3c638a7be3f144f2b313c78bc863aeca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 09:54:07.807798 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-e5d3f423-89fe-4082-84f3-821f994c6bad admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:54:07.808440 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-e5d3f423-89fe-4082-84f3-821f994c6bad admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:54:07.810065 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 871/1733] 10.222.0.65 () {58 vars in 1233 bytes} [Thu Oct 27 09:54:07 2022] DELETE /identity/v3/projects/3c638a7be3f144f2b313c78bc863aeca => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 09:54:07.813936 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d3f423-89fe-4082-84f3-821f994c6bad admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:54:07.815258 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-e5d3f423-89fe-4082-84f3-821f994c6bad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:54:07.828156 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d3f423-89fe-4082-84f3-821f994c6bad admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:54:07.833744 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdda760-2930-4c5d-a1fa-4d6e725b56f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:54:07.834405 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdda760-2930-4c5d-a1fa-4d6e725b56f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:54:07.834733 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdda760-2930-4c5d-a1fa-4d6e725b56f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:54:07.835011 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdda760-2930-4c5d-a1fa-4d6e725b56f9 admin admin] PATH_INFO: `/v3/users/8ccc87d7e287432d98549bf2f08eebb8` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:54:07.836149 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdda760-2930-4c5d-a1fa-4d6e725b56f9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8ccc87d7e287432d98549bf2f08eebb8)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:54:07.838071 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdda760-2930-4c5d-a1fa-4d6e725b56f9 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:54:07.878124 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 863/1734] 10.222.0.65 () {60 vars in 1153 bytes} [Thu Oct 27 09:54:07 2022] POST /identity/v3/projects => generated 363 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 09:54:07.883103 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7e98d6-bf03-4304-937d-4d724ae25114 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:54:07.884734 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-cb7e98d6-bf03-4304-937d-4d724ae25114 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:54:07.949600 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7e98d6-bf03-4304-937d-4d724ae25114 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:54:07.954389 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c80a1a6-9a94-49af-b168-78568c8ca5bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:54:07.955024 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c80a1a6-9a94-49af-b168-78568c8ca5bb admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:54:07.955309 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c80a1a6-9a94-49af-b168-78568c8ca5bb admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:54:07.955585 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c80a1a6-9a94-49af-b168-78568c8ca5bb admin admin] PATH_INFO: `/v3/users` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:54:07.956216 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c80a1a6-9a94-49af-b168-78568c8ca5bb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:54:07.958508 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c80a1a6-9a94-49af-b168-78568c8ca5bb admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:54:08.014308 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-6cdda760-2930-4c5d-a1fa-4d6e725b56f9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8ccc87d7e287432d98549bf2f08eebb8'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:54:08.026975 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-6cdda760-2930-4c5d-a1fa-4d6e725b56f9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8ccc87d7e287432d98549bf2f08eebb8'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:54:08.027728 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-6cdda760-2930-4c5d-a1fa-4d6e725b56f9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8ccc87d7e287432d98549bf2f08eebb8'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:54:08.036124 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-6cdda760-2930-4c5d-a1fa-4d6e725b56f9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8ccc87d7e287432d98549bf2f08eebb8'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:54:08.046780 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 864/1735] 10.222.0.65 () {60 vars in 1144 bytes} [Thu Oct 27 09:54:07 2022] POST /identity/v3/users => generated 282 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 09:54:08.050964 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c80a1a6-9a94-49af-b168-78568c8ca5bb admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:54:08.061756 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c80a1a6-9a94-49af-b168-78568c8ca5bb admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:54:08.066468 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93be49a-a92a-47c4-a025-31f6a7a260e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:54:08.067288 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93be49a-a92a-47c4-a025-31f6a7a260e2 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:54:08.067565 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93be49a-a92a-47c4-a025-31f6a7a260e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:54:08.067832 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93be49a-a92a-47c4-a025-31f6a7a260e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:54:08.068466 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93be49a-a92a-47c4-a025-31f6a7a260e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:54:08.070189 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93be49a-a92a-47c4-a025-31f6a7a260e2 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:54:08.073208 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:54:08.080809 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 865/1736] 10.222.0.65 () {58 vars in 1122 bytes} [Thu Oct 27 09:54:08 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 09:54:08.085598 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93be49a-a92a-47c4-a025-31f6a7a260e2 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:54:08.095359 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93be49a-a92a-47c4-a025-31f6a7a260e2 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:54:08.101071 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed1cff2-a071-4dc1-9dd3-933209472d3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:54:08.101742 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed1cff2-a071-4dc1-9dd3-933209472d3c admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:54:08.102029 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed1cff2-a071-4dc1-9dd3-933209472d3c admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:54:08.102302 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed1cff2-a071-4dc1-9dd3-933209472d3c admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:54:08.102964 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed1cff2-a071-4dc1-9dd3-933209472d3c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:54:08.103664 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-6cdda760-2930-4c5d-a1fa-4d6e725b56f9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8ccc87d7e287432d98549bf2f08eebb8'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:54:08.104545 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed1cff2-a071-4dc1-9dd3-933209472d3c admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:54:08.110605 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 872/1737] 10.222.0.65 () {58 vars in 1224 bytes} [Thu Oct 27 09:54:07 2022] DELETE /identity/v3/users/8ccc87d7e287432d98549bf2f08eebb8 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 09:54:08.119450 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 866/1738] 10.222.0.65 () {58 vars in 1122 bytes} [Thu Oct 27 09:54:08 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 09:54:08.120366 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdda760-2930-4c5d-a1fa-4d6e725b56f9 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:54:08.121880 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-6cdda760-2930-4c5d-a1fa-4d6e725b56f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:54:08.190843 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdda760-2930-4c5d-a1fa-4d6e725b56f9 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:54:08.196263 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb05496-08fc-4e15-8275-311c744582e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:54:08.196979 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb05496-08fc-4e15-8275-311c744582e7 admin admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:54:08.197266 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb05496-08fc-4e15-8275-311c744582e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:54:08.197547 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb05496-08fc-4e15-8275-311c744582e7 admin admin] PATH_INFO: `/v3/projects/c47f4da1b70442a897bb8bdac6994b53/users/c163fdef0aa144039b8489d3207000ea/roles/43543ce1450245af9661cb017bac17bd` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:54:08.213288 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb05496-08fc-4e15-8275-311c744582e7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c47f4da1b70442a897bb8bdac6994b53, user_id=c163fdef0aa144039b8489d3207000ea, role_id=43543ce1450245af9661cb017bac17bd)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:54:08.216030 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb05496-08fc-4e15-8275-311c744582e7 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:54:08.345087 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 873/1739] 10.222.0.65 () {60 vars in 1483 bytes} [Thu Oct 27 09:54:08 2022] PUT /identity/v3/projects/c47f4da1b70442a897bb8bdac6994b53/users/c163fdef0aa144039b8489d3207000ea/roles/43543ce1450245af9661cb017bac17bd => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 09:54:08.357378 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c2e140-43a6-4f1e-92ca-2bb2a5dc8718 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:54:08.357912 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c2e140-43a6-4f1e-92ca-2bb2a5dc8718 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:54:08.358285 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c2e140-43a6-4f1e-92ca-2bb2a5dc8718 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:54:08.390150 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-08c2e140-43a6-4f1e-92ca-2bb2a5dc8718 None None] MFA Rules not processed for user `c163fdef0aa144039b8489d3207000ea`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:54:08.391417 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-08c2e140-43a6-4f1e-92ca-2bb2a5dc8718 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:54:08.436286 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:54:08.460993 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 867/1740] 10.222.0.65 () {58 vars in 958 bytes} [Thu Oct 27 09:54:08 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 09:54:08.465870 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb05496-08fc-4e15-8275-311c744582e7 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:54:08.509822 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:54:08.534236 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb05496-08fc-4e15-8275-311c744582e7 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:54:08.539851 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e175210-86fc-472a-baa0-2f1f30913318 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:54:08.540471 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e175210-86fc-472a-baa0-2f1f30913318 admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:54:08.540758 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e175210-86fc-472a-baa0-2f1f30913318 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:54:08.541040 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e175210-86fc-472a-baa0-2f1f30913318 admin admin] PATH_INFO: `/v3/projects` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:54:08.541680 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e175210-86fc-472a-baa0-2f1f30913318 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:54:08.543949 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e175210-86fc-472a-baa0-2f1f30913318 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:54:08.597366 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c2e140-43a6-4f1e-92ca-2bb2a5dc8718 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:54:08.599769 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-08c2e140-43a6-4f1e-92ca-2bb2a5dc8718 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:54:08.633637 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c2e140-43a6-4f1e-92ca-2bb2a5dc8718 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:54:08.638716 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486a256c-dbae-4fc3-b3c0-b2a723577664 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:54:08.639391 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486a256c-dbae-4fc3-b3c0-b2a723577664 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:54:08.639675 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486a256c-dbae-4fc3-b3c0-b2a723577664 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:54:08.639954 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486a256c-dbae-4fc3-b3c0-b2a723577664 admin admin] PATH_INFO: `/v3/projects/03781435d25c4cdaae24140ea7934f8d` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:54:08.641331 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486a256c-dbae-4fc3-b3c0-b2a723577664 admin admin] RBAC: Authorizing `identity:delete_project(project_id=03781435d25c4cdaae24140ea7934f8d)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:54:08.643376 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486a256c-dbae-4fc3-b3c0-b2a723577664 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:54:08.677205 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 874/1741] 10.222.0.65 () {60 vars in 1153 bytes} [Thu Oct 27 09:54:08 2022] POST /identity/v3/projects => generated 361 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 09:54:08.681220 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e175210-86fc-472a-baa0-2f1f30913318 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:54:08.746060 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e175210-86fc-472a-baa0-2f1f30913318 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:54:08.750855 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83a4f63-34dc-4b3f-a8fa-c653dc4b6c59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:54:08.751456 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83a4f63-34dc-4b3f-a8fa-c653dc4b6c59 admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:54:08.751736 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83a4f63-34dc-4b3f-a8fa-c653dc4b6c59 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:54:08.752008 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83a4f63-34dc-4b3f-a8fa-c653dc4b6c59 admin admin] PATH_INFO: `/v3/users` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:54:08.752626 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83a4f63-34dc-4b3f-a8fa-c653dc4b6c59 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:54:08.755139 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83a4f63-34dc-4b3f-a8fa-c653dc4b6c59 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:54:08.795354 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-486a256c-dbae-4fc3-b3c0-b2a723577664 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '03781435d25c4cdaae24140ea7934f8d', 'request_id': 'req-486a256c-dbae-4fc3-b3c0-b2a723577664'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:54:08.802078 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-486a256c-dbae-4fc3-b3c0-b2a723577664 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '03781435d25c4cdaae24140ea7934f8d', 'request_id': 'req-486a256c-dbae-4fc3-b3c0-b2a723577664'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:54:08.873959 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 875/1742] 10.222.0.65 () {60 vars in 1144 bytes} [Thu Oct 27 09:54:08 2022] POST /identity/v3/users => generated 287 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 09:54:08.875810 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83a4f63-34dc-4b3f-a8fa-c653dc4b6c59 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:54:08.886147 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83a4f63-34dc-4b3f-a8fa-c653dc4b6c59 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:54:08.893818 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-486a256c-dbae-4fc3-b3c0-b2a723577664 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '03781435d25c4cdaae24140ea7934f8d', 'request_id': 'req-486a256c-dbae-4fc3-b3c0-b2a723577664'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:54:08.896695 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:54:08.906221 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-486a256c-dbae-4fc3-b3c0-b2a723577664 admin admin] The token cache is being invalidate because project 03781435d25c4cdaae24140ea7934f8d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 09:54:08.906535 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-486a256c-dbae-4fc3-b3c0-b2a723577664 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:54:08.907235 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-486a256c-dbae-4fc3-b3c0-b2a723577664 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:54:08.913312 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 868/1743] 10.222.0.65 () {58 vars in 1233 bytes} [Thu Oct 27 09:54:08 2022] DELETE /identity/v3/projects/03781435d25c4cdaae24140ea7934f8d => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 09:54:08.914651 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28026f58-ff30-460a-a9c7-526c674011e7 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:54:08.914939 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28026f58-ff30-460a-a9c7-526c674011e7 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:54:08.915217 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28026f58-ff30-460a-a9c7-526c674011e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:54:08.936059 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-28026f58-ff30-460a-a9c7-526c674011e7 None None] MFA Rules not processed for user `b5065084bf664b99bdeac46067cb0f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:54:08.937285 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-28026f58-ff30-460a-a9c7-526c674011e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:54:08.949207 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff18492-2fcb-4046-9bfe-88109251f9e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:54:08.949807 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff18492-2fcb-4046-9bfe-88109251f9e7 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:54:08.950091 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff18492-2fcb-4046-9bfe-88109251f9e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:54:08.950371 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff18492-2fcb-4046-9bfe-88109251f9e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:54:08.951052 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff18492-2fcb-4046-9bfe-88109251f9e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:54:08.952655 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff18492-2fcb-4046-9bfe-88109251f9e7 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:54:08.966761 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 876/1744] 10.222.0.65 () {58 vars in 1122 bytes} [Thu Oct 27 09:54:08 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 09:54:08.967902 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff18492-2fcb-4046-9bfe-88109251f9e7 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:54:08.969600 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-fff18492-2fcb-4046-9bfe-88109251f9e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:54:08.982246 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff18492-2fcb-4046-9bfe-88109251f9e7 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:54:08.987072 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd93ad26-841b-4457-879c-da3baae4475b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:54:08.987727 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd93ad26-841b-4457-879c-da3baae4475b admin admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:54:08.988011 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd93ad26-841b-4457-879c-da3baae4475b admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:54:08.988290 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd93ad26-841b-4457-879c-da3baae4475b admin admin] PATH_INFO: `/v3/projects/32008ed8e3854eca9af37ae521732a80/users/dfffa0890dce4f8ebc5381efb5ba27ff/roles/6ad17b9f9dea4b66ab2da3677d7e715d` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:54:09.003366 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 869/1745] 10.222.0.65 () {58 vars in 958 bytes} [Thu Oct 27 09:54:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 09:54:09.005515 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd93ad26-841b-4457-879c-da3baae4475b admin admin] RBAC: Authorizing `identity:create_grant(project_id=32008ed8e3854eca9af37ae521732a80, user_id=dfffa0890dce4f8ebc5381efb5ba27ff, role_id=6ad17b9f9dea4b66ab2da3677d7e715d)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:54:09.008242 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd93ad26-841b-4457-879c-da3baae4475b admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:54:09.012068 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28957317-fd0a-4872-88b1-65e5fde9603f None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:54:09.012328 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28957317-fd0a-4872-88b1-65e5fde9603f None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:54:09.012600 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28957317-fd0a-4872-88b1-65e5fde9603f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:54:09.033558 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-28957317-fd0a-4872-88b1-65e5fde9603f None None] MFA Rules not processed for user `b5065084bf664b99bdeac46067cb0f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:54:09.034803 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-28957317-fd0a-4872-88b1-65e5fde9603f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:54:09.043556 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 870/1746] 10.222.0.65 () {58 vars in 958 bytes} [Thu Oct 27 09:54:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 09:54:09.047653 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28957317-fd0a-4872-88b1-65e5fde9603f None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:54:09.056667 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28957317-fd0a-4872-88b1-65e5fde9603f None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:54:09.061322 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d438892-b2b3-48b7-ae72-b109c12e1d23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:54:09.061963 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d438892-b2b3-48b7-ae72-b109c12e1d23 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:54:09.062245 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d438892-b2b3-48b7-ae72-b109c12e1d23 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:54:09.062535 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d438892-b2b3-48b7-ae72-b109c12e1d23 admin admin] PATH_INFO: `/v3/domains` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:54:09.068822 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d438892-b2b3-48b7-ae72-b109c12e1d23 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 09:54:09.068822 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d438892-b2b3-48b7-ae72-b109c12e1d23 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:54:09.068822 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d438892-b2b3-48b7-ae72-b109c12e1d23 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:54:09.076592 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 871/1747] 10.222.0.65 () {58 vars in 1153 bytes} [Thu Oct 27 09:54:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 09:54:09.080751 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d438892-b2b3-48b7-ae72-b109c12e1d23 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:54:09.091599 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d438892-b2b3-48b7-ae72-b109c12e1d23 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:54:09.093814 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 877/1748] 10.222.0.65 () {60 vars in 1483 bytes} [Thu Oct 27 09:54:08 2022] PUT /identity/v3/projects/32008ed8e3854eca9af37ae521732a80/users/dfffa0890dce4f8ebc5381efb5ba27ff/roles/6ad17b9f9dea4b66ab2da3677d7e715d => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 09:54:09.099135 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd93ad26-841b-4457-879c-da3baae4475b admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:54:09.152389 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966d846a-8422-4601-bb3b-e555711cdc9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:54:09.153456 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966d846a-8422-4601-bb3b-e555711cdc9e admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:54:09.158674 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966d846a-8422-4601-bb3b-e555711cdc9e admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:54:09.158674 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966d846a-8422-4601-bb3b-e555711cdc9e admin admin] PATH_INFO: `/v3/projects` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:54:09.158674 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966d846a-8422-4601-bb3b-e555711cdc9e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:54:09.158674 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966d846a-8422-4601-bb3b-e555711cdc9e admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:54:09.163406 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd93ad26-841b-4457-879c-da3baae4475b admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:54:09.168256 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d54ddbd-a3a5-4e65-81bd-4900d59a941c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:54:09.168873 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d54ddbd-a3a5-4e65-81bd-4900d59a941c admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:54:09.169155 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d54ddbd-a3a5-4e65-81bd-4900d59a941c admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:54:09.169432 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d54ddbd-a3a5-4e65-81bd-4900d59a941c admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:54:09.170120 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d54ddbd-a3a5-4e65-81bd-4900d59a941c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:54:09.171766 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d54ddbd-a3a5-4e65-81bd-4900d59a941c admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:54:09.182491 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 878/1749] 10.222.0.65 () {58 vars in 1122 bytes} [Thu Oct 27 09:54:09 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 09:54:09.186768 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d54ddbd-a3a5-4e65-81bd-4900d59a941c admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:54:09.197387 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d54ddbd-a3a5-4e65-81bd-4900d59a941c admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:54:09.202266 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6a9b73-5d08-4a7c-9310-e01b2b71af56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:54:09.202948 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6a9b73-5d08-4a7c-9310-e01b2b71af56 admin admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:54:09.203229 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6a9b73-5d08-4a7c-9310-e01b2b71af56 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:54:09.203510 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6a9b73-5d08-4a7c-9310-e01b2b71af56 admin admin] PATH_INFO: `/v3/projects/32008ed8e3854eca9af37ae521732a80/users/dfffa0890dce4f8ebc5381efb5ba27ff/roles/6ad17b9f9dea4b66ab2da3677d7e715d` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:54:09.205451 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6a9b73-5d08-4a7c-9310-e01b2b71af56 admin admin] RBAC: Authorizing `identity:create_grant(project_id=32008ed8e3854eca9af37ae521732a80, user_id=dfffa0890dce4f8ebc5381efb5ba27ff, role_id=6ad17b9f9dea4b66ab2da3677d7e715d)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:54:09.208728 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6a9b73-5d08-4a7c-9310-e01b2b71af56 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:54:09.219104 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 879/1750] 10.222.0.65 () {60 vars in 1483 bytes} [Thu Oct 27 09:54:09 2022] PUT /identity/v3/projects/32008ed8e3854eca9af37ae521732a80/users/dfffa0890dce4f8ebc5381efb5ba27ff/roles/6ad17b9f9dea4b66ab2da3677d7e715d => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 09:54:09.229953 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc969a3-35f8-47eb-bb38-3715f01442a8 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:54:09.230244 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc969a3-35f8-47eb-bb38-3715f01442a8 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:54:09.230621 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc969a3-35f8-47eb-bb38-3715f01442a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:54:09.259161 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-3bc969a3-35f8-47eb-bb38-3715f01442a8 None None] MFA Rules not processed for user `dfffa0890dce4f8ebc5381efb5ba27ff`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:54:09.260374 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-3bc969a3-35f8-47eb-bb38-3715f01442a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:54:09.271636 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 872/1751] 10.222.0.65 () {60 vars in 1153 bytes} [Thu Oct 27 09:54:09 2022] POST /identity/v3/projects => generated 365 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 09:54:09.276102 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966d846a-8422-4601-bb3b-e555711cdc9e admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:54:09.333346 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:54:09.337434 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 880/1752] 10.222.0.65 () {58 vars in 958 bytes} [Thu Oct 27 09:54:09 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 09:54:09.345664 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966d846a-8422-4601-bb3b-e555711cdc9e admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:54:09.349523 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc969a3-35f8-47eb-bb38-3715f01442a8 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:54:09.351006 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-3bc969a3-35f8-47eb-bb38-3715f01442a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:54:09.351239 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d83965-8a32-4dc6-b542-6e4f11038d4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:54:09.351854 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d83965-8a32-4dc6-b542-6e4f11038d4a admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:54:09.352137 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d83965-8a32-4dc6-b542-6e4f11038d4a admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:54:09.352407 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d83965-8a32-4dc6-b542-6e4f11038d4a admin admin] PATH_INFO: `/v3/users` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:54:09.353040 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d83965-8a32-4dc6-b542-6e4f11038d4a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:54:09.355032 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d83965-8a32-4dc6-b542-6e4f11038d4a admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:54:09.409770 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc969a3-35f8-47eb-bb38-3715f01442a8 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:54:09.459098 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb527bf-ad4e-4f30-8f95-5a0748061f98 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8e5d5f04c4741bb86ca4a0f667d4ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc2e3a7a1bcc480891c0b433291c00b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:54:09.459743 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb527bf-ad4e-4f30-8f95-5a0748061f98 service cinder] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:54:09.463094 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 873/1753] 10.222.0.65 () {60 vars in 1144 bytes} [Thu Oct 27 09:54:09 2022] POST /identity/v3/users => generated 283 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 09:54:09.463585 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb527bf-ad4e-4f30-8f95-5a0748061f98 service cinder] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:54:09.463585 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb527bf-ad4e-4f30-8f95-5a0748061f98 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:54:09.464042 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d83965-8a32-4dc6-b542-6e4f11038d4a admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:54:09.474509 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d83965-8a32-4dc6-b542-6e4f11038d4a admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:54:09.479695 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab8f59d-db65-42ae-8227-e02aaced83d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:54:09.480438 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab8f59d-db65-42ae-8227-e02aaced83d3 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:54:09.480767 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab8f59d-db65-42ae-8227-e02aaced83d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:54:09.481215 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab8f59d-db65-42ae-8227-e02aaced83d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:54:09.481911 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab8f59d-db65-42ae-8227-e02aaced83d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:54:09.483634 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab8f59d-db65-42ae-8227-e02aaced83d3 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:54:09.494801 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 874/1754] 10.222.0.65 () {58 vars in 1122 bytes} [Thu Oct 27 09:54:09 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 09:54:09.498846 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab8f59d-db65-42ae-8227-e02aaced83d3 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:54:09.509512 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab8f59d-db65-42ae-8227-e02aaced83d3 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:54:09.514346 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b225c5ae-c728-4ff9-8ab4-2478fd93c92e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:54:09.514972 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b225c5ae-c728-4ff9-8ab4-2478fd93c92e admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:54:09.515257 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b225c5ae-c728-4ff9-8ab4-2478fd93c92e admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:54:09.515575 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b225c5ae-c728-4ff9-8ab4-2478fd93c92e admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:54:09.516252 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b225c5ae-c728-4ff9-8ab4-2478fd93c92e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:54:09.517858 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b225c5ae-c728-4ff9-8ab4-2478fd93c92e admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:54:09.528630 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb527bf-ad4e-4f30-8f95-5a0748061f98 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:54:09.530056 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb527bf-ad4e-4f30-8f95-5a0748061f98 service cinder] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:54:09.533960 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 875/1755] 10.222.0.65 () {58 vars in 1122 bytes} [Thu Oct 27 09:54:09 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 09:54:09.535079 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b225c5ae-c728-4ff9-8ab4-2478fd93c92e admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:54:09.541969 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 881/1756] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Oct 27 09:54:09 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 09:54:09.546752 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b225c5ae-c728-4ff9-8ab4-2478fd93c92e admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:54:09.552682 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da75802c-b9ca-49e2-81dd-d3e3cff41738 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:54:09.553447 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da75802c-b9ca-49e2-81dd-d3e3cff41738 admin admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:54:09.553731 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da75802c-b9ca-49e2-81dd-d3e3cff41738 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:54:09.554007 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da75802c-b9ca-49e2-81dd-d3e3cff41738 admin admin] PATH_INFO: `/v3/projects/e41cebbf5a204b608912ad5ed301a146/users/547835331d644f8da5621a6566dcc5dc/roles/43543ce1450245af9661cb017bac17bd` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:54:09.571545 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da75802c-b9ca-49e2-81dd-d3e3cff41738 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e41cebbf5a204b608912ad5ed301a146, user_id=547835331d644f8da5621a6566dcc5dc, role_id=43543ce1450245af9661cb017bac17bd)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:54:09.574306 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da75802c-b9ca-49e2-81dd-d3e3cff41738 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:54:09.584088 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:54:09.700810 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 876/1757] 10.222.0.65 () {60 vars in 1483 bytes} [Thu Oct 27 09:54:09 2022] PUT /identity/v3/projects/e41cebbf5a204b608912ad5ed301a146/users/547835331d644f8da5621a6566dcc5dc/roles/43543ce1450245af9661cb017bac17bd => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 09:54:09.712303 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c210520b-9d7e-47ea-9773-74af331e000e None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:54:09.717968 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c210520b-9d7e-47ea-9773-74af331e000e None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:54:09.717968 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c210520b-9d7e-47ea-9773-74af331e000e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:54:09.745344 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-c210520b-9d7e-47ea-9773-74af331e000e None None] MFA Rules not processed for user `547835331d644f8da5621a6566dcc5dc`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:54:09.746609 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-c210520b-9d7e-47ea-9773-74af331e000e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:54:09.828365 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 882/1758] 10.222.0.65 () {58 vars in 958 bytes} [Thu Oct 27 09:54:09 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 09:54:09.847480 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da75802c-b9ca-49e2-81dd-d3e3cff41738 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:54:09.916770 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da75802c-b9ca-49e2-81dd-d3e3cff41738 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:54:09.920849 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d1e9f8-028e-4704-a11b-18f56deb7175 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8e5d5f04c4741bb86ca4a0f667d4ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc2e3a7a1bcc480891c0b433291c00b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:54:09.921377 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d1e9f8-028e-4704-a11b-18f56deb7175 service cinder] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:54:09.921657 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d1e9f8-028e-4704-a11b-18f56deb7175 service cinder] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:54:09.921930 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d1e9f8-028e-4704-a11b-18f56deb7175 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:54:09.932165 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d1e9f8-028e-4704-a11b-18f56deb7175 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:54:09.933614 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d1e9f8-028e-4704-a11b-18f56deb7175 service cinder] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:54:09.943866 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 877/1759] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Oct 27 09:54:09 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 09:54:10.088680 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:54:10.277547 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:54:10.600233 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c210520b-9d7e-47ea-9773-74af331e000e None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:54:10.673075 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c210520b-9d7e-47ea-9773-74af331e000e None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:54:10.678615 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fb8210-aeb1-4272-8349-8db4852f97cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:54:10.679248 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fb8210-aeb1-4272-8349-8db4852f97cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:54:10.679531 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fb8210-aeb1-4272-8349-8db4852f97cf admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:54:10.679804 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fb8210-aeb1-4272-8349-8db4852f97cf admin admin] PATH_INFO: `/v3/users/c163fdef0aa144039b8489d3207000ea` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:54:10.680930 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30fb8210-aeb1-4272-8349-8db4852f97cf admin admin] RBAC: Authorizing `identity:delete_user(user_id=c163fdef0aa144039b8489d3207000ea)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:54:10.682916 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30fb8210-aeb1-4272-8349-8db4852f97cf admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:54:10.818863 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:54:10.908366 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-30fb8210-aeb1-4272-8349-8db4852f97cf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c163fdef0aa144039b8489d3207000ea'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:54:10.920621 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:54:10.921139 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-30fb8210-aeb1-4272-8349-8db4852f97cf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c163fdef0aa144039b8489d3207000ea'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:54:10.921895 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-30fb8210-aeb1-4272-8349-8db4852f97cf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c163fdef0aa144039b8489d3207000ea'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:54:10.931092 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-30fb8210-aeb1-4272-8349-8db4852f97cf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c163fdef0aa144039b8489d3207000ea'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:54:11.008822 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-30fb8210-aeb1-4272-8349-8db4852f97cf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c163fdef0aa144039b8489d3207000ea'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:54:11.016756 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 883/1760] 10.222.0.65 () {58 vars in 1224 bytes} [Thu Oct 27 09:54:10 2022] DELETE /identity/v3/users/c163fdef0aa144039b8489d3207000ea => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 09:54:11.025245 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb7de65-4171-4928-a408-dcf39483bfc3 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:54:11.025245 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb7de65-4171-4928-a408-dcf39483bfc3 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:54:11.025245 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb7de65-4171-4928-a408-dcf39483bfc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:54:11.042726 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-0eb7de65-4171-4928-a408-dcf39483bfc3 None None] MFA Rules not processed for user `b5065084bf664b99bdeac46067cb0f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:54:11.043956 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-0eb7de65-4171-4928-a408-dcf39483bfc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:54:11.111222 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 878/1761] 10.222.0.65 () {58 vars in 958 bytes} [Thu Oct 27 09:54:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 09:54:11.121673 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fb8210-aeb1-4272-8349-8db4852f97cf admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:54:11.123116 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-30fb8210-aeb1-4272-8349-8db4852f97cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:54:11.136314 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:54:11.157240 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:54:11.187177 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fb8210-aeb1-4272-8349-8db4852f97cf admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:54:11.191134 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593aaa37-19f6-4b07-8448-fe7ca6a7a06e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6191cc41efa74f46b49022cf387f7a4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc2e3a7a1bcc480891c0b433291c00b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:54:11.191813 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593aaa37-19f6-4b07-8448-fe7ca6a7a06e service neutron] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:54:11.192085 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593aaa37-19f6-4b07-8448-fe7ca6a7a06e service neutron] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:54:11.192918 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593aaa37-19f6-4b07-8448-fe7ca6a7a06e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:54:11.203382 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593aaa37-19f6-4b07-8448-fe7ca6a7a06e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:54:11.204805 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593aaa37-19f6-4b07-8448-fe7ca6a7a06e service neutron] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:54:11.215763 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 884/1762] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Oct 27 09:54:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 09:54:11.231603 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:54:11.391258 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:54:11.488686 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:54:11.673896 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb7de65-4171-4928-a408-dcf39483bfc3 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:54:11.676642 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-0eb7de65-4171-4928-a408-dcf39483bfc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:54:11.706358 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb7de65-4171-4928-a408-dcf39483bfc3 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:54:11.729048 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7426361-5764-4a80-84aa-70cabff49df0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:54:11.729711 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7426361-5764-4a80-84aa-70cabff49df0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:54:11.729994 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7426361-5764-4a80-84aa-70cabff49df0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:54:11.730270 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7426361-5764-4a80-84aa-70cabff49df0 admin admin] PATH_INFO: `/v3/projects/c47f4da1b70442a897bb8bdac6994b53` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:54:11.731766 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7426361-5764-4a80-84aa-70cabff49df0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c47f4da1b70442a897bb8bdac6994b53)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:54:11.733765 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7426361-5764-4a80-84aa-70cabff49df0 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:54:11.885081 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-a7426361-5764-4a80-84aa-70cabff49df0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c47f4da1b70442a897bb8bdac6994b53', 'request_id': 'req-a7426361-5764-4a80-84aa-70cabff49df0'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:54:11.892126 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-a7426361-5764-4a80-84aa-70cabff49df0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c47f4da1b70442a897bb8bdac6994b53', 'request_id': 'req-a7426361-5764-4a80-84aa-70cabff49df0'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:54:11.968117 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-a7426361-5764-4a80-84aa-70cabff49df0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c47f4da1b70442a897bb8bdac6994b53', 'request_id': 'req-a7426361-5764-4a80-84aa-70cabff49df0'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:54:11.981490 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-a7426361-5764-4a80-84aa-70cabff49df0 admin admin] The token cache is being invalidate because project c47f4da1b70442a897bb8bdac6994b53 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 09:54:11.981726 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-a7426361-5764-4a80-84aa-70cabff49df0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:54:11.982456 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-a7426361-5764-4a80-84aa-70cabff49df0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:54:11.984027 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 879/1763] 10.222.0.65 () {58 vars in 1233 bytes} [Thu Oct 27 09:54:11 2022] DELETE /identity/v3/projects/c47f4da1b70442a897bb8bdac6994b53 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 09:54:11.988418 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593aaa37-19f6-4b07-8448-fe7ca6a7a06e service neutron] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:54:12.000107 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593aaa37-19f6-4b07-8448-fe7ca6a7a06e service neutron] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:54:12.071199 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17952733-9c54-483d-abef-5c0eb5b4cdd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:54:12.072882 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17952733-9c54-483d-abef-5c0eb5b4cdd3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:54:12.073175 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17952733-9c54-483d-abef-5c0eb5b4cdd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:54:12.073461 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17952733-9c54-483d-abef-5c0eb5b4cdd3 admin admin] PATH_INFO: `/v3/users/dfffa0890dce4f8ebc5381efb5ba27ff` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:54:12.074822 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17952733-9c54-483d-abef-5c0eb5b4cdd3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dfffa0890dce4f8ebc5381efb5ba27ff)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:54:12.077886 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17952733-9c54-483d-abef-5c0eb5b4cdd3 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:54:12.081377 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:54:12.287526 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:DELETE=14,keystone:SELECT=83,keystone:INSERT=3 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:54:12.330230 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-17952733-9c54-483d-abef-5c0eb5b4cdd3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dfffa0890dce4f8ebc5381efb5ba27ff'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:54:12.349233 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-17952733-9c54-483d-abef-5c0eb5b4cdd3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dfffa0890dce4f8ebc5381efb5ba27ff'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:54:12.350001 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-17952733-9c54-483d-abef-5c0eb5b4cdd3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dfffa0890dce4f8ebc5381efb5ba27ff'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:54:12.356926 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-17952733-9c54-483d-abef-5c0eb5b4cdd3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dfffa0890dce4f8ebc5381efb5ba27ff'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:54:12.434804 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-17952733-9c54-483d-abef-5c0eb5b4cdd3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dfffa0890dce4f8ebc5381efb5ba27ff'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:54:12.441362 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 885/1764] 10.222.0.65 () {58 vars in 1224 bytes} [Thu Oct 27 09:54:11 2022] DELETE /identity/v3/users/dfffa0890dce4f8ebc5381efb5ba27ff => generated 0 bytes in 454 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 09:54:12.448056 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:54:12.584053 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:54:12.680661 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:54:12.956513 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7426361-5764-4a80-84aa-70cabff49df0 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:54:12.958508 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-a7426361-5764-4a80-84aa-70cabff49df0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:54:12.972498 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7426361-5764-4a80-84aa-70cabff49df0 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:54:12.980620 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:54:13.050831 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a729f0ac-3a05-45cc-9e13-3159ad6968ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:54:13.051318 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a729f0ac-3a05-45cc-9e13-3159ad6968ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:54:13.051662 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a729f0ac-3a05-45cc-9e13-3159ad6968ed admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:54:13.052084 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a729f0ac-3a05-45cc-9e13-3159ad6968ed admin admin] PATH_INFO: `/v3/projects/32008ed8e3854eca9af37ae521732a80` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:54:13.053412 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a729f0ac-3a05-45cc-9e13-3159ad6968ed admin admin] RBAC: Authorizing `identity:delete_project(project_id=32008ed8e3854eca9af37ae521732a80)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:54:13.055677 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a729f0ac-3a05-45cc-9e13-3159ad6968ed admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:54:13.244844 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-a729f0ac-3a05-45cc-9e13-3159ad6968ed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '32008ed8e3854eca9af37ae521732a80', 'request_id': 'req-a729f0ac-3a05-45cc-9e13-3159ad6968ed'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:54:13.252032 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-a729f0ac-3a05-45cc-9e13-3159ad6968ed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '32008ed8e3854eca9af37ae521732a80', 'request_id': 'req-a729f0ac-3a05-45cc-9e13-3159ad6968ed'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:54:13.337785 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-a729f0ac-3a05-45cc-9e13-3159ad6968ed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '32008ed8e3854eca9af37ae521732a80', 'request_id': 'req-a729f0ac-3a05-45cc-9e13-3159ad6968ed'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:54:13.352020 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-a729f0ac-3a05-45cc-9e13-3159ad6968ed admin admin] The token cache is being invalidate because project 32008ed8e3854eca9af37ae521732a80 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 09:54:13.352317 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-a729f0ac-3a05-45cc-9e13-3159ad6968ed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:54:13.353133 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-a729f0ac-3a05-45cc-9e13-3159ad6968ed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:54:13.356495 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 880/1765] 10.222.0.65 () {58 vars in 1233 bytes} [Thu Oct 27 09:54:12 2022] DELETE /identity/v3/projects/32008ed8e3854eca9af37ae521732a80 => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 09:54:13.359634 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b2d734-338d-42dd-b23b-0c41e94bbd77 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:54:13.360309 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b2d734-338d-42dd-b23b-0c41e94bbd77 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:54:13.360309 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b2d734-338d-42dd-b23b-0c41e94bbd77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:54:13.383557 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-52b2d734-338d-42dd-b23b-0c41e94bbd77 None None] MFA Rules not processed for user `b5065084bf664b99bdeac46067cb0f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:54:13.384928 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-52b2d734-338d-42dd-b23b-0c41e94bbd77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:54:13.454311 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 886/1766] 10.222.0.65 () {58 vars in 958 bytes} [Thu Oct 27 09:54:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 09:54:13.462895 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab819e63-952b-4c27-a115-98d24f4d6bc5 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:54:13.463206 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab819e63-952b-4c27-a115-98d24f4d6bc5 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:54:13.463516 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab819e63-952b-4c27-a115-98d24f4d6bc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:54:13.479385 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:54:13.484773 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-ab819e63-952b-4c27-a115-98d24f4d6bc5 None None] MFA Rules not processed for user `b5065084bf664b99bdeac46067cb0f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:54:13.486026 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-ab819e63-952b-4c27-a115-98d24f4d6bc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:54:13.494572 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 881/1767] 10.222.0.65 () {58 vars in 958 bytes} [Thu Oct 27 09:54:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 09:54:13.498803 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b2d734-338d-42dd-b23b-0c41e94bbd77 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:54:13.514153 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b2d734-338d-42dd-b23b-0c41e94bbd77 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:54:13.522249 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e7294e-5e6a-4a81-983a-f6cf85c0f4d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:54:13.523235 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e7294e-5e6a-4a81-983a-f6cf85c0f4d8 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:54:13.523736 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e7294e-5e6a-4a81-983a-f6cf85c0f4d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:54:13.526866 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e7294e-5e6a-4a81-983a-f6cf85c0f4d8 admin admin] PATH_INFO: `/v3/domains` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:54:13.526866 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e7294e-5e6a-4a81-983a-f6cf85c0f4d8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 09:54:13.526866 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e7294e-5e6a-4a81-983a-f6cf85c0f4d8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:54:13.529159 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e7294e-5e6a-4a81-983a-f6cf85c0f4d8 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:54:13.547482 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 887/1768] 10.222.0.65 () {58 vars in 1153 bytes} [Thu Oct 27 09:54:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 09:54:13.554333 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab819e63-952b-4c27-a115-98d24f4d6bc5 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:54:13.561953 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab819e63-952b-4c27-a115-98d24f4d6bc5 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:54:13.570562 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f15586-1a40-4306-913c-66fd57cb5d0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:54:13.571173 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f15586-1a40-4306-913c-66fd57cb5d0f admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:54:13.571459 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f15586-1a40-4306-913c-66fd57cb5d0f admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:54:13.571735 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f15586-1a40-4306-913c-66fd57cb5d0f admin admin] PATH_INFO: `/v3/projects` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:54:13.572371 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f15586-1a40-4306-913c-66fd57cb5d0f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:54:13.574281 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f15586-1a40-4306-913c-66fd57cb5d0f admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:54:13.696249 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 882/1769] 10.222.0.65 () {60 vars in 1153 bytes} [Thu Oct 27 09:54:13 2022] POST /identity/v3/projects => generated 385 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 09:54:13.700735 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e7294e-5e6a-4a81-983a-f6cf85c0f4d8 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:54:13.711204 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e7294e-5e6a-4a81-983a-f6cf85c0f4d8 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:54:13.769597 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e72f5e-4038-4c9e-ae47-3f7dd93473ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:54:13.770213 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e72f5e-4038-4c9e-ae47-3f7dd93473ed admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:54:13.770638 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e72f5e-4038-4c9e-ae47-3f7dd93473ed admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:54:13.770938 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e72f5e-4038-4c9e-ae47-3f7dd93473ed admin admin] PATH_INFO: `/v3/users` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:54:13.771993 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e72f5e-4038-4c9e-ae47-3f7dd93473ed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:54:13.773633 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e72f5e-4038-4c9e-ae47-3f7dd93473ed admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:54:13.869049 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 888/1770] 10.222.0.65 () {60 vars in 1144 bytes} [Thu Oct 27 09:54:13 2022] POST /identity/v3/users => generated 293 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 09:54:13.870971 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f15586-1a40-4306-913c-66fd57cb5d0f admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:54:13.884586 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f15586-1a40-4306-913c-66fd57cb5d0f admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:54:13.889997 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8272be0a-31d6-43cc-abaf-e40fa3010e85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:54:13.894196 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8272be0a-31d6-43cc-abaf-e40fa3010e85 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:54:13.894196 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8272be0a-31d6-43cc-abaf-e40fa3010e85 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:54:13.894196 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8272be0a-31d6-43cc-abaf-e40fa3010e85 admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:54:13.894196 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8272be0a-31d6-43cc-abaf-e40fa3010e85 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:54:13.894196 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8272be0a-31d6-43cc-abaf-e40fa3010e85 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:54:13.905192 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 883/1771] 10.222.0.65 () {58 vars in 1122 bytes} [Thu Oct 27 09:54:13 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 09:54:13.909198 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e72f5e-4038-4c9e-ae47-3f7dd93473ed admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:54:13.920071 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e72f5e-4038-4c9e-ae47-3f7dd93473ed admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:54:13.925974 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68430d3-163b-41b0-9acb-7ae38414b74a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:54:13.927363 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68430d3-163b-41b0-9acb-7ae38414b74a admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:54:13.927972 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68430d3-163b-41b0-9acb-7ae38414b74a admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:54:13.927972 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68430d3-163b-41b0-9acb-7ae38414b74a admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:54:13.928858 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68430d3-163b-41b0-9acb-7ae38414b74a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:54:13.930667 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68430d3-163b-41b0-9acb-7ae38414b74a admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:54:13.941768 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 889/1772] 10.222.0.65 () {58 vars in 1122 bytes} [Thu Oct 27 09:54:13 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 09:54:13.946003 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8272be0a-31d6-43cc-abaf-e40fa3010e85 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:54:13.956490 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8272be0a-31d6-43cc-abaf-e40fa3010e85 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:54:13.961749 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369cd696-766c-4218-95ee-f458136a290e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:54:13.962408 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369cd696-766c-4218-95ee-f458136a290e admin admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:54:13.962763 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369cd696-766c-4218-95ee-f458136a290e admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:54:13.963067 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369cd696-766c-4218-95ee-f458136a290e admin admin] PATH_INFO: `/v3/projects/b3c97c7b69bd43bc976069c47fb5f57d/users/5518f21962a34c6d945b078015872c80/roles/43543ce1450245af9661cb017bac17bd` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:54:13.979807 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369cd696-766c-4218-95ee-f458136a290e admin admin] RBAC: Authorizing `identity:create_grant(project_id=b3c97c7b69bd43bc976069c47fb5f57d, user_id=5518f21962a34c6d945b078015872c80, role_id=43543ce1450245af9661cb017bac17bd)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:54:13.982494 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369cd696-766c-4218-95ee-f458136a290e admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:54:14.066702 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 884/1773] 10.222.0.65 () {60 vars in 1483 bytes} [Thu Oct 27 09:54:13 2022] PUT /identity/v3/projects/b3c97c7b69bd43bc976069c47fb5f57d/users/5518f21962a34c6d945b078015872c80/roles/43543ce1450245af9661cb017bac17bd => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 09:54:14.078352 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680e9483-c0bc-4b9a-b568-190d62c93e51 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:54:14.078704 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680e9483-c0bc-4b9a-b568-190d62c93e51 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:54:14.078991 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680e9483-c0bc-4b9a-b568-190d62c93e51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:54:14.109795 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-680e9483-c0bc-4b9a-b568-190d62c93e51 None None] MFA Rules not processed for user `5518f21962a34c6d945b078015872c80`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:54:14.110933 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-680e9483-c0bc-4b9a-b568-190d62c93e51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:54:14.125074 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:DELETE=4,keystone:SELECT=92,keystone:INSERT=4 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:54:14.188089 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 890/1774] 10.222.0.65 () {58 vars in 958 bytes} [Thu Oct 27 09:54:14 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 09:54:14.193568 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369cd696-766c-4218-95ee-f458136a290e admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:54:14.258885 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369cd696-766c-4218-95ee-f458136a290e admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:54:14.263545 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc8bbd5-b18d-495f-a7f1-16df1a725767 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:54:14.264149 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc8bbd5-b18d-495f-a7f1-16df1a725767 admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:54:14.264431 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc8bbd5-b18d-495f-a7f1-16df1a725767 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:54:14.276380 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc8bbd5-b18d-495f-a7f1-16df1a725767 admin admin] PATH_INFO: `/v3/projects` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:54:14.276380 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc8bbd5-b18d-495f-a7f1-16df1a725767 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:54:14.276380 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc8bbd5-b18d-495f-a7f1-16df1a725767 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:54:14.369648 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 885/1775] 10.222.0.65 () {60 vars in 1153 bytes} [Thu Oct 27 09:54:14 2022] POST /identity/v3/projects => generated 385 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 09:54:14.373691 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680e9483-c0bc-4b9a-b568-190d62c93e51 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:54:14.385790 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680e9483-c0bc-4b9a-b568-190d62c93e51 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:54:14.445289 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074fdfb0-5c0f-46cf-b587-36660125eb29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:54:14.445912 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074fdfb0-5c0f-46cf-b587-36660125eb29 admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:54:14.446218 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074fdfb0-5c0f-46cf-b587-36660125eb29 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:54:14.446474 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074fdfb0-5c0f-46cf-b587-36660125eb29 admin admin] PATH_INFO: `/v3/users` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:54:14.447217 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074fdfb0-5c0f-46cf-b587-36660125eb29 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:54:14.449168 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074fdfb0-5c0f-46cf-b587-36660125eb29 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:54:14.523884 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 891/1776] 10.222.0.65 () {60 vars in 1144 bytes} [Thu Oct 27 09:54:14 2022] POST /identity/v3/users => generated 299 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 09:54:14.528045 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc8bbd5-b18d-495f-a7f1-16df1a725767 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:54:14.539665 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc8bbd5-b18d-495f-a7f1-16df1a725767 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:54:14.544615 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e3690d-936e-42db-9f5b-94e480c0f2a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:54:14.545255 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e3690d-936e-42db-9f5b-94e480c0f2a9 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:54:14.545540 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e3690d-936e-42db-9f5b-94e480c0f2a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:54:14.545815 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e3690d-936e-42db-9f5b-94e480c0f2a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:54:14.546509 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e3690d-936e-42db-9f5b-94e480c0f2a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:54:14.548263 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e3690d-936e-42db-9f5b-94e480c0f2a9 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:54:14.559713 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 886/1777] 10.222.0.65 () {58 vars in 1122 bytes} [Thu Oct 27 09:54:14 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 09:54:14.563879 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074fdfb0-5c0f-46cf-b587-36660125eb29 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:54:14.574146 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074fdfb0-5c0f-46cf-b587-36660125eb29 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:54:14.579101 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29720ec3-e824-4e81-9be7-9a704943dfb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:54:14.579793 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29720ec3-e824-4e81-9be7-9a704943dfb1 admin admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:54:14.580075 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29720ec3-e824-4e81-9be7-9a704943dfb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:54:14.580506 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29720ec3-e824-4e81-9be7-9a704943dfb1 admin admin] PATH_INFO: `/v3/projects/b9abcfdd98a34bedae1a859772f18b78/users/26a091aea12f497ab9a2359e4cd2c664/roles/6ad17b9f9dea4b66ab2da3677d7e715d` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:54:14.599678 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29720ec3-e824-4e81-9be7-9a704943dfb1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b9abcfdd98a34bedae1a859772f18b78, user_id=26a091aea12f497ab9a2359e4cd2c664, role_id=6ad17b9f9dea4b66ab2da3677d7e715d)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:54:14.602354 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29720ec3-e824-4e81-9be7-9a704943dfb1 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:54:14.607805 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e3690d-936e-42db-9f5b-94e480c0f2a9 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:54:14.609775 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-86e3690d-936e-42db-9f5b-94e480c0f2a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:54:14.624112 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e3690d-936e-42db-9f5b-94e480c0f2a9 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:54:14.628713 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45fa653-1ea3-42d9-81c6-3f8d1d9632f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:54:14.629329 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45fa653-1ea3-42d9-81c6-3f8d1d9632f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:54:14.630426 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45fa653-1ea3-42d9-81c6-3f8d1d9632f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:54:14.631585 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45fa653-1ea3-42d9-81c6-3f8d1d9632f7 admin admin] PATH_INFO: `/v3/users/8c0690d934044d25ad1769e1a012ff29` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:54:14.632276 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45fa653-1ea3-42d9-81c6-3f8d1d9632f7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8c0690d934044d25ad1769e1a012ff29)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:54:14.634346 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45fa653-1ea3-42d9-81c6-3f8d1d9632f7 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:54:14.691890 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 892/1778] 10.222.0.65 () {60 vars in 1483 bytes} [Thu Oct 27 09:54:14 2022] PUT /identity/v3/projects/b9abcfdd98a34bedae1a859772f18b78/users/26a091aea12f497ab9a2359e4cd2c664/roles/6ad17b9f9dea4b66ab2da3677d7e715d => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 09:54:14.696542 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29720ec3-e824-4e81-9be7-9a704943dfb1 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:54:14.765408 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29720ec3-e824-4e81-9be7-9a704943dfb1 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:54:14.772471 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca03eea-bcae-4140-a40b-295e30afef41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:54:14.773239 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca03eea-bcae-4140-a40b-295e30afef41 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:54:14.781526 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca03eea-bcae-4140-a40b-295e30afef41 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:54:14.781526 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca03eea-bcae-4140-a40b-295e30afef41 admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:54:14.781526 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca03eea-bcae-4140-a40b-295e30afef41 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:54:14.781526 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca03eea-bcae-4140-a40b-295e30afef41 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:54:14.787504 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 893/1779] 10.222.0.65 () {58 vars in 1122 bytes} [Thu Oct 27 09:54:14 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 09:54:14.792165 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca03eea-bcae-4140-a40b-295e30afef41 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:54:14.802736 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca03eea-bcae-4140-a40b-295e30afef41 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:54:14.807376 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8acbb3-2347-42ab-b862-de3e22e41483 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:54:14.808016 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8acbb3-2347-42ab-b862-de3e22e41483 admin admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:54:14.808296 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8acbb3-2347-42ab-b862-de3e22e41483 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:54:14.808570 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8acbb3-2347-42ab-b862-de3e22e41483 admin admin] PATH_INFO: `/v3/projects/b9abcfdd98a34bedae1a859772f18b78/users/26a091aea12f497ab9a2359e4cd2c664/roles/6ad17b9f9dea4b66ab2da3677d7e715d` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:54:14.810542 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8acbb3-2347-42ab-b862-de3e22e41483 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b9abcfdd98a34bedae1a859772f18b78, user_id=26a091aea12f497ab9a2359e4cd2c664, role_id=6ad17b9f9dea4b66ab2da3677d7e715d)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:54:14.813188 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8acbb3-2347-42ab-b862-de3e22e41483 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:54:14.825548 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 894/1780] 10.222.0.65 () {60 vars in 1483 bytes} [Thu Oct 27 09:54:14 2022] PUT /identity/v3/projects/b9abcfdd98a34bedae1a859772f18b78/users/26a091aea12f497ab9a2359e4cd2c664/roles/6ad17b9f9dea4b66ab2da3677d7e715d => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 09:54:14.837396 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e997ce3-65e9-4fab-b185-9b04c7487dba None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:54:14.837691 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e997ce3-65e9-4fab-b185-9b04c7487dba None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:54:14.837972 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e997ce3-65e9-4fab-b185-9b04c7487dba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:54:14.846102 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:54:14.868407 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-1e997ce3-65e9-4fab-b185-9b04c7487dba None None] MFA Rules not processed for user `26a091aea12f497ab9a2359e4cd2c664`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:54:14.869708 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-1e997ce3-65e9-4fab-b185-9b04c7487dba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:54:14.932570 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-e45fa653-1ea3-42d9-81c6-3f8d1d9632f7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8c0690d934044d25ad1769e1a012ff29'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:54:14.933305 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-e45fa653-1ea3-42d9-81c6-3f8d1d9632f7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8c0690d934044d25ad1769e1a012ff29'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:54:14.941630 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-e45fa653-1ea3-42d9-81c6-3f8d1d9632f7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8c0690d934044d25ad1769e1a012ff29'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:54:14.943386 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 895/1781] 10.222.0.65 () {58 vars in 958 bytes} [Thu Oct 27 09:54:14 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 09:54:14.944519 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-e45fa653-1ea3-42d9-81c6-3f8d1d9632f7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8c0690d934044d25ad1769e1a012ff29'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:54:14.956807 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e997ce3-65e9-4fab-b185-9b04c7487dba None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:54:14.958479 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-1e997ce3-65e9-4fab-b185-9b04c7487dba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:54:14.968430 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=89,keystone:INSERT=3,keystone:DELETE=8 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:54:14.979731 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-e45fa653-1ea3-42d9-81c6-3f8d1d9632f7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8c0690d934044d25ad1769e1a012ff29'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:54:15.039450 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e997ce3-65e9-4fab-b185-9b04c7487dba None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:54:15.043740 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9065cb6-85a1-403d-a0dc-8b349ebc7863 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8e5d5f04c4741bb86ca4a0f667d4ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc2e3a7a1bcc480891c0b433291c00b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:54:15.045070 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9065cb6-85a1-403d-a0dc-8b349ebc7863 service cinder] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:54:15.045070 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9065cb6-85a1-403d-a0dc-8b349ebc7863 service cinder] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:54:15.045273 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 887/1782] 10.222.0.65 () {58 vars in 1224 bytes} [Thu Oct 27 09:54:14 2022] DELETE /identity/v3/users/8c0690d934044d25ad1769e1a012ff29 => generated 0 bytes in 438 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 09:54:15.045800 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9065cb6-85a1-403d-a0dc-8b349ebc7863 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:54:15.047357 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-c9065cb6-85a1-403d-a0dc-8b349ebc7863 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:54:15.049227 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bb619d-8b25-463d-8259-3e15a047baff None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:54:15.049714 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bb619d-8b25-463d-8259-3e15a047baff None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:54:15.050139 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bb619d-8b25-463d-8259-3e15a047baff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:54:15.061548 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9065cb6-85a1-403d-a0dc-8b349ebc7863 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:54:15.063048 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9065cb6-85a1-403d-a0dc-8b349ebc7863 service cinder] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:54:15.074276 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-b8bb619d-8b25-463d-8259-3e15a047baff None None] MFA Rules not processed for user `b5065084bf664b99bdeac46067cb0f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:54:15.075555 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-b8bb619d-8b25-463d-8259-3e15a047baff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:54:15.075816 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 896/1783] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Oct 27 09:54:14 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 09:54:15.141921 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 888/1784] 10.222.0.65 () {58 vars in 958 bytes} [Thu Oct 27 09:54:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 09:54:15.147621 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9065cb6-85a1-403d-a0dc-8b349ebc7863 service cinder] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:54:15.149048 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-c9065cb6-85a1-403d-a0dc-8b349ebc7863 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:54:15.152626 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bb619d-8b25-463d-8259-3e15a047baff None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:54:15.154269 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-b8bb619d-8b25-463d-8259-3e15a047baff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:54:15.228099 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9065cb6-85a1-403d-a0dc-8b349ebc7863 service cinder] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:54:15.228319 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bb619d-8b25-463d-8259-3e15a047baff None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:54:15.231958 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5c9ec9-fb4b-47ed-9917-899dadd9973f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6191cc41efa74f46b49022cf387f7a4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc2e3a7a1bcc480891c0b433291c00b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:54:15.232569 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5c9ec9-fb4b-47ed-9917-899dadd9973f service neutron] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:54:15.232783 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c333a6dd-77ea-4a42-905e-5e2fe1ffb521 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:54:15.232890 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5c9ec9-fb4b-47ed-9917-899dadd9973f service neutron] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:54:15.233114 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5c9ec9-fb4b-47ed-9917-899dadd9973f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:54:15.233425 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c333a6dd-77ea-4a42-905e-5e2fe1ffb521 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:54:15.233708 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c333a6dd-77ea-4a42-905e-5e2fe1ffb521 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:54:15.233988 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c333a6dd-77ea-4a42-905e-5e2fe1ffb521 admin admin] PATH_INFO: `/v3/users/5518f21962a34c6d945b078015872c80` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:54:15.235138 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c333a6dd-77ea-4a42-905e-5e2fe1ffb521 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5518f21962a34c6d945b078015872c80)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:54:15.237062 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c333a6dd-77ea-4a42-905e-5e2fe1ffb521 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:54:15.244727 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5c9ec9-fb4b-47ed-9917-899dadd9973f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:54:15.246193 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5c9ec9-fb4b-47ed-9917-899dadd9973f service neutron] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:54:15.257706 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 889/1785] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Oct 27 09:54:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 09:54:15.504771 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:54:15.532216 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-c333a6dd-77ea-4a42-905e-5e2fe1ffb521 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5518f21962a34c6d945b078015872c80'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:54:15.544746 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-c333a6dd-77ea-4a42-905e-5e2fe1ffb521 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5518f21962a34c6d945b078015872c80'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:54:15.545482 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-c333a6dd-77ea-4a42-905e-5e2fe1ffb521 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5518f21962a34c6d945b078015872c80'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:54:15.552418 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-c333a6dd-77ea-4a42-905e-5e2fe1ffb521 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5518f21962a34c6d945b078015872c80'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:54:15.630482 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-c333a6dd-77ea-4a42-905e-5e2fe1ffb521 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5518f21962a34c6d945b078015872c80'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:54:15.639361 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 897/1786] 10.222.0.65 () {58 vars in 1224 bytes} [Thu Oct 27 09:54:15 2022] DELETE /identity/v3/users/5518f21962a34c6d945b078015872c80 => generated 0 bytes in 492 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 09:54:15.643999 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70068419-a025-41d9-a91d-2d61ef870668 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:54:15.644354 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70068419-a025-41d9-a91d-2d61ef870668 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:54:15.644625 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70068419-a025-41d9-a91d-2d61ef870668 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:54:15.664931 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-70068419-a025-41d9-a91d-2d61ef870668 None None] MFA Rules not processed for user `b5065084bf664b99bdeac46067cb0f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:54:15.666150 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-70068419-a025-41d9-a91d-2d61ef870668 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:54:15.731004 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 890/1787] 10.222.0.65 () {58 vars in 958 bytes} [Thu Oct 27 09:54:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 09:54:15.735754 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c333a6dd-77ea-4a42-905e-5e2fe1ffb521 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:54:15.737627 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-c333a6dd-77ea-4a42-905e-5e2fe1ffb521 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:54:15.743942 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70068419-a025-41d9-a91d-2d61ef870668 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:54:15.745557 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-70068419-a025-41d9-a91d-2d61ef870668 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:54:15.754933 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c333a6dd-77ea-4a42-905e-5e2fe1ffb521 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:54:15.762795 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03858c3a-dbe3-4895-b537-ec19c047bfad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:54:15.763579 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03858c3a-dbe3-4895-b537-ec19c047bfad admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:54:15.763869 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03858c3a-dbe3-4895-b537-ec19c047bfad admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:54:15.765946 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03858c3a-dbe3-4895-b537-ec19c047bfad admin admin] PATH_INFO: `/v3/projects/f2c999efd73543da8736ca998375b085` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:54:15.765946 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03858c3a-dbe3-4895-b537-ec19c047bfad admin admin] RBAC: Authorizing `identity:delete_project(project_id=f2c999efd73543da8736ca998375b085)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:54:15.767466 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03858c3a-dbe3-4895-b537-ec19c047bfad admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:54:15.796868 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:DELETE=2,keystone:SELECT=97,keystone:INSERT=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:54:15.823949 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70068419-a025-41d9-a91d-2d61ef870668 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:54:15.828347 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b66107-38ea-42df-bce4-1db38e2f0548 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6191cc41efa74f46b49022cf387f7a4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc2e3a7a1bcc480891c0b433291c00b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:54:15.829073 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b66107-38ea-42df-bce4-1db38e2f0548 service neutron] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:54:15.829428 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b66107-38ea-42df-bce4-1db38e2f0548 service neutron] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:54:15.829778 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b66107-38ea-42df-bce4-1db38e2f0548 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:54:15.841113 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b66107-38ea-42df-bce4-1db38e2f0548 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:54:15.842751 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b66107-38ea-42df-bce4-1db38e2f0548 service neutron] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:54:15.854943 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 891/1788] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Oct 27 09:54:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 09:54:15.916195 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-03858c3a-dbe3-4895-b537-ec19c047bfad admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f2c999efd73543da8736ca998375b085', 'request_id': 'req-03858c3a-dbe3-4895-b537-ec19c047bfad'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:54:16.023789 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-03858c3a-dbe3-4895-b537-ec19c047bfad admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f2c999efd73543da8736ca998375b085', 'request_id': 'req-03858c3a-dbe3-4895-b537-ec19c047bfad'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:54:16.030253 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-03858c3a-dbe3-4895-b537-ec19c047bfad admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f2c999efd73543da8736ca998375b085', 'request_id': 'req-03858c3a-dbe3-4895-b537-ec19c047bfad'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:54:16.042108 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-03858c3a-dbe3-4895-b537-ec19c047bfad admin admin] The token cache is being invalidate because project f2c999efd73543da8736ca998375b085 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 09:54:16.042396 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-03858c3a-dbe3-4895-b537-ec19c047bfad admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:54:16.043151 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-03858c3a-dbe3-4895-b537-ec19c047bfad admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:54:16.044702 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 898/1789] 10.222.0.65 () {58 vars in 1233 bytes} [Thu Oct 27 09:54:15 2022] DELETE /identity/v3/projects/f2c999efd73543da8736ca998375b085 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 09:54:16.050386 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873b48ed-036d-421b-b3ab-f9124cfc6fae None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:54:16.050884 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873b48ed-036d-421b-b3ab-f9124cfc6fae None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:54:16.051087 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873b48ed-036d-421b-b3ab-f9124cfc6fae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:54:16.073158 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-873b48ed-036d-421b-b3ab-f9124cfc6fae None None] MFA Rules not processed for user `b5065084bf664b99bdeac46067cb0f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:54:16.074430 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-873b48ed-036d-421b-b3ab-f9124cfc6fae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:54:16.149166 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 892/1790] 10.222.0.65 () {58 vars in 958 bytes} [Thu Oct 27 09:54:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 09:54:16.158346 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1029e0-3e57-4f0f-a2ab-b94dd4611780 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:54:16.158683 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1029e0-3e57-4f0f-a2ab-b94dd4611780 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:54:16.159012 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1029e0-3e57-4f0f-a2ab-b94dd4611780 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:54:16.180149 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-9c1029e0-3e57-4f0f-a2ab-b94dd4611780 None None] MFA Rules not processed for user `b5065084bf664b99bdeac46067cb0f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:54:16.181473 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-9c1029e0-3e57-4f0f-a2ab-b94dd4611780 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:54:16.189802 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 899/1791] 10.222.0.65 () {58 vars in 958 bytes} [Thu Oct 27 09:54:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 09:54:16.195685 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873b48ed-036d-421b-b3ab-f9124cfc6fae None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:54:16.205568 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873b48ed-036d-421b-b3ab-f9124cfc6fae None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:54:16.211802 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5b50ca-c7a7-4daf-9db3-9ebad4cfae95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:54:16.212450 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5b50ca-c7a7-4daf-9db3-9ebad4cfae95 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:54:16.212737 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5b50ca-c7a7-4daf-9db3-9ebad4cfae95 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:54:16.213009 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5b50ca-c7a7-4daf-9db3-9ebad4cfae95 admin admin] PATH_INFO: `/v3/domains` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:54:16.213999 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5b50ca-c7a7-4daf-9db3-9ebad4cfae95 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 09:54:16.213999 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5b50ca-c7a7-4daf-9db3-9ebad4cfae95 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:54:16.215826 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5b50ca-c7a7-4daf-9db3-9ebad4cfae95 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:54:16.232533 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 893/1792] 10.222.0.65 () {58 vars in 1153 bytes} [Thu Oct 27 09:54:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 09:54:16.233675 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1029e0-3e57-4f0f-a2ab-b94dd4611780 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:54:16.243501 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1029e0-3e57-4f0f-a2ab-b94dd4611780 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:54:16.248331 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ffa187-37ad-46cd-8d4a-a862e0e213cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:54:16.248950 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ffa187-37ad-46cd-8d4a-a862e0e213cd admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:54:16.249235 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ffa187-37ad-46cd-8d4a-a862e0e213cd admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:54:16.249514 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ffa187-37ad-46cd-8d4a-a862e0e213cd admin admin] PATH_INFO: `/v3/projects` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:54:16.250149 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ffa187-37ad-46cd-8d4a-a862e0e213cd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:54:16.252127 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ffa187-37ad-46cd-8d4a-a862e0e213cd admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:54:16.342090 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5b50ca-c7a7-4daf-9db3-9ebad4cfae95 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:54:16.346056 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 900/1793] 10.222.0.65 () {60 vars in 1153 bytes} [Thu Oct 27 09:54:16 2022] POST /identity/v3/projects => generated 383 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 09:54:16.346233 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-6f5b50ca-c7a7-4daf-9db3-9ebad4cfae95 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:54:16.347925 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ffa187-37ad-46cd-8d4a-a862e0e213cd admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:54:16.363733 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5b50ca-c7a7-4daf-9db3-9ebad4cfae95 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:54:16.418176 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ffa187-37ad-46cd-8d4a-a862e0e213cd admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:54:16.423148 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d350faf1-181d-4392-be96-8c587f915c1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:54:16.423770 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d350faf1-181d-4392-be96-8c587f915c1c admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:54:16.424050 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d350faf1-181d-4392-be96-8c587f915c1c admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:54:16.424335 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d350faf1-181d-4392-be96-8c587f915c1c admin admin] PATH_INFO: `/v3/users` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:54:16.425039 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d350faf1-181d-4392-be96-8c587f915c1c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:54:16.427018 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d350faf1-181d-4392-be96-8c587f915c1c admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:54:16.430809 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9ff507-80a6-4615-9fc7-3b621d2443e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:54:16.431684 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9ff507-80a6-4615-9fc7-3b621d2443e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:54:16.431965 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9ff507-80a6-4615-9fc7-3b621d2443e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:54:16.432238 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9ff507-80a6-4615-9fc7-3b621d2443e5 admin admin] PATH_INFO: `/v3/projects/b3c97c7b69bd43bc976069c47fb5f57d` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:54:16.434783 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9ff507-80a6-4615-9fc7-3b621d2443e5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b3c97c7b69bd43bc976069c47fb5f57d)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:54:16.435874 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9ff507-80a6-4615-9fc7-3b621d2443e5 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:54:16.439573 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=82,keystone:DELETE=12,keystone:INSERT=6 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:54:16.533955 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 901/1794] 10.222.0.65 () {60 vars in 1144 bytes} [Thu Oct 27 09:54:16 2022] POST /identity/v3/users => generated 292 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 09:54:16.538330 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d350faf1-181d-4392-be96-8c587f915c1c admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:54:16.549146 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d350faf1-181d-4392-be96-8c587f915c1c admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:54:16.558305 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-2b9ff507-80a6-4615-9fc7-3b621d2443e5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b3c97c7b69bd43bc976069c47fb5f57d', 'request_id': 'req-2b9ff507-80a6-4615-9fc7-3b621d2443e5'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:54:16.565149 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-2b9ff507-80a6-4615-9fc7-3b621d2443e5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b3c97c7b69bd43bc976069c47fb5f57d', 'request_id': 'req-2b9ff507-80a6-4615-9fc7-3b621d2443e5'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:54:16.610289 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55db1ae6-820f-44b6-be6f-07451c07f8c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:54:16.610871 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55db1ae6-820f-44b6-be6f-07451c07f8c7 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:54:16.611155 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55db1ae6-820f-44b6-be6f-07451c07f8c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:54:16.611430 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55db1ae6-820f-44b6-be6f-07451c07f8c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:54:16.612071 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55db1ae6-820f-44b6-be6f-07451c07f8c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:54:16.613674 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55db1ae6-820f-44b6-be6f-07451c07f8c7 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:54:16.622854 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-2b9ff507-80a6-4615-9fc7-3b621d2443e5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b3c97c7b69bd43bc976069c47fb5f57d', 'request_id': 'req-2b9ff507-80a6-4615-9fc7-3b621d2443e5'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:54:16.624533 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 902/1795] 10.222.0.65 () {58 vars in 1122 bytes} [Thu Oct 27 09:54:16 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 09:54:16.626015 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:54:16.628804 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55db1ae6-820f-44b6-be6f-07451c07f8c7 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:54:16.637018 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-2b9ff507-80a6-4615-9fc7-3b621d2443e5 admin admin] The token cache is being invalidate because project b3c97c7b69bd43bc976069c47fb5f57d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 09:54:16.637312 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-2b9ff507-80a6-4615-9fc7-3b621d2443e5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:54:16.638000 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-2b9ff507-80a6-4615-9fc7-3b621d2443e5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:54:16.639555 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 894/1796] 10.222.0.65 () {58 vars in 1233 bytes} [Thu Oct 27 09:54:16 2022] DELETE /identity/v3/projects/b3c97c7b69bd43bc976069c47fb5f57d => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 09:54:16.640159 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55db1ae6-820f-44b6-be6f-07451c07f8c7 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:54:16.645099 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf3ef14-c717-4a8b-940c-f4ba9f603309 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:54:16.645709 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf3ef14-c717-4a8b-940c-f4ba9f603309 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:54:16.645988 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf3ef14-c717-4a8b-940c-f4ba9f603309 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:54:16.646265 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf3ef14-c717-4a8b-940c-f4ba9f603309 admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:54:16.648638 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf3ef14-c717-4a8b-940c-f4ba9f603309 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:54:16.649097 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf3ef14-c717-4a8b-940c-f4ba9f603309 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:54:16.651372 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9ff507-80a6-4615-9fc7-3b621d2443e5 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:54:16.653046 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-2b9ff507-80a6-4615-9fc7-3b621d2443e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:54:16.664214 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 903/1797] 10.222.0.65 () {58 vars in 1122 bytes} [Thu Oct 27 09:54:16 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 09:54:16.665366 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf3ef14-c717-4a8b-940c-f4ba9f603309 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:54:16.666195 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9ff507-80a6-4615-9fc7-3b621d2443e5 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:54:16.667245 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-4cf3ef14-c717-4a8b-940c-f4ba9f603309 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:54:16.671212 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3173827e-5b9e-4a18-977b-cc9fc23f2dea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:54:16.671881 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3173827e-5b9e-4a18-977b-cc9fc23f2dea admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:54:16.672160 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3173827e-5b9e-4a18-977b-cc9fc23f2dea admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:54:16.672435 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3173827e-5b9e-4a18-977b-cc9fc23f2dea admin admin] PATH_INFO: `/v3/users/26a091aea12f497ab9a2359e4cd2c664` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:54:16.673603 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3173827e-5b9e-4a18-977b-cc9fc23f2dea admin admin] RBAC: Authorizing `identity:delete_user(user_id=26a091aea12f497ab9a2359e4cd2c664)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:54:16.675580 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3173827e-5b9e-4a18-977b-cc9fc23f2dea admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:54:16.680733 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf3ef14-c717-4a8b-940c-f4ba9f603309 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:54:16.687141 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625a6ded-417c-4690-a808-4e0451432597 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:54:16.687925 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625a6ded-417c-4690-a808-4e0451432597 admin admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:54:16.696821 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625a6ded-417c-4690-a808-4e0451432597 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:54:16.696821 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625a6ded-417c-4690-a808-4e0451432597 admin admin] PATH_INFO: `/v3/projects/f81acc4ef6a746c2b3a3f82b817f00a4/users/20cc370d9dbc4af19b9860ed47847ca3/roles/43543ce1450245af9661cb017bac17bd` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:54:16.705737 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625a6ded-417c-4690-a808-4e0451432597 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f81acc4ef6a746c2b3a3f82b817f00a4, user_id=20cc370d9dbc4af19b9860ed47847ca3, role_id=43543ce1450245af9661cb017bac17bd)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:54:16.708907 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625a6ded-417c-4690-a808-4e0451432597 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:54:16.829819 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 904/1798] 10.222.0.65 () {60 vars in 1483 bytes} [Thu Oct 27 09:54:16 2022] PUT /identity/v3/projects/f81acc4ef6a746c2b3a3f82b817f00a4/users/20cc370d9dbc4af19b9860ed47847ca3/roles/43543ce1450245af9661cb017bac17bd => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 09:54:16.841110 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5e80ef-5d92-41fa-b5b0-41217fd60756 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:54:16.841401 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5e80ef-5d92-41fa-b5b0-41217fd60756 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:54:16.841684 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5e80ef-5d92-41fa-b5b0-41217fd60756 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:54:16.873036 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-6e5e80ef-5d92-41fa-b5b0-41217fd60756 None None] MFA Rules not processed for user `20cc370d9dbc4af19b9860ed47847ca3`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:54:16.874213 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-6e5e80ef-5d92-41fa-b5b0-41217fd60756 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:54:16.936530 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-3173827e-5b9e-4a18-977b-cc9fc23f2dea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '26a091aea12f497ab9a2359e4cd2c664'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:54:16.937581 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-3173827e-5b9e-4a18-977b-cc9fc23f2dea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '26a091aea12f497ab9a2359e4cd2c664'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:54:16.942417 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 905/1799] 10.222.0.65 () {58 vars in 958 bytes} [Thu Oct 27 09:54:16 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 09:54:16.946980 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5e80ef-5d92-41fa-b5b0-41217fd60756 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:54:16.947386 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-3173827e-5b9e-4a18-977b-cc9fc23f2dea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '26a091aea12f497ab9a2359e4cd2c664'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:54:16.948092 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-3173827e-5b9e-4a18-977b-cc9fc23f2dea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '26a091aea12f497ab9a2359e4cd2c664'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:54:16.962987 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-3173827e-5b9e-4a18-977b-cc9fc23f2dea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '26a091aea12f497ab9a2359e4cd2c664'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:54:17.002161 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:54:17.017323 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5e80ef-5d92-41fa-b5b0-41217fd60756 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:54:17.022165 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737256ff-2970-4191-8204-4fc4b3820c68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:54:17.022918 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737256ff-2970-4191-8204-4fc4b3820c68 admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:54:17.023172 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737256ff-2970-4191-8204-4fc4b3820c68 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:54:17.023446 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737256ff-2970-4191-8204-4fc4b3820c68 admin admin] PATH_INFO: `/v3/projects` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:54:17.024079 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737256ff-2970-4191-8204-4fc4b3820c68 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:54:17.026056 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737256ff-2970-4191-8204-4fc4b3820c68 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:54:17.087347 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 895/1800] 10.222.0.65 () {58 vars in 1224 bytes} [Thu Oct 27 09:54:16 2022] DELETE /identity/v3/users/26a091aea12f497ab9a2359e4cd2c664 => generated 0 bytes in 436 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 09:54:17.202892 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 906/1801] 10.222.0.65 () {60 vars in 1153 bytes} [Thu Oct 27 09:54:16 2022] POST /identity/v3/projects => generated 385 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 09:54:17.213917 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3173827e-5b9e-4a18-977b-cc9fc23f2dea admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:54:17.216079 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-3173827e-5b9e-4a18-977b-cc9fc23f2dea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:54:17.296929 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3173827e-5b9e-4a18-977b-cc9fc23f2dea admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:54:17.369639 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7977683-17f4-4d08-a097-bbce1de4da4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:54:17.370615 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7977683-17f4-4d08-a097-bbce1de4da4d admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:54:17.370895 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7977683-17f4-4d08-a097-bbce1de4da4d admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:54:17.371169 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7977683-17f4-4d08-a097-bbce1de4da4d admin admin] PATH_INFO: `/v3/users` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:54:17.371812 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7977683-17f4-4d08-a097-bbce1de4da4d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:54:17.373749 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7977683-17f4-4d08-a097-bbce1de4da4d admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:54:17.448565 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=85,keystone:DELETE=11,keystone:INSERT=4 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:54:17.454028 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 896/1802] 10.222.0.65 () {60 vars in 1144 bytes} [Thu Oct 27 09:54:17 2022] POST /identity/v3/users => generated 293 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 09:54:17.457824 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737256ff-2970-4191-8204-4fc4b3820c68 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:54:17.468702 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737256ff-2970-4191-8204-4fc4b3820c68 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:54:17.473568 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f66472-4065-478c-a041-e46de1883cce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:54:17.474222 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f66472-4065-478c-a041-e46de1883cce admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:54:17.474565 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f66472-4065-478c-a041-e46de1883cce admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:54:17.476578 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f66472-4065-478c-a041-e46de1883cce admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:54:17.477408 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f66472-4065-478c-a041-e46de1883cce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:54:17.479109 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f66472-4065-478c-a041-e46de1883cce admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:54:17.492475 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 907/1803] 10.222.0.65 () {58 vars in 1122 bytes} [Thu Oct 27 09:54:17 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 09:54:17.494117 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7977683-17f4-4d08-a097-bbce1de4da4d admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:54:17.504622 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7977683-17f4-4d08-a097-bbce1de4da4d admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:54:17.509539 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40e33a8-e440-4de9-8d89-b403964a50ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:54:17.510145 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40e33a8-e440-4de9-8d89-b403964a50ea admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:54:17.510426 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40e33a8-e440-4de9-8d89-b403964a50ea admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:54:17.512828 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40e33a8-e440-4de9-8d89-b403964a50ea admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:54:17.512828 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40e33a8-e440-4de9-8d89-b403964a50ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:54:17.513127 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40e33a8-e440-4de9-8d89-b403964a50ea admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:54:17.524737 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 897/1804] 10.222.0.65 () {58 vars in 1122 bytes} [Thu Oct 27 09:54:17 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 09:54:17.529271 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f66472-4065-478c-a041-e46de1883cce admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:54:17.541610 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f66472-4065-478c-a041-e46de1883cce admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:54:17.546305 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01431709-0208-43b7-966c-e980fd6c3cd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:54:17.546975 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01431709-0208-43b7-966c-e980fd6c3cd1 admin admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:54:17.547261 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01431709-0208-43b7-966c-e980fd6c3cd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:54:17.547540 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01431709-0208-43b7-966c-e980fd6c3cd1 admin admin] PATH_INFO: `/v3/projects/50cb184e7a3343ba88adc30704bfc9fb/users/b83bd123fcf645a2b5571d3220ea659b/roles/43543ce1450245af9661cb017bac17bd` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:54:17.562454 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01431709-0208-43b7-966c-e980fd6c3cd1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=50cb184e7a3343ba88adc30704bfc9fb, user_id=b83bd123fcf645a2b5571d3220ea659b, role_id=43543ce1450245af9661cb017bac17bd)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:54:17.565251 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01431709-0208-43b7-966c-e980fd6c3cd1 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:54:17.587254 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40e33a8-e440-4de9-8d89-b403964a50ea admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:54:17.587254 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-b40e33a8-e440-4de9-8d89-b403964a50ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:54:17.591951 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40e33a8-e440-4de9-8d89-b403964a50ea admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:54:17.596978 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca14431-c086-46f2-86c5-0e660ab455eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:54:17.597496 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca14431-c086-46f2-86c5-0e660ab455eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:54:17.597775 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca14431-c086-46f2-86c5-0e660ab455eb admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:54:17.598048 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca14431-c086-46f2-86c5-0e660ab455eb admin admin] PATH_INFO: `/v3/projects/b9abcfdd98a34bedae1a859772f18b78` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:54:17.599182 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca14431-c086-46f2-86c5-0e660ab455eb admin admin] RBAC: Authorizing `identity:delete_project(project_id=b9abcfdd98a34bedae1a859772f18b78)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:54:17.601280 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca14431-c086-46f2-86c5-0e660ab455eb admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:54:17.674891 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 908/1805] 10.222.0.65 () {60 vars in 1483 bytes} [Thu Oct 27 09:54:17 2022] PUT /identity/v3/projects/50cb184e7a3343ba88adc30704bfc9fb/users/b83bd123fcf645a2b5571d3220ea659b/roles/43543ce1450245af9661cb017bac17bd => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 09:54:17.685560 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620722d0-f7eb-4266-96c7-08bfda5150f1 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:54:17.685852 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620722d0-f7eb-4266-96c7-08bfda5150f1 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:54:17.686209 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620722d0-f7eb-4266-96c7-08bfda5150f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:54:17.718363 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-620722d0-f7eb-4266-96c7-08bfda5150f1 None None] MFA Rules not processed for user `b83bd123fcf645a2b5571d3220ea659b`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:54:17.718589 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-6ca14431-c086-46f2-86c5-0e660ab455eb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b9abcfdd98a34bedae1a859772f18b78', 'request_id': 'req-6ca14431-c086-46f2-86c5-0e660ab455eb'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:54:17.719548 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-620722d0-f7eb-4266-96c7-08bfda5150f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:54:17.725955 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-6ca14431-c086-46f2-86c5-0e660ab455eb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b9abcfdd98a34bedae1a859772f18b78', 'request_id': 'req-6ca14431-c086-46f2-86c5-0e660ab455eb'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:54:17.792130 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 909/1806] 10.222.0.65 () {58 vars in 958 bytes} [Thu Oct 27 09:54:17 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 09:54:17.796687 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620722d0-f7eb-4266-96c7-08bfda5150f1 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:54:17.800391 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-6ca14431-c086-46f2-86c5-0e660ab455eb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b9abcfdd98a34bedae1a859772f18b78', 'request_id': 'req-6ca14431-c086-46f2-86c5-0e660ab455eb'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:54:17.812877 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-6ca14431-c086-46f2-86c5-0e660ab455eb admin admin] The token cache is being invalidate because project b9abcfdd98a34bedae1a859772f18b78 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 09:54:17.813528 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-6ca14431-c086-46f2-86c5-0e660ab455eb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:54:17.814903 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-6ca14431-c086-46f2-86c5-0e660ab455eb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:54:17.816985 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 898/1807] 10.222.0.65 () {58 vars in 1233 bytes} [Thu Oct 27 09:54:17 2022] DELETE /identity/v3/projects/b9abcfdd98a34bedae1a859772f18b78 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 09:54:17.822546 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a748f89-463b-4578-8810-cc8a828d0c4d None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:54:17.822862 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a748f89-463b-4578-8810-cc8a828d0c4d None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:54:17.823414 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a748f89-463b-4578-8810-cc8a828d0c4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:54:17.854919 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-9a748f89-463b-4578-8810-cc8a828d0c4d None None] MFA Rules not processed for user `b5065084bf664b99bdeac46067cb0f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:54:17.856294 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-9a748f89-463b-4578-8810-cc8a828d0c4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:54:17.876233 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620722d0-f7eb-4266-96c7-08bfda5150f1 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:54:17.883078 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681c45b0-9fa2-48ad-8f56-9d38515876f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:54:17.883813 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681c45b0-9fa2-48ad-8f56-9d38515876f7 admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:54:17.883998 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681c45b0-9fa2-48ad-8f56-9d38515876f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:54:17.884419 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681c45b0-9fa2-48ad-8f56-9d38515876f7 admin admin] PATH_INFO: `/v3/projects` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:54:17.885055 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681c45b0-9fa2-48ad-8f56-9d38515876f7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:54:17.887414 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681c45b0-9fa2-48ad-8f56-9d38515876f7 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:54:17.928451 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 899/1808] 10.222.0.65 () {58 vars in 958 bytes} [Thu Oct 27 09:54:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 09:54:17.936444 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe9f6f1-3dac-4dad-93a4-9ce308ef0982 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:54:17.936764 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe9f6f1-3dac-4dad-93a4-9ce308ef0982 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:54:17.937049 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe9f6f1-3dac-4dad-93a4-9ce308ef0982 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:54:17.958007 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-cfe9f6f1-3dac-4dad-93a4-9ce308ef0982 None None] MFA Rules not processed for user `b5065084bf664b99bdeac46067cb0f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:54:17.959432 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-cfe9f6f1-3dac-4dad-93a4-9ce308ef0982 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:54:17.968139 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 900/1809] 10.222.0.65 () {58 vars in 958 bytes} [Thu Oct 27 09:54:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 09:54:17.972349 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe9f6f1-3dac-4dad-93a4-9ce308ef0982 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:54:17.982199 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe9f6f1-3dac-4dad-93a4-9ce308ef0982 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:54:17.986938 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200d2ef1-132c-404b-b113-9ade2be51357 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:54:17.987535 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200d2ef1-132c-404b-b113-9ade2be51357 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:54:17.987813 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200d2ef1-132c-404b-b113-9ade2be51357 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:54:17.988088 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200d2ef1-132c-404b-b113-9ade2be51357 admin admin] PATH_INFO: `/v3/domains` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:54:17.988732 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200d2ef1-132c-404b-b113-9ade2be51357 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 09:54:17.989037 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200d2ef1-132c-404b-b113-9ade2be51357 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:54:17.991742 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200d2ef1-132c-404b-b113-9ade2be51357 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:54:17.997148 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 910/1810] 10.222.0.65 () {60 vars in 1153 bytes} [Thu Oct 27 09:54:17 2022] POST /identity/v3/projects => generated 385 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 09:54:18.001319 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681c45b0-9fa2-48ad-8f56-9d38515876f7 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:54:18.003126 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-681c45b0-9fa2-48ad-8f56-9d38515876f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:54:18.006863 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 901/1811] 10.222.0.65 () {58 vars in 1153 bytes} [Thu Oct 27 09:54:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 09:54:18.008411 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200d2ef1-132c-404b-b113-9ade2be51357 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:54:18.018108 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200d2ef1-132c-404b-b113-9ade2be51357 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:54:18.021311 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:54:18.071720 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:54:18.079707 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681c45b0-9fa2-48ad-8f56-9d38515876f7 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:54:18.080574 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b492444-d6bf-4419-93a1-59bc6a4101a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:54:18.081190 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b492444-d6bf-4419-93a1-59bc6a4101a9 admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:54:18.081472 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b492444-d6bf-4419-93a1-59bc6a4101a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:54:18.081751 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b492444-d6bf-4419-93a1-59bc6a4101a9 admin admin] PATH_INFO: `/v3/projects` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:54:18.083513 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b492444-d6bf-4419-93a1-59bc6a4101a9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:54:18.084502 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b492444-d6bf-4419-93a1-59bc6a4101a9 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:54:18.088342 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f03fb3b-f795-49b6-8e9b-6d2f1b2924a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:54:18.089135 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f03fb3b-f795-49b6-8e9b-6d2f1b2924a1 admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:54:18.089247 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f03fb3b-f795-49b6-8e9b-6d2f1b2924a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:54:18.090618 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f03fb3b-f795-49b6-8e9b-6d2f1b2924a1 admin admin] PATH_INFO: `/v3/users` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:54:18.090618 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f03fb3b-f795-49b6-8e9b-6d2f1b2924a1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:54:18.092157 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f03fb3b-f795-49b6-8e9b-6d2f1b2924a1 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:54:18.179465 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 902/1812] 10.222.0.65 () {60 vars in 1153 bytes} [Thu Oct 27 09:54:18 2022] POST /identity/v3/projects => generated 369 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 09:54:18.183722 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b492444-d6bf-4419-93a1-59bc6a4101a9 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:54:18.208972 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 911/1813] 10.222.0.65 () {60 vars in 1144 bytes} [Thu Oct 27 09:54:18 2022] POST /identity/v3/users => generated 299 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 09:54:18.214648 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f03fb3b-f795-49b6-8e9b-6d2f1b2924a1 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:54:18.225442 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f03fb3b-f795-49b6-8e9b-6d2f1b2924a1 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:54:18.261416 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b492444-d6bf-4419-93a1-59bc6a4101a9 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:54:18.266343 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134922e2-a7f3-4da5-acb9-53f7acd4a041 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:54:18.267049 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134922e2-a7f3-4da5-acb9-53f7acd4a041 admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:54:18.267388 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134922e2-a7f3-4da5-acb9-53f7acd4a041 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:54:18.267723 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134922e2-a7f3-4da5-acb9-53f7acd4a041 admin admin] PATH_INFO: `/v3/users` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:54:18.268414 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134922e2-a7f3-4da5-acb9-53f7acd4a041 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:54:18.270487 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134922e2-a7f3-4da5-acb9-53f7acd4a041 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:54:18.293865 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3dbe59-ef8c-4bcb-87e3-bb4d8cd9b7f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:54:18.294478 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3dbe59-ef8c-4bcb-87e3-bb4d8cd9b7f4 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:54:18.294804 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3dbe59-ef8c-4bcb-87e3-bb4d8cd9b7f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:54:18.295081 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3dbe59-ef8c-4bcb-87e3-bb4d8cd9b7f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:54:18.295769 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3dbe59-ef8c-4bcb-87e3-bb4d8cd9b7f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:54:18.297368 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3dbe59-ef8c-4bcb-87e3-bb4d8cd9b7f4 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:54:18.308228 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 912/1814] 10.222.0.65 () {58 vars in 1122 bytes} [Thu Oct 27 09:54:18 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 09:54:18.312856 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3dbe59-ef8c-4bcb-87e3-bb4d8cd9b7f4 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:54:18.327348 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3dbe59-ef8c-4bcb-87e3-bb4d8cd9b7f4 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:54:18.332677 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182af2f7-c92c-4ae2-b1b6-a7b082031b9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:54:18.333928 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182af2f7-c92c-4ae2-b1b6-a7b082031b9c admin admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:54:18.338436 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182af2f7-c92c-4ae2-b1b6-a7b082031b9c admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:54:18.338838 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182af2f7-c92c-4ae2-b1b6-a7b082031b9c admin admin] PATH_INFO: `/v3/projects/94aa3a43e67c445295360abf4f1e1243/users/7808d11e6a7542c6b76ef5e65b896df6/roles/6ad17b9f9dea4b66ab2da3677d7e715d` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:54:18.357027 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182af2f7-c92c-4ae2-b1b6-a7b082031b9c admin admin] RBAC: Authorizing `identity:create_grant(project_id=94aa3a43e67c445295360abf4f1e1243, user_id=7808d11e6a7542c6b76ef5e65b896df6, role_id=6ad17b9f9dea4b66ab2da3677d7e715d)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:54:18.359802 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182af2f7-c92c-4ae2-b1b6-a7b082031b9c admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:54:18.405610 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 903/1815] 10.222.0.65 () {60 vars in 1144 bytes} [Thu Oct 27 09:54:18 2022] POST /identity/v3/users => generated 285 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 09:54:18.410224 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134922e2-a7f3-4da5-acb9-53f7acd4a041 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:54:18.422803 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134922e2-a7f3-4da5-acb9-53f7acd4a041 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:54:18.429001 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7949bec9-aeea-4937-9f0e-4a376f363f91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:54:18.429713 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7949bec9-aeea-4937-9f0e-4a376f363f91 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:54:18.430242 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7949bec9-aeea-4937-9f0e-4a376f363f91 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:54:18.430723 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7949bec9-aeea-4937-9f0e-4a376f363f91 admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:54:18.431772 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7949bec9-aeea-4937-9f0e-4a376f363f91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:54:18.434919 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7949bec9-aeea-4937-9f0e-4a376f363f91 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:54:18.438996 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 913/1816] 10.222.0.65 () {60 vars in 1483 bytes} [Thu Oct 27 09:54:18 2022] PUT /identity/v3/projects/94aa3a43e67c445295360abf4f1e1243/users/7808d11e6a7542c6b76ef5e65b896df6/roles/6ad17b9f9dea4b66ab2da3677d7e715d => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 09:54:18.443223 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182af2f7-c92c-4ae2-b1b6-a7b082031b9c admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:54:18.447956 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 904/1817] 10.222.0.65 () {58 vars in 1122 bytes} [Thu Oct 27 09:54:18 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 09:54:18.451983 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7949bec9-aeea-4937-9f0e-4a376f363f91 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:54:18.463626 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7949bec9-aeea-4937-9f0e-4a376f363f91 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:54:18.518848 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182af2f7-c92c-4ae2-b1b6-a7b082031b9c admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:54:18.526277 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a535b1a-7960-48f8-904c-27ed2a60d8c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:54:18.527046 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a535b1a-7960-48f8-904c-27ed2a60d8c2 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:54:18.530806 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a535b1a-7960-48f8-904c-27ed2a60d8c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:54:18.530806 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a535b1a-7960-48f8-904c-27ed2a60d8c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:54:18.530806 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a535b1a-7960-48f8-904c-27ed2a60d8c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:54:18.531469 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a535b1a-7960-48f8-904c-27ed2a60d8c2 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:54:18.549208 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 914/1818] 10.222.0.65 () {58 vars in 1122 bytes} [Thu Oct 27 09:54:18 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 09:54:18.550329 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a535b1a-7960-48f8-904c-27ed2a60d8c2 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:54:18.553836 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3b0b67-744d-4f5a-81ab-4ef5effd71d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:54:18.553836 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3b0b67-744d-4f5a-81ab-4ef5effd71d4 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:54:18.553836 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3b0b67-744d-4f5a-81ab-4ef5effd71d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:54:18.553836 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3b0b67-744d-4f5a-81ab-4ef5effd71d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:54:18.554319 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3b0b67-744d-4f5a-81ab-4ef5effd71d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:54:18.556515 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3b0b67-744d-4f5a-81ab-4ef5effd71d4 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:54:18.561917 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a535b1a-7960-48f8-904c-27ed2a60d8c2 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:54:18.566873 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4080c46f-8d66-4390-b0b9-20ccf8b8a3f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:54:18.567545 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4080c46f-8d66-4390-b0b9-20ccf8b8a3f2 admin admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:54:18.567831 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4080c46f-8d66-4390-b0b9-20ccf8b8a3f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:54:18.569274 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4080c46f-8d66-4390-b0b9-20ccf8b8a3f2 admin admin] PATH_INFO: `/v3/projects/94aa3a43e67c445295360abf4f1e1243/users/7808d11e6a7542c6b76ef5e65b896df6/roles/6ad17b9f9dea4b66ab2da3677d7e715d` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:54:18.571187 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 905/1819] 10.222.0.65 () {58 vars in 1122 bytes} [Thu Oct 27 09:54:18 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 09:54:18.571421 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4080c46f-8d66-4390-b0b9-20ccf8b8a3f2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=94aa3a43e67c445295360abf4f1e1243, user_id=7808d11e6a7542c6b76ef5e65b896df6, role_id=6ad17b9f9dea4b66ab2da3677d7e715d)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:54:18.574342 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4080c46f-8d66-4390-b0b9-20ccf8b8a3f2 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:54:18.575306 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3b0b67-744d-4f5a-81ab-4ef5effd71d4 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:54:18.578337 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:54:18.587406 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 915/1820] 10.222.0.65 () {60 vars in 1483 bytes} [Thu Oct 27 09:54:18 2022] PUT /identity/v3/projects/94aa3a43e67c445295360abf4f1e1243/users/7808d11e6a7542c6b76ef5e65b896df6/roles/6ad17b9f9dea4b66ab2da3677d7e715d => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 09:54:18.589407 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3b0b67-744d-4f5a-81ab-4ef5effd71d4 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:54:18.604032 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39418636-1b2d-4cfa-8dcd-57a8c868d2a3 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:54:18.604302 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39418636-1b2d-4cfa-8dcd-57a8c868d2a3 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:54:18.604585 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39418636-1b2d-4cfa-8dcd-57a8c868d2a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:54:18.640141 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-39418636-1b2d-4cfa-8dcd-57a8c868d2a3 None None] MFA Rules not processed for user `7808d11e6a7542c6b76ef5e65b896df6`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:54:18.641629 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-39418636-1b2d-4cfa-8dcd-57a8c868d2a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:54:18.646810 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:54:18.658904 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353d1901-fd5e-4303-baad-1f16abc7a3cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:54:18.659860 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353d1901-fd5e-4303-baad-1f16abc7a3cc admin admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:54:18.660333 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353d1901-fd5e-4303-baad-1f16abc7a3cc admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:54:18.660986 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353d1901-fd5e-4303-baad-1f16abc7a3cc admin admin] PATH_INFO: `/v3/projects/09eabff0e5494e2f8af15f7b66908da7/users/0aa959ee7c3c46beaecca0ce0903bfe3/roles/43543ce1450245af9661cb017bac17bd` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:54:18.680583 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353d1901-fd5e-4303-baad-1f16abc7a3cc admin admin] RBAC: Authorizing `identity:create_grant(project_id=09eabff0e5494e2f8af15f7b66908da7, user_id=0aa959ee7c3c46beaecca0ce0903bfe3, role_id=43543ce1450245af9661cb017bac17bd)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:54:18.683611 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353d1901-fd5e-4303-baad-1f16abc7a3cc admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:54:18.720910 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 916/1821] 10.222.0.65 () {58 vars in 958 bytes} [Thu Oct 27 09:54:18 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 09:54:18.733853 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39418636-1b2d-4cfa-8dcd-57a8c868d2a3 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:54:18.735434 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-39418636-1b2d-4cfa-8dcd-57a8c868d2a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:54:18.785702 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 906/1822] 10.222.0.65 () {60 vars in 1483 bytes} [Thu Oct 27 09:54:18 2022] PUT /identity/v3/projects/09eabff0e5494e2f8af15f7b66908da7/users/0aa959ee7c3c46beaecca0ce0903bfe3/roles/43543ce1450245af9661cb017bac17bd => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 09:54:18.796539 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39418636-1b2d-4cfa-8dcd-57a8c868d2a3 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:54:18.797778 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0a735e-4f43-45ed-b699-99961e970338 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:54:18.798080 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0a735e-4f43-45ed-b699-99961e970338 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:54:18.798432 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0a735e-4f43-45ed-b699-99961e970338 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:54:18.828292 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-2d0a735e-4f43-45ed-b699-99961e970338 None None] MFA Rules not processed for user `0aa959ee7c3c46beaecca0ce0903bfe3`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:54:18.829536 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-2d0a735e-4f43-45ed-b699-99961e970338 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:54:18.848092 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee44d978-cd81-457c-ba0d-630470644cd7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8e5d5f04c4741bb86ca4a0f667d4ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc2e3a7a1bcc480891c0b433291c00b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:54:18.848820 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee44d978-cd81-457c-ba0d-630470644cd7 service cinder] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:54:18.849171 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee44d978-cd81-457c-ba0d-630470644cd7 service cinder] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:54:18.849513 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee44d978-cd81-457c-ba0d-630470644cd7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:54:18.852428 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-ee44d978-cd81-457c-ba0d-630470644cd7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:54:18.905296 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:54:18.906229 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 907/1823] 10.222.0.65 () {58 vars in 958 bytes} [Thu Oct 27 09:54:18 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 09:54:18.916896 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee44d978-cd81-457c-ba0d-630470644cd7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:54:18.918376 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0a735e-4f43-45ed-b699-99961e970338 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:54:18.918564 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee44d978-cd81-457c-ba0d-630470644cd7 service cinder] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:54:18.919777 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-2d0a735e-4f43-45ed-b699-99961e970338 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:54:18.934491 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 917/1824] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Oct 27 09:54:18 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 09:54:18.983575 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0a735e-4f43-45ed-b699-99961e970338 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:54:18.987400 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03db3c14-a03d-4fb6-b7d6-0f8c48b96cc2 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4b0886666584397be686ee02a505269', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc2e3a7a1bcc480891c0b433291c00b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:54:18.987960 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03db3c14-a03d-4fb6-b7d6-0f8c48b96cc2 service glance] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:54:18.988245 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03db3c14-a03d-4fb6-b7d6-0f8c48b96cc2 service glance] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:54:18.988524 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03db3c14-a03d-4fb6-b7d6-0f8c48b96cc2 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:54:18.998245 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03db3c14-a03d-4fb6-b7d6-0f8c48b96cc2 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:54:18.999782 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03db3c14-a03d-4fb6-b7d6-0f8c48b96cc2 service glance] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:54:19.009807 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 908/1825] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Oct 27 09:54:18 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 09:54:21.187178 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee44d978-cd81-457c-ba0d-630470644cd7 service cinder] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:54:21.188804 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-ee44d978-cd81-457c-ba0d-630470644cd7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:54:21.200154 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee44d978-cd81-457c-ba0d-630470644cd7 service cinder] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:54:21.203948 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4f6bc0-2d1d-462a-b0c8-076172ae67b1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8e5d5f04c4741bb86ca4a0f667d4ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc2e3a7a1bcc480891c0b433291c00b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:54:21.204550 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4f6bc0-2d1d-462a-b0c8-076172ae67b1 service cinder] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:54:21.204837 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4f6bc0-2d1d-462a-b0c8-076172ae67b1 service cinder] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:54:21.205115 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4f6bc0-2d1d-462a-b0c8-076172ae67b1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:54:21.206993 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-6e4f6bc0-2d1d-462a-b0c8-076172ae67b1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:54:21.280049 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4f6bc0-2d1d-462a-b0c8-076172ae67b1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:54:21.281490 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4f6bc0-2d1d-462a-b0c8-076172ae67b1 service cinder] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:54:21.291656 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 918/1826] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Oct 27 09:54:21 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 09:54:22.889340 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03db3c14-a03d-4fb6-b7d6-0f8c48b96cc2 service glance] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:54:22.899104 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03db3c14-a03d-4fb6-b7d6-0f8c48b96cc2 service glance] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:54:22.903144 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981921f7-eda3-4314-9d8f-d5fe1374fb60 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8e5d5f04c4741bb86ca4a0f667d4ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc2e3a7a1bcc480891c0b433291c00b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:54:22.903735 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981921f7-eda3-4314-9d8f-d5fe1374fb60 service cinder] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:54:22.904016 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981921f7-eda3-4314-9d8f-d5fe1374fb60 service cinder] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:54:22.904286 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981921f7-eda3-4314-9d8f-d5fe1374fb60 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:54:22.969490 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981921f7-eda3-4314-9d8f-d5fe1374fb60 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:54:22.970980 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981921f7-eda3-4314-9d8f-d5fe1374fb60 service cinder] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:54:22.983709 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 909/1827] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Oct 27 09:54:22 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 09:54:27.762495 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4f6bc0-2d1d-462a-b0c8-076172ae67b1 service cinder] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:54:27.834788 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4f6bc0-2d1d-462a-b0c8-076172ae67b1 service cinder] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:54:27.840151 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6261ebd-cb29-485b-bbae-660432e517b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:54:27.840877 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6261ebd-cb29-485b-bbae-660432e517b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:54:27.841227 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6261ebd-cb29-485b-bbae-660432e517b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:54:27.841571 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6261ebd-cb29-485b-bbae-660432e517b8 admin admin] PATH_INFO: `/v3/users/20cc370d9dbc4af19b9860ed47847ca3` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:54:27.846643 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6261ebd-cb29-485b-bbae-660432e517b8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=20cc370d9dbc4af19b9860ed47847ca3)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:54:27.848690 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6261ebd-cb29-485b-bbae-660432e517b8 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:54:28.046891 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-d6261ebd-cb29-485b-bbae-660432e517b8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '20cc370d9dbc4af19b9860ed47847ca3'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:54:28.063174 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-d6261ebd-cb29-485b-bbae-660432e517b8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '20cc370d9dbc4af19b9860ed47847ca3'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:54:28.063941 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-d6261ebd-cb29-485b-bbae-660432e517b8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '20cc370d9dbc4af19b9860ed47847ca3'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:54:28.072906 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-d6261ebd-cb29-485b-bbae-660432e517b8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '20cc370d9dbc4af19b9860ed47847ca3'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:54:28.156036 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-d6261ebd-cb29-485b-bbae-660432e517b8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '20cc370d9dbc4af19b9860ed47847ca3'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:54:28.163109 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 919/1828] 10.222.0.65 () {58 vars in 1224 bytes} [Thu Oct 27 09:54:27 2022] DELETE /identity/v3/users/20cc370d9dbc4af19b9860ed47847ca3 => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 09:54:28.167711 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c042df41-8311-449a-afc8-27d92b475ad3 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:54:28.168173 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c042df41-8311-449a-afc8-27d92b475ad3 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:54:28.168286 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c042df41-8311-449a-afc8-27d92b475ad3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:54:28.175974 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:54:28.189283 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-c042df41-8311-449a-afc8-27d92b475ad3 None None] MFA Rules not processed for user `b5065084bf664b99bdeac46067cb0f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:54:28.190691 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-c042df41-8311-449a-afc8-27d92b475ad3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:54:28.257885 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 910/1829] 10.222.0.65 () {58 vars in 958 bytes} [Thu Oct 27 09:54:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 09:54:28.270114 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6261ebd-cb29-485b-bbae-660432e517b8 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:54:28.272014 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-d6261ebd-cb29-485b-bbae-660432e517b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:54:28.285231 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:54:28.335537 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6261ebd-cb29-485b-bbae-660432e517b8 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:54:28.344352 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87656e89-6cb0-41a0-b541-87f933347152 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6191cc41efa74f46b49022cf387f7a4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc2e3a7a1bcc480891c0b433291c00b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:54:28.344981 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87656e89-6cb0-41a0-b541-87f933347152 service neutron] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:54:28.345326 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87656e89-6cb0-41a0-b541-87f933347152 service neutron] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:54:28.345606 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87656e89-6cb0-41a0-b541-87f933347152 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:54:28.357794 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87656e89-6cb0-41a0-b541-87f933347152 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:54:28.359545 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87656e89-6cb0-41a0-b541-87f933347152 service neutron] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:54:28.374084 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 920/1830] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Oct 27 09:54:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 09:54:28.829293 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c042df41-8311-449a-afc8-27d92b475ad3 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:54:28.831459 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-c042df41-8311-449a-afc8-27d92b475ad3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:54:28.855190 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c042df41-8311-449a-afc8-27d92b475ad3 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:54:28.861766 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7970ce07-2ff9-483c-8fe5-7326e7d05377 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:54:28.862454 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7970ce07-2ff9-483c-8fe5-7326e7d05377 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:54:28.862777 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7970ce07-2ff9-483c-8fe5-7326e7d05377 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:54:28.863057 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7970ce07-2ff9-483c-8fe5-7326e7d05377 admin admin] PATH_INFO: `/v3/projects/f81acc4ef6a746c2b3a3f82b817f00a4` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:54:28.864229 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7970ce07-2ff9-483c-8fe5-7326e7d05377 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f81acc4ef6a746c2b3a3f82b817f00a4)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:54:28.866954 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7970ce07-2ff9-483c-8fe5-7326e7d05377 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:54:28.984576 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-7970ce07-2ff9-483c-8fe5-7326e7d05377 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f81acc4ef6a746c2b3a3f82b817f00a4', 'request_id': 'req-7970ce07-2ff9-483c-8fe5-7326e7d05377'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:54:28.991634 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-7970ce07-2ff9-483c-8fe5-7326e7d05377 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f81acc4ef6a746c2b3a3f82b817f00a4', 'request_id': 'req-7970ce07-2ff9-483c-8fe5-7326e7d05377'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:54:29.056071 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-7970ce07-2ff9-483c-8fe5-7326e7d05377 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f81acc4ef6a746c2b3a3f82b817f00a4', 'request_id': 'req-7970ce07-2ff9-483c-8fe5-7326e7d05377'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:54:29.069700 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-7970ce07-2ff9-483c-8fe5-7326e7d05377 admin admin] The token cache is being invalidate because project f81acc4ef6a746c2b3a3f82b817f00a4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 09:54:29.069909 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-7970ce07-2ff9-483c-8fe5-7326e7d05377 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:54:29.070684 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-7970ce07-2ff9-483c-8fe5-7326e7d05377 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:54:29.072567 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 911/1831] 10.222.0.65 () {58 vars in 1233 bytes} [Thu Oct 27 09:54:28 2022] DELETE /identity/v3/projects/f81acc4ef6a746c2b3a3f82b817f00a4 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 09:54:29.076214 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87656e89-6cb0-41a0-b541-87f933347152 service neutron] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:54:29.087623 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87656e89-6cb0-41a0-b541-87f933347152 service neutron] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:54:29.156652 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41cfe73-d9ba-4ecf-88b2-8c5bbdbe72df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:54:29.158853 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41cfe73-d9ba-4ecf-88b2-8c5bbdbe72df admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:54:29.158853 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41cfe73-d9ba-4ecf-88b2-8c5bbdbe72df admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:54:29.158853 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41cfe73-d9ba-4ecf-88b2-8c5bbdbe72df admin admin] PATH_INFO: `/v3/users/b83bd123fcf645a2b5571d3220ea659b` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:54:29.159135 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41cfe73-d9ba-4ecf-88b2-8c5bbdbe72df admin admin] RBAC: Authorizing `identity:delete_user(user_id=b83bd123fcf645a2b5571d3220ea659b)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:54:29.161145 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41cfe73-d9ba-4ecf-88b2-8c5bbdbe72df admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:54:29.367501 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-a41cfe73-d9ba-4ecf-88b2-8c5bbdbe72df admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b83bd123fcf645a2b5571d3220ea659b'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:54:29.380430 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-a41cfe73-d9ba-4ecf-88b2-8c5bbdbe72df admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b83bd123fcf645a2b5571d3220ea659b'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:54:29.381334 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-a41cfe73-d9ba-4ecf-88b2-8c5bbdbe72df admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b83bd123fcf645a2b5571d3220ea659b'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:54:29.388609 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-a41cfe73-d9ba-4ecf-88b2-8c5bbdbe72df admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b83bd123fcf645a2b5571d3220ea659b'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:54:29.521996 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-a41cfe73-d9ba-4ecf-88b2-8c5bbdbe72df admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b83bd123fcf645a2b5571d3220ea659b'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:54:29.529087 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 921/1832] 10.222.0.65 () {58 vars in 1224 bytes} [Thu Oct 27 09:54:29 2022] DELETE /identity/v3/users/b83bd123fcf645a2b5571d3220ea659b => generated 0 bytes in 453 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 09:54:30.117679 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7970ce07-2ff9-483c-8fe5-7326e7d05377 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:54:30.117679 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-7970ce07-2ff9-483c-8fe5-7326e7d05377 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:54:30.140855 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7970ce07-2ff9-483c-8fe5-7326e7d05377 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:54:30.199705 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed4175b-836c-4017-881b-5035ffb26ced admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:54:30.200889 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed4175b-836c-4017-881b-5035ffb26ced admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:54:30.201174 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed4175b-836c-4017-881b-5035ffb26ced admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:54:30.201477 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed4175b-836c-4017-881b-5035ffb26ced admin admin] PATH_INFO: `/v3/projects/50cb184e7a3343ba88adc30704bfc9fb` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:54:30.202682 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed4175b-836c-4017-881b-5035ffb26ced admin admin] RBAC: Authorizing `identity:delete_project(project_id=50cb184e7a3343ba88adc30704bfc9fb)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:54:30.204616 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed4175b-836c-4017-881b-5035ffb26ced admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:54:30.314241 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:54:30.333567 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-eed4175b-836c-4017-881b-5035ffb26ced admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '50cb184e7a3343ba88adc30704bfc9fb', 'request_id': 'req-eed4175b-836c-4017-881b-5035ffb26ced'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:54:30.341593 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-eed4175b-836c-4017-881b-5035ffb26ced admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '50cb184e7a3343ba88adc30704bfc9fb', 'request_id': 'req-eed4175b-836c-4017-881b-5035ffb26ced'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:54:30.424474 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-eed4175b-836c-4017-881b-5035ffb26ced admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '50cb184e7a3343ba88adc30704bfc9fb', 'request_id': 'req-eed4175b-836c-4017-881b-5035ffb26ced'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:54:30.442827 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-eed4175b-836c-4017-881b-5035ffb26ced admin admin] The token cache is being invalidate because project 50cb184e7a3343ba88adc30704bfc9fb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 09:54:30.442827 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-eed4175b-836c-4017-881b-5035ffb26ced admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:54:30.442827 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-eed4175b-836c-4017-881b-5035ffb26ced admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:54:30.442827 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 912/1833] 10.222.0.65 () {58 vars in 1233 bytes} [Thu Oct 27 09:54:30 2022] DELETE /identity/v3/projects/50cb184e7a3343ba88adc30704bfc9fb => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 09:54:30.444151 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41cfe73-d9ba-4ecf-88b2-8c5bbdbe72df admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:54:30.445569 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-a41cfe73-d9ba-4ecf-88b2-8c5bbdbe72df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:54:30.458491 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41cfe73-d9ba-4ecf-88b2-8c5bbdbe72df admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:54:30.490430 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:54:30.521730 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7f1001-8cda-4980-bf94-49f1e6a709d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:54:30.521730 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7f1001-8cda-4980-bf94-49f1e6a709d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:54:30.521730 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7f1001-8cda-4980-bf94-49f1e6a709d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:54:30.521730 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7f1001-8cda-4980-bf94-49f1e6a709d0 admin admin] PATH_INFO: `/v3/users/7808d11e6a7542c6b76ef5e65b896df6` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:54:30.522070 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7f1001-8cda-4980-bf94-49f1e6a709d0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7808d11e6a7542c6b76ef5e65b896df6)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:54:30.523039 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7f1001-8cda-4980-bf94-49f1e6a709d0 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:54:30.745459 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-9e7f1001-8cda-4980-bf94-49f1e6a709d0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7808d11e6a7542c6b76ef5e65b896df6'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:54:30.765322 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-9e7f1001-8cda-4980-bf94-49f1e6a709d0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7808d11e6a7542c6b76ef5e65b896df6'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:54:30.766052 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-9e7f1001-8cda-4980-bf94-49f1e6a709d0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7808d11e6a7542c6b76ef5e65b896df6'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:54:30.774321 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-9e7f1001-8cda-4980-bf94-49f1e6a709d0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7808d11e6a7542c6b76ef5e65b896df6'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:54:30.834023 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-9e7f1001-8cda-4980-bf94-49f1e6a709d0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7808d11e6a7542c6b76ef5e65b896df6'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:54:30.840902 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 922/1834] 10.222.0.65 () {58 vars in 1224 bytes} [Thu Oct 27 09:54:30 2022] DELETE /identity/v3/users/7808d11e6a7542c6b76ef5e65b896df6 => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 09:54:31.321958 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed4175b-836c-4017-881b-5035ffb26ced admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:54:31.323690 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-eed4175b-836c-4017-881b-5035ffb26ced admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:54:31.340877 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed4175b-836c-4017-881b-5035ffb26ced admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:54:31.405086 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc434cd8-68ce-43c5-ba38-1d2c71b2c464 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:54:31.405844 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc434cd8-68ce-43c5-ba38-1d2c71b2c464 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:54:31.406177 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc434cd8-68ce-43c5-ba38-1d2c71b2c464 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:54:31.406562 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc434cd8-68ce-43c5-ba38-1d2c71b2c464 admin admin] PATH_INFO: `/v3/projects/94aa3a43e67c445295360abf4f1e1243` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:54:31.407722 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc434cd8-68ce-43c5-ba38-1d2c71b2c464 admin admin] RBAC: Authorizing `identity:delete_project(project_id=94aa3a43e67c445295360abf4f1e1243)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:54:31.410014 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc434cd8-68ce-43c5-ba38-1d2c71b2c464 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:54:31.539357 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-dc434cd8-68ce-43c5-ba38-1d2c71b2c464 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '94aa3a43e67c445295360abf4f1e1243', 'request_id': 'req-dc434cd8-68ce-43c5-ba38-1d2c71b2c464'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:54:31.548849 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-dc434cd8-68ce-43c5-ba38-1d2c71b2c464 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '94aa3a43e67c445295360abf4f1e1243', 'request_id': 'req-dc434cd8-68ce-43c5-ba38-1d2c71b2c464'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:54:31.610469 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-dc434cd8-68ce-43c5-ba38-1d2c71b2c464 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '94aa3a43e67c445295360abf4f1e1243', 'request_id': 'req-dc434cd8-68ce-43c5-ba38-1d2c71b2c464'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:54:31.635245 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-dc434cd8-68ce-43c5-ba38-1d2c71b2c464 admin admin] The token cache is being invalidate because project 94aa3a43e67c445295360abf4f1e1243 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 09:54:31.635543 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-dc434cd8-68ce-43c5-ba38-1d2c71b2c464 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:54:31.636209 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-dc434cd8-68ce-43c5-ba38-1d2c71b2c464 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:54:31.637764 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 913/1835] 10.222.0.65 () {58 vars in 1233 bytes} [Thu Oct 27 09:54:31 2022] DELETE /identity/v3/projects/94aa3a43e67c445295360abf4f1e1243 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 09:54:31.642727 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31bc875-94c7-461a-bbf2-31115c726292 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:54:31.643200 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31bc875-94c7-461a-bbf2-31115c726292 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:54:31.643307 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31bc875-94c7-461a-bbf2-31115c726292 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:54:31.665518 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-a31bc875-94c7-461a-bbf2-31115c726292 None None] MFA Rules not processed for user `b5065084bf664b99bdeac46067cb0f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:54:31.666932 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-a31bc875-94c7-461a-bbf2-31115c726292 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:54:31.729326 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 923/1836] 10.222.0.65 () {58 vars in 958 bytes} [Thu Oct 27 09:54:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 09:54:31.737883 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20312586-dce6-4d46-91aa-e615e1f43a2c None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:54:31.738170 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20312586-dce6-4d46-91aa-e615e1f43a2c None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:54:31.738629 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20312586-dce6-4d46-91aa-e615e1f43a2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:54:31.760633 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-20312586-dce6-4d46-91aa-e615e1f43a2c None None] MFA Rules not processed for user `b5065084bf664b99bdeac46067cb0f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:54:31.761868 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-20312586-dce6-4d46-91aa-e615e1f43a2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:54:31.770054 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 914/1837] 10.222.0.65 () {58 vars in 958 bytes} [Thu Oct 27 09:54:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 09:54:31.774698 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31bc875-94c7-461a-bbf2-31115c726292 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:54:31.785436 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31bc875-94c7-461a-bbf2-31115c726292 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:54:31.790715 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3504ea93-9561-418b-93a8-c9f3500afe07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:54:31.791348 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3504ea93-9561-418b-93a8-c9f3500afe07 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:54:31.791633 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3504ea93-9561-418b-93a8-c9f3500afe07 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:54:31.791911 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3504ea93-9561-418b-93a8-c9f3500afe07 admin admin] PATH_INFO: `/v3/domains` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:54:31.792564 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3504ea93-9561-418b-93a8-c9f3500afe07 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 09:54:31.792870 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3504ea93-9561-418b-93a8-c9f3500afe07 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:54:31.794510 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3504ea93-9561-418b-93a8-c9f3500afe07 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:54:31.807787 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 924/1838] 10.222.0.65 () {58 vars in 1153 bytes} [Thu Oct 27 09:54:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 09:54:31.812205 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20312586-dce6-4d46-91aa-e615e1f43a2c None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:54:31.822319 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20312586-dce6-4d46-91aa-e615e1f43a2c None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:54:31.827313 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f472f4e9-8bf2-48a5-87ce-9a45a3b4608c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:54:31.827866 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f472f4e9-8bf2-48a5-87ce-9a45a3b4608c admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:54:31.828145 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f472f4e9-8bf2-48a5-87ce-9a45a3b4608c admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:54:31.828416 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f472f4e9-8bf2-48a5-87ce-9a45a3b4608c admin admin] PATH_INFO: `/v3/projects` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:54:31.829109 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f472f4e9-8bf2-48a5-87ce-9a45a3b4608c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:54:31.831167 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f472f4e9-8bf2-48a5-87ce-9a45a3b4608c admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:54:31.918562 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 915/1839] 10.222.0.65 () {60 vars in 1153 bytes} [Thu Oct 27 09:54:31 2022] POST /identity/v3/projects => generated 371 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 09:54:31.922432 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3504ea93-9561-418b-93a8-c9f3500afe07 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:54:31.934752 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3504ea93-9561-418b-93a8-c9f3500afe07 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:54:31.970320 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:54:31.996141 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33dae8e8-6dfd-494a-a4b2-dade0fc842b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:54:31.996787 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dae8e8-6dfd-494a-a4b2-dade0fc842b5 admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:54:31.997073 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dae8e8-6dfd-494a-a4b2-dade0fc842b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:54:31.997351 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dae8e8-6dfd-494a-a4b2-dade0fc842b5 admin admin] PATH_INFO: `/v3/users` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:54:31.997983 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33dae8e8-6dfd-494a-a4b2-dade0fc842b5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:54:31.999950 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33dae8e8-6dfd-494a-a4b2-dade0fc842b5 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:54:32.127708 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 925/1840] 10.222.0.65 () {60 vars in 1144 bytes} [Thu Oct 27 09:54:31 2022] POST /identity/v3/users => generated 286 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 09:54:32.131873 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f472f4e9-8bf2-48a5-87ce-9a45a3b4608c admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:54:32.142064 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f472f4e9-8bf2-48a5-87ce-9a45a3b4608c admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:54:32.146690 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b28ef72-c181-4728-8935-7809ad8308fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:54:32.147281 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b28ef72-c181-4728-8935-7809ad8308fa admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:54:32.147562 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b28ef72-c181-4728-8935-7809ad8308fa admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:54:32.147835 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b28ef72-c181-4728-8935-7809ad8308fa admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:54:32.148467 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b28ef72-c181-4728-8935-7809ad8308fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:54:32.150493 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b28ef72-c181-4728-8935-7809ad8308fa admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:54:32.160224 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 916/1841] 10.222.0.65 () {58 vars in 1122 bytes} [Thu Oct 27 09:54:32 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 09:54:32.165241 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33dae8e8-6dfd-494a-a4b2-dade0fc842b5 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:54:32.176525 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33dae8e8-6dfd-494a-a4b2-dade0fc842b5 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:54:32.182835 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0860cb6a-47b7-4496-a82e-3a92802ab916 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:54:32.183496 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0860cb6a-47b7-4496-a82e-3a92802ab916 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:54:32.183806 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0860cb6a-47b7-4496-a82e-3a92802ab916 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:54:32.184070 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0860cb6a-47b7-4496-a82e-3a92802ab916 admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:54:32.185002 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0860cb6a-47b7-4496-a82e-3a92802ab916 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:54:32.186666 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0860cb6a-47b7-4496-a82e-3a92802ab916 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:54:32.197948 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 926/1842] 10.222.0.65 () {58 vars in 1122 bytes} [Thu Oct 27 09:54:32 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 09:54:32.202306 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b28ef72-c181-4728-8935-7809ad8308fa admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:54:32.212991 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b28ef72-c181-4728-8935-7809ad8308fa admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:54:32.218104 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2efae4-1242-4ae1-9fb6-01c740af2114 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:54:32.218799 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2efae4-1242-4ae1-9fb6-01c740af2114 admin admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:54:32.219077 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2efae4-1242-4ae1-9fb6-01c740af2114 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:54:32.219348 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2efae4-1242-4ae1-9fb6-01c740af2114 admin admin] PATH_INFO: `/v3/projects/5849d94c8cd44c0f8f3cb12ba2f6bee5/users/c2d74550d0234a33a93993ca68197751/roles/43543ce1450245af9661cb017bac17bd` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:54:32.229053 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:54:32.235772 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2efae4-1242-4ae1-9fb6-01c740af2114 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5849d94c8cd44c0f8f3cb12ba2f6bee5, user_id=c2d74550d0234a33a93993ca68197751, role_id=43543ce1450245af9661cb017bac17bd)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:54:32.238455 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2efae4-1242-4ae1-9fb6-01c740af2114 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:54:32.338546 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 917/1843] 10.222.0.65 () {60 vars in 1483 bytes} [Thu Oct 27 09:54:32 2022] PUT /identity/v3/projects/5849d94c8cd44c0f8f3cb12ba2f6bee5/users/c2d74550d0234a33a93993ca68197751/roles/43543ce1450245af9661cb017bac17bd => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 09:54:32.343853 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5960fceb-cfc6-44b9-95dc-5b77f915d65d None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:54:32.345972 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5960fceb-cfc6-44b9-95dc-5b77f915d65d None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:54:32.345972 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5960fceb-cfc6-44b9-95dc-5b77f915d65d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:54:32.365075 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-5960fceb-cfc6-44b9-95dc-5b77f915d65d None None] MFA Rules not processed for user `b5065084bf664b99bdeac46067cb0f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:54:32.366303 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-5960fceb-cfc6-44b9-95dc-5b77f915d65d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:54:32.433636 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 927/1844] 10.222.0.65 () {58 vars in 958 bytes} [Thu Oct 27 09:54:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 09:54:32.444192 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2efae4-1242-4ae1-9fb6-01c740af2114 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:54:32.445925 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-0a2efae4-1242-4ae1-9fb6-01c740af2114 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:54:32.503265 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2efae4-1242-4ae1-9fb6-01c740af2114 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:54:32.508250 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cf4bfc-5eb8-476e-89da-c3444e7bfc41 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6191cc41efa74f46b49022cf387f7a4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc2e3a7a1bcc480891c0b433291c00b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:54:32.508885 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cf4bfc-5eb8-476e-89da-c3444e7bfc41 service neutron] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:54:32.509174 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cf4bfc-5eb8-476e-89da-c3444e7bfc41 service neutron] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:54:32.509479 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cf4bfc-5eb8-476e-89da-c3444e7bfc41 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:54:32.519375 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0cf4bfc-5eb8-476e-89da-c3444e7bfc41 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:54:32.520921 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0cf4bfc-5eb8-476e-89da-c3444e7bfc41 service neutron] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:54:32.530936 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 918/1845] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Oct 27 09:54:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 09:54:33.935421 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4914c61-b04f-4494-b60b-6bf4744baf2f None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:54:33.935972 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4914c61-b04f-4494-b60b-6bf4744baf2f None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:54:33.935972 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4914c61-b04f-4494-b60b-6bf4744baf2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:54:33.980299 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-b4914c61-b04f-4494-b60b-6bf4744baf2f None None] MFA Rules not processed for user `c2d74550d0234a33a93993ca68197751`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:54:33.981650 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-b4914c61-b04f-4494-b60b-6bf4744baf2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:54:34.070399 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 928/1846] 10.222.0.65 () {58 vars in 958 bytes} [Thu Oct 27 09:54:33 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 09:54:34.080979 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cf4bfc-5eb8-476e-89da-c3444e7bfc41 service neutron] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:54:34.082431 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-c0cf4bfc-5eb8-476e-89da-c3444e7bfc41 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:54:34.141514 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cf4bfc-5eb8-476e-89da-c3444e7bfc41 service neutron] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:54:34.145120 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3600b109-b661-41b5-b658-b679f6ed2dc6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8e5d5f04c4741bb86ca4a0f667d4ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc2e3a7a1bcc480891c0b433291c00b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:54:34.145756 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3600b109-b661-41b5-b658-b679f6ed2dc6 service cinder] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:54:34.146037 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3600b109-b661-41b5-b658-b679f6ed2dc6 service cinder] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:54:34.146821 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3600b109-b661-41b5-b658-b679f6ed2dc6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:54:34.156957 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3600b109-b661-41b5-b658-b679f6ed2dc6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:54:34.158472 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3600b109-b661-41b5-b658-b679f6ed2dc6 service cinder] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:54:34.168884 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 919/1847] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Oct 27 09:54:34 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 09:54:37.038927 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d11fcee-2ff2-4611-bafb-a383bcf8cab0 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:54:37.039518 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d11fcee-2ff2-4611-bafb-a383bcf8cab0 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:54:37.039518 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d11fcee-2ff2-4611-bafb-a383bcf8cab0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:54:37.060999 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-0d11fcee-2ff2-4611-bafb-a383bcf8cab0 None None] MFA Rules not processed for user `c2d74550d0234a33a93993ca68197751`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:54:37.061970 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-0d11fcee-2ff2-4611-bafb-a383bcf8cab0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:54:37.069880 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 929/1848] 10.222.0.65 () {58 vars in 958 bytes} [Thu Oct 27 09:54:37 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 09:54:44.164359 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=59,keystone:INSERT=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:54:47.054752 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=79,keystone:INSERT=3 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:54:50.755050 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed97e19b-faac-4ea5-8e51-2ad6000d247b None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:54:50.755597 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed97e19b-faac-4ea5-8e51-2ad6000d247b None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:54:50.755861 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed97e19b-faac-4ea5-8e51-2ad6000d247b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:54:50.776765 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-ed97e19b-faac-4ea5-8e51-2ad6000d247b None None] MFA Rules not processed for user `94fd43de1d8343d18e229b6e9429ce66`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:54:50.777975 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-ed97e19b-faac-4ea5-8e51-2ad6000d247b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:54:50.834588 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 920/1849] 10.222.0.65 () {58 vars in 958 bytes} [Thu Oct 27 09:54:50 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 09:55:00.827506 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=25 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:55:02.332521 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d11fcee-2ff2-4611-bafb-a383bcf8cab0 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:55:02.334373 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-0d11fcee-2ff2-4611-bafb-a383bcf8cab0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:55:02.349829 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d11fcee-2ff2-4611-bafb-a383bcf8cab0 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:55:02.354330 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03462a24-e5e5-4f92-adf8-084f76e3e9f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:55:02.354974 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03462a24-e5e5-4f92-adf8-084f76e3e9f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:55:02.355257 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03462a24-e5e5-4f92-adf8-084f76e3e9f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:55:02.355536 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03462a24-e5e5-4f92-adf8-084f76e3e9f2 admin admin] PATH_INFO: `/v3/users/547835331d644f8da5621a6566dcc5dc` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:55:02.357565 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03462a24-e5e5-4f92-adf8-084f76e3e9f2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=547835331d644f8da5621a6566dcc5dc)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:55:02.359535 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03462a24-e5e5-4f92-adf8-084f76e3e9f2 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:55:02.599434 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-03462a24-e5e5-4f92-adf8-084f76e3e9f2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '547835331d644f8da5621a6566dcc5dc'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:55:02.613228 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-03462a24-e5e5-4f92-adf8-084f76e3e9f2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '547835331d644f8da5621a6566dcc5dc'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:55:02.614213 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-03462a24-e5e5-4f92-adf8-084f76e3e9f2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '547835331d644f8da5621a6566dcc5dc'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:55:02.622396 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-03462a24-e5e5-4f92-adf8-084f76e3e9f2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '547835331d644f8da5621a6566dcc5dc'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:55:02.703948 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-03462a24-e5e5-4f92-adf8-084f76e3e9f2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '547835331d644f8da5621a6566dcc5dc'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:55:02.714113 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 930/1850] 10.222.0.65 () {58 vars in 1224 bytes} [Thu Oct 27 09:55:02 2022] DELETE /identity/v3/users/547835331d644f8da5621a6566dcc5dc => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 09:55:02.717031 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad286721-aa88-442a-884d-82276d880288 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:55:02.717843 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad286721-aa88-442a-884d-82276d880288 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:55:02.718183 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad286721-aa88-442a-884d-82276d880288 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:55:02.740155 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-ad286721-aa88-442a-884d-82276d880288 None None] MFA Rules not processed for user `b5065084bf664b99bdeac46067cb0f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:55:02.746783 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-ad286721-aa88-442a-884d-82276d880288 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:55:02.808715 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 921/1851] 10.222.0.65 () {58 vars in 958 bytes} [Thu Oct 27 09:55:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 09:55:02.819289 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03462a24-e5e5-4f92-adf8-084f76e3e9f2 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:55:02.820941 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-03462a24-e5e5-4f92-adf8-084f76e3e9f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:55:02.895036 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03462a24-e5e5-4f92-adf8-084f76e3e9f2 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:55:02.898893 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb1b0cb-8103-4b67-a2d9-47dd3798c946 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6191cc41efa74f46b49022cf387f7a4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc2e3a7a1bcc480891c0b433291c00b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:55:02.899793 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb1b0cb-8103-4b67-a2d9-47dd3798c946 service neutron] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:55:02.900138 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb1b0cb-8103-4b67-a2d9-47dd3798c946 service neutron] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:55:02.900417 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb1b0cb-8103-4b67-a2d9-47dd3798c946 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:55:02.910795 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb1b0cb-8103-4b67-a2d9-47dd3798c946 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:55:02.912704 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb1b0cb-8103-4b67-a2d9-47dd3798c946 service neutron] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:55:02.924006 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 931/1852] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Oct 27 09:55:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 09:55:03.309323 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad286721-aa88-442a-884d-82276d880288 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:55:03.310802 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-ad286721-aa88-442a-884d-82276d880288 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:55:03.327430 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad286721-aa88-442a-884d-82276d880288 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:55:03.332421 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d3a0b5-a168-4189-bf91-9883d39d478d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:55:03.333206 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d3a0b5-a168-4189-bf91-9883d39d478d admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:55:03.333522 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d3a0b5-a168-4189-bf91-9883d39d478d admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:55:03.333805 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d3a0b5-a168-4189-bf91-9883d39d478d admin admin] PATH_INFO: `/v3/users/0aa959ee7c3c46beaecca0ce0903bfe3` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:55:03.335185 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d3a0b5-a168-4189-bf91-9883d39d478d admin admin] RBAC: Authorizing `identity:delete_user(user_id=0aa959ee7c3c46beaecca0ce0903bfe3)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:55:03.337308 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d3a0b5-a168-4189-bf91-9883d39d478d admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:55:03.563652 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb1b0cb-8103-4b67-a2d9-47dd3798c946 service neutron] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:55:03.565078 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-abb1b0cb-8103-4b67-a2d9-47dd3798c946 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:55:03.573328 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-d8d3a0b5-a168-4189-bf91-9883d39d478d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0aa959ee7c3c46beaecca0ce0903bfe3'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:55:03.574451 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-d8d3a0b5-a168-4189-bf91-9883d39d478d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0aa959ee7c3c46beaecca0ce0903bfe3'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:55:03.589013 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb1b0cb-8103-4b67-a2d9-47dd3798c946 service neutron] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:55:03.592339 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-d8d3a0b5-a168-4189-bf91-9883d39d478d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0aa959ee7c3c46beaecca0ce0903bfe3'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:55:03.593518 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-d8d3a0b5-a168-4189-bf91-9883d39d478d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0aa959ee7c3c46beaecca0ce0903bfe3'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:55:03.597850 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f49c16c-57bd-4b5f-be49-efa8f280eb97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:55:03.598511 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f49c16c-57bd-4b5f-be49-efa8f280eb97 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:55:03.598827 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f49c16c-57bd-4b5f-be49-efa8f280eb97 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:55:03.599108 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f49c16c-57bd-4b5f-be49-efa8f280eb97 admin admin] PATH_INFO: `/v3/projects/e41cebbf5a204b608912ad5ed301a146` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:55:03.600288 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f49c16c-57bd-4b5f-be49-efa8f280eb97 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e41cebbf5a204b608912ad5ed301a146)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:55:03.603204 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f49c16c-57bd-4b5f-be49-efa8f280eb97 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:55:03.612314 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-d8d3a0b5-a168-4189-bf91-9883d39d478d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0aa959ee7c3c46beaecca0ce0903bfe3'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:55:03.708358 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 922/1853] 10.222.0.65 () {58 vars in 1224 bytes} [Thu Oct 27 09:55:03 2022] DELETE /identity/v3/users/0aa959ee7c3c46beaecca0ce0903bfe3 => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 09:55:03.712985 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326d944a-1784-4ffe-b022-6b8f4520d2df None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:55:03.713272 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326d944a-1784-4ffe-b022-6b8f4520d2df None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:55:03.713552 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326d944a-1784-4ffe-b022-6b8f4520d2df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:55:03.733409 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-326d944a-1784-4ffe-b022-6b8f4520d2df None None] MFA Rules not processed for user `b5065084bf664b99bdeac46067cb0f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:55:03.735405 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-326d944a-1784-4ffe-b022-6b8f4520d2df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:55:03.780273 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-7f49c16c-57bd-4b5f-be49-efa8f280eb97 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e41cebbf5a204b608912ad5ed301a146', 'request_id': 'req-7f49c16c-57bd-4b5f-be49-efa8f280eb97'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:55:03.815966 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 923/1854] 10.222.0.65 () {58 vars in 958 bytes} [Thu Oct 27 09:55:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 09:55:03.823659 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326d944a-1784-4ffe-b022-6b8f4520d2df None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:55:03.824355 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-326d944a-1784-4ffe-b022-6b8f4520d2df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:55:03.839737 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:55:03.897981 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326d944a-1784-4ffe-b022-6b8f4520d2df None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:55:03.910625 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-7f49c16c-57bd-4b5f-be49-efa8f280eb97 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e41cebbf5a204b608912ad5ed301a146', 'request_id': 'req-7f49c16c-57bd-4b5f-be49-efa8f280eb97'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:55:03.924197 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-7f49c16c-57bd-4b5f-be49-efa8f280eb97 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e41cebbf5a204b608912ad5ed301a146', 'request_id': 'req-7f49c16c-57bd-4b5f-be49-efa8f280eb97'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:55:03.931731 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:55:03.938423 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-7f49c16c-57bd-4b5f-be49-efa8f280eb97 admin admin] The token cache is being invalidate because project e41cebbf5a204b608912ad5ed301a146 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 09:55:03.939227 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-7f49c16c-57bd-4b5f-be49-efa8f280eb97 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:55:03.940193 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-7f49c16c-57bd-4b5f-be49-efa8f280eb97 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:55:03.942480 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 932/1855] 10.222.0.65 () {58 vars in 1233 bytes} [Thu Oct 27 09:55:03 2022] DELETE /identity/v3/projects/e41cebbf5a204b608912ad5ed301a146 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 09:55:03.967534 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f10982-7be1-4254-a883-5b6a0c9ff0eb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6191cc41efa74f46b49022cf387f7a4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc2e3a7a1bcc480891c0b433291c00b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:55:03.968429 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f10982-7be1-4254-a883-5b6a0c9ff0eb service neutron] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:55:03.968697 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f10982-7be1-4254-a883-5b6a0c9ff0eb service neutron] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:55:03.968974 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f10982-7be1-4254-a883-5b6a0c9ff0eb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:55:03.970981 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-23f10982-7be1-4254-a883-5b6a0c9ff0eb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:55:04.095135 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f10982-7be1-4254-a883-5b6a0c9ff0eb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:55:04.096655 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f10982-7be1-4254-a883-5b6a0c9ff0eb service neutron] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:55:04.108810 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 924/1856] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Oct 27 09:55:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 286 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 09:55:04.664804 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f49c16c-57bd-4b5f-be49-efa8f280eb97 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:55:04.664804 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-7f49c16c-57bd-4b5f-be49-efa8f280eb97 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:55:04.679219 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f49c16c-57bd-4b5f-be49-efa8f280eb97 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:55:04.684041 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a84fa1c-0351-46f3-ad04-54f103b22982 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:55:04.684920 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a84fa1c-0351-46f3-ad04-54f103b22982 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:55:04.685205 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a84fa1c-0351-46f3-ad04-54f103b22982 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:55:04.685709 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a84fa1c-0351-46f3-ad04-54f103b22982 admin admin] PATH_INFO: `/v3/projects/09eabff0e5494e2f8af15f7b66908da7` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:55:04.687266 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a84fa1c-0351-46f3-ad04-54f103b22982 admin admin] RBAC: Authorizing `identity:delete_project(project_id=09eabff0e5494e2f8af15f7b66908da7)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:55:04.689402 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a84fa1c-0351-46f3-ad04-54f103b22982 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:55:04.880525 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-8a84fa1c-0351-46f3-ad04-54f103b22982 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '09eabff0e5494e2f8af15f7b66908da7', 'request_id': 'req-8a84fa1c-0351-46f3-ad04-54f103b22982'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:55:05.002205 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-8a84fa1c-0351-46f3-ad04-54f103b22982 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '09eabff0e5494e2f8af15f7b66908da7', 'request_id': 'req-8a84fa1c-0351-46f3-ad04-54f103b22982'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:55:05.008342 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-8a84fa1c-0351-46f3-ad04-54f103b22982 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '09eabff0e5494e2f8af15f7b66908da7', 'request_id': 'req-8a84fa1c-0351-46f3-ad04-54f103b22982'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:55:05.021125 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-8a84fa1c-0351-46f3-ad04-54f103b22982 admin admin] The token cache is being invalidate because project 09eabff0e5494e2f8af15f7b66908da7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 09:55:05.021418 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-8a84fa1c-0351-46f3-ad04-54f103b22982 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:55:05.022094 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-8a84fa1c-0351-46f3-ad04-54f103b22982 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:55:05.023631 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 933/1857] 10.222.0.65 () {58 vars in 1233 bytes} [Thu Oct 27 09:55:04 2022] DELETE /identity/v3/projects/09eabff0e5494e2f8af15f7b66908da7 => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 09:55:05.029011 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfabb633-264d-45aa-b9ae-f87e26781945 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:55:05.030207 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfabb633-264d-45aa-b9ae-f87e26781945 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:55:05.030207 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfabb633-264d-45aa-b9ae-f87e26781945 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:55:05.059051 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-bfabb633-264d-45aa-b9ae-f87e26781945 None None] MFA Rules not processed for user `b5065084bf664b99bdeac46067cb0f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:55:05.069403 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-bfabb633-264d-45aa-b9ae-f87e26781945 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:55:05.122539 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 925/1858] 10.222.0.65 () {58 vars in 958 bytes} [Thu Oct 27 09:55:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 09:55:05.132898 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bce6b7b-c7a4-4788-a942-5bad3bad1e8d None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:55:05.133155 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bce6b7b-c7a4-4788-a942-5bad3bad1e8d None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:55:05.133432 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bce6b7b-c7a4-4788-a942-5bad3bad1e8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:55:05.134646 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0ea470-0449-486b-a8ff-1741c3835954 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:55:05.134978 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0ea470-0449-486b-a8ff-1741c3835954 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:55:05.135259 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0ea470-0449-486b-a8ff-1741c3835954 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:55:05.155409 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-5bce6b7b-c7a4-4788-a942-5bad3bad1e8d None None] MFA Rules not processed for user `b5065084bf664b99bdeac46067cb0f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:55:05.155642 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-dd0ea470-0449-486b-a8ff-1741c3835954 None None] MFA Rules not processed for user `c2d74550d0234a33a93993ca68197751`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:55:05.156639 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-5bce6b7b-c7a4-4788-a942-5bad3bad1e8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:55:05.156782 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-dd0ea470-0449-486b-a8ff-1741c3835954 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:55:05.165334 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 934/1859] 10.222.0.65 () {58 vars in 958 bytes} [Thu Oct 27 09:55:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 09:55:05.169495 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bce6b7b-c7a4-4788-a942-5bad3bad1e8d None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:55:05.179442 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bce6b7b-c7a4-4788-a942-5bad3bad1e8d None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:55:05.185003 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15340008-3588-44d4-863a-e5d69bb7dacb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:55:05.186213 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15340008-3588-44d4-863a-e5d69bb7dacb admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:55:05.187048 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15340008-3588-44d4-863a-e5d69bb7dacb admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:55:05.187333 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15340008-3588-44d4-863a-e5d69bb7dacb admin admin] PATH_INFO: `/v3/domains` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:55:05.187993 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15340008-3588-44d4-863a-e5d69bb7dacb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 09:55:05.188305 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15340008-3588-44d4-863a-e5d69bb7dacb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:55:05.189912 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15340008-3588-44d4-863a-e5d69bb7dacb admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:55:05.203108 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 935/1860] 10.222.0.65 () {58 vars in 1153 bytes} [Thu Oct 27 09:55:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 09:55:05.207498 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15340008-3588-44d4-863a-e5d69bb7dacb admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:55:05.214660 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 926/1861] 10.222.0.65 () {58 vars in 958 bytes} [Thu Oct 27 09:55:05 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 09:55:05.217596 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15340008-3588-44d4-863a-e5d69bb7dacb admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:55:05.223133 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aaa0e5e-beb9-4e62-93d2-5bdafdb92e8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:55:05.223738 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aaa0e5e-beb9-4e62-93d2-5bdafdb92e8d admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:55:05.224018 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aaa0e5e-beb9-4e62-93d2-5bdafdb92e8d admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:55:05.224289 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aaa0e5e-beb9-4e62-93d2-5bdafdb92e8d admin admin] PATH_INFO: `/v3/projects` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:55:05.224918 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aaa0e5e-beb9-4e62-93d2-5bdafdb92e8d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:55:05.226960 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aaa0e5e-beb9-4e62-93d2-5bdafdb92e8d admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:55:05.250848 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:55:05.316363 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 936/1862] 10.222.0.65 () {60 vars in 1153 bytes} [Thu Oct 27 09:55:05 2022] POST /identity/v3/projects => generated 385 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 09:55:05.320544 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0ea470-0449-486b-a8ff-1741c3835954 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:55:05.332803 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0ea470-0449-486b-a8ff-1741c3835954 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:55:05.396970 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd566c8-db92-47fd-9fa7-3dd2a6289c3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:55:05.397640 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd566c8-db92-47fd-9fa7-3dd2a6289c3b admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:55:05.397918 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd566c8-db92-47fd-9fa7-3dd2a6289c3b admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:55:05.398193 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd566c8-db92-47fd-9fa7-3dd2a6289c3b admin admin] PATH_INFO: `/v3/users` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:55:05.398868 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd566c8-db92-47fd-9fa7-3dd2a6289c3b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:55:05.400887 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd566c8-db92-47fd-9fa7-3dd2a6289c3b admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:55:05.503479 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 927/1863] 10.222.0.65 () {60 vars in 1144 bytes} [Thu Oct 27 09:55:05 2022] POST /identity/v3/users => generated 293 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 09:55:05.505156 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aaa0e5e-beb9-4e62-93d2-5bdafdb92e8d admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:55:05.517113 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aaa0e5e-beb9-4e62-93d2-5bdafdb92e8d admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:55:05.522145 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c76d72a-6148-499a-92c5-f53c9d7d3c65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:55:05.522820 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c76d72a-6148-499a-92c5-f53c9d7d3c65 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:55:05.523105 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c76d72a-6148-499a-92c5-f53c9d7d3c65 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:55:05.523383 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c76d72a-6148-499a-92c5-f53c9d7d3c65 admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:55:05.524032 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c76d72a-6148-499a-92c5-f53c9d7d3c65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:55:05.525648 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c76d72a-6148-499a-92c5-f53c9d7d3c65 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:55:05.537031 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 937/1864] 10.222.0.65 () {58 vars in 1122 bytes} [Thu Oct 27 09:55:05 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 09:55:05.541126 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd566c8-db92-47fd-9fa7-3dd2a6289c3b admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:55:05.553025 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd566c8-db92-47fd-9fa7-3dd2a6289c3b admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:55:05.558489 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4eadf96-68b7-41d7-956c-c4de98fc0bd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:55:05.559126 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4eadf96-68b7-41d7-956c-c4de98fc0bd1 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:55:05.559409 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4eadf96-68b7-41d7-956c-c4de98fc0bd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:55:05.559686 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4eadf96-68b7-41d7-956c-c4de98fc0bd1 admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:55:05.560380 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4eadf96-68b7-41d7-956c-c4de98fc0bd1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:55:05.562994 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4eadf96-68b7-41d7-956c-c4de98fc0bd1 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:55:05.574159 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 928/1865] 10.222.0.65 () {58 vars in 1122 bytes} [Thu Oct 27 09:55:05 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 09:55:05.578741 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c76d72a-6148-499a-92c5-f53c9d7d3c65 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:55:05.593397 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c76d72a-6148-499a-92c5-f53c9d7d3c65 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:55:05.599812 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e2b5c3-a56b-4fa2-b95f-a75b14250c33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:55:05.600496 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e2b5c3-a56b-4fa2-b95f-a75b14250c33 admin admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:55:05.600779 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e2b5c3-a56b-4fa2-b95f-a75b14250c33 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:55:05.601056 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e2b5c3-a56b-4fa2-b95f-a75b14250c33 admin admin] PATH_INFO: `/v3/projects/1ec2789d8ef24be3aa6ca52eacfe35df/users/042b63d7eaa844e4b2440caf0b2f5a16/roles/43543ce1450245af9661cb017bac17bd` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:55:05.617127 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e2b5c3-a56b-4fa2-b95f-a75b14250c33 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1ec2789d8ef24be3aa6ca52eacfe35df, user_id=042b63d7eaa844e4b2440caf0b2f5a16, role_id=43543ce1450245af9661cb017bac17bd)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:55:05.619850 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e2b5c3-a56b-4fa2-b95f-a75b14250c33 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:55:05.690670 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 938/1866] 10.222.0.65 () {60 vars in 1483 bytes} [Thu Oct 27 09:55:05 2022] PUT /identity/v3/projects/1ec2789d8ef24be3aa6ca52eacfe35df/users/042b63d7eaa844e4b2440caf0b2f5a16/roles/43543ce1450245af9661cb017bac17bd => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 09:55:05.702191 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b300a60-7803-47bf-8de3-ac48a0e5413c None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:55:05.702476 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b300a60-7803-47bf-8de3-ac48a0e5413c None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:55:05.702930 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b300a60-7803-47bf-8de3-ac48a0e5413c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:55:05.734468 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-1b300a60-7803-47bf-8de3-ac48a0e5413c None None] MFA Rules not processed for user `042b63d7eaa844e4b2440caf0b2f5a16`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:55:05.735750 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-1b300a60-7803-47bf-8de3-ac48a0e5413c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:55:05.807086 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 929/1867] 10.222.0.65 () {58 vars in 958 bytes} [Thu Oct 27 09:55:05 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 09:55:05.818851 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e2b5c3-a56b-4fa2-b95f-a75b14250c33 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:55:05.820642 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-13e2b5c3-a56b-4fa2-b95f-a75b14250c33 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:55:05.893880 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e2b5c3-a56b-4fa2-b95f-a75b14250c33 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:55:05.898215 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1314301f-0da7-4c9d-9476-21185b4b40a4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8e5d5f04c4741bb86ca4a0f667d4ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc2e3a7a1bcc480891c0b433291c00b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:55:05.898864 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1314301f-0da7-4c9d-9476-21185b4b40a4 service cinder] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:55:05.899155 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1314301f-0da7-4c9d-9476-21185b4b40a4 service cinder] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:55:05.899440 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1314301f-0da7-4c9d-9476-21185b4b40a4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:55:05.911847 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1314301f-0da7-4c9d-9476-21185b4b40a4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:55:05.913699 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1314301f-0da7-4c9d-9476-21185b4b40a4 service cinder] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:55:05.940276 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 939/1868] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Oct 27 09:55:05 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 09:55:09.219364 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b300a60-7803-47bf-8de3-ac48a0e5413c None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:55:09.261525 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:55:09.292646 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b300a60-7803-47bf-8de3-ac48a0e5413c None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:55:09.297414 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65815721-a1f1-4a08-be75-489bef5775bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:55:09.298059 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65815721-a1f1-4a08-be75-489bef5775bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:55:09.298339 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65815721-a1f1-4a08-be75-489bef5775bd admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:55:09.298653 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65815721-a1f1-4a08-be75-489bef5775bd admin admin] PATH_INFO: `/v3/users/042b63d7eaa844e4b2440caf0b2f5a16` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:55:09.300245 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65815721-a1f1-4a08-be75-489bef5775bd admin admin] RBAC: Authorizing `identity:delete_user(user_id=042b63d7eaa844e4b2440caf0b2f5a16)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:55:09.302290 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65815721-a1f1-4a08-be75-489bef5775bd admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:55:09.588861 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-65815721-a1f1-4a08-be75-489bef5775bd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '042b63d7eaa844e4b2440caf0b2f5a16'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:55:09.589635 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-65815721-a1f1-4a08-be75-489bef5775bd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '042b63d7eaa844e4b2440caf0b2f5a16'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:55:09.599349 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-65815721-a1f1-4a08-be75-489bef5775bd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '042b63d7eaa844e4b2440caf0b2f5a16'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:55:09.600156 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-65815721-a1f1-4a08-be75-489bef5775bd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '042b63d7eaa844e4b2440caf0b2f5a16'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:55:09.613413 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-65815721-a1f1-4a08-be75-489bef5775bd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '042b63d7eaa844e4b2440caf0b2f5a16'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:55:09.726412 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 930/1869] 10.222.0.65 () {58 vars in 1224 bytes} [Thu Oct 27 09:55:09 2022] DELETE /identity/v3/users/042b63d7eaa844e4b2440caf0b2f5a16 => generated 0 bytes in 508 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 09:55:09.727696 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c74e7a0-cd08-4848-bb26-b3fa92e9e44f None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:55:09.728144 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c74e7a0-cd08-4848-bb26-b3fa92e9e44f None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:55:09.728246 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c74e7a0-cd08-4848-bb26-b3fa92e9e44f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:55:09.745807 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:55:09.752985 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-1c74e7a0-cd08-4848-bb26-b3fa92e9e44f None None] MFA Rules not processed for user `b5065084bf664b99bdeac46067cb0f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:55:09.754190 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-1c74e7a0-cd08-4848-bb26-b3fa92e9e44f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:55:09.819203 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 940/1870] 10.222.0.65 () {58 vars in 958 bytes} [Thu Oct 27 09:55:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 09:55:09.830989 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65815721-a1f1-4a08-be75-489bef5775bd admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:55:09.832579 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-65815721-a1f1-4a08-be75-489bef5775bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:55:09.915674 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65815721-a1f1-4a08-be75-489bef5775bd admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:55:09.919859 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3c2379-a8b9-448b-965a-55c159256e16 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6191cc41efa74f46b49022cf387f7a4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc2e3a7a1bcc480891c0b433291c00b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:55:09.920420 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3c2379-a8b9-448b-965a-55c159256e16 service neutron] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:55:09.920698 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3c2379-a8b9-448b-965a-55c159256e16 service neutron] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:55:09.920969 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3c2379-a8b9-448b-965a-55c159256e16 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:55:09.935127 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3c2379-a8b9-448b-965a-55c159256e16 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:55:09.936612 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3c2379-a8b9-448b-965a-55c159256e16 service neutron] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:55:09.947931 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 931/1871] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Oct 27 09:55:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 09:55:10.401927 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c74e7a0-cd08-4848-bb26-b3fa92e9e44f None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:55:10.411466 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-1c74e7a0-cd08-4848-bb26-b3fa92e9e44f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:55:10.419463 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c74e7a0-cd08-4848-bb26-b3fa92e9e44f None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:55:10.425644 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4436115f-0f19-4fe9-8413-727a2d37cb6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:55:10.426305 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4436115f-0f19-4fe9-8413-727a2d37cb6c admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:55:10.426740 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4436115f-0f19-4fe9-8413-727a2d37cb6c admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:55:10.426938 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4436115f-0f19-4fe9-8413-727a2d37cb6c admin admin] PATH_INFO: `/v3/projects/1ec2789d8ef24be3aa6ca52eacfe35df` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:55:10.429028 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4436115f-0f19-4fe9-8413-727a2d37cb6c admin admin] RBAC: Authorizing `identity:delete_project(project_id=1ec2789d8ef24be3aa6ca52eacfe35df)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:55:10.431052 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4436115f-0f19-4fe9-8413-727a2d37cb6c admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:55:10.575172 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-4436115f-0f19-4fe9-8413-727a2d37cb6c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1ec2789d8ef24be3aa6ca52eacfe35df', 'request_id': 'req-4436115f-0f19-4fe9-8413-727a2d37cb6c'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:55:10.675026 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-4436115f-0f19-4fe9-8413-727a2d37cb6c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1ec2789d8ef24be3aa6ca52eacfe35df', 'request_id': 'req-4436115f-0f19-4fe9-8413-727a2d37cb6c'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:55:10.681834 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-4436115f-0f19-4fe9-8413-727a2d37cb6c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1ec2789d8ef24be3aa6ca52eacfe35df', 'request_id': 'req-4436115f-0f19-4fe9-8413-727a2d37cb6c'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:55:10.695063 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-4436115f-0f19-4fe9-8413-727a2d37cb6c admin admin] The token cache is being invalidate because project 1ec2789d8ef24be3aa6ca52eacfe35df was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 09:55:10.695268 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-4436115f-0f19-4fe9-8413-727a2d37cb6c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:55:10.695934 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-4436115f-0f19-4fe9-8413-727a2d37cb6c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:55:10.697452 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 941/1872] 10.222.0.65 () {58 vars in 1233 bytes} [Thu Oct 27 09:55:10 2022] DELETE /identity/v3/projects/1ec2789d8ef24be3aa6ca52eacfe35df => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 09:55:10.702680 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa31139-fa9d-4489-baaa-afa16448a400 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:55:10.703143 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa31139-fa9d-4489-baaa-afa16448a400 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:55:10.703296 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa31139-fa9d-4489-baaa-afa16448a400 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:55:10.724144 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-5fa31139-fa9d-4489-baaa-afa16448a400 None None] MFA Rules not processed for user `b5065084bf664b99bdeac46067cb0f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:55:10.725403 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-5fa31139-fa9d-4489-baaa-afa16448a400 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:55:10.777642 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:55:10.795798 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 932/1873] 10.222.0.65 () {58 vars in 958 bytes} [Thu Oct 27 09:55:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 09:55:10.799507 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c278cbb-2a5f-4ce5-9f10-203b3d7d2da3 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:55:10.800627 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c278cbb-2a5f-4ce5-9f10-203b3d7d2da3 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:55:10.800935 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c278cbb-2a5f-4ce5-9f10-203b3d7d2da3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:55:10.823788 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-7c278cbb-2a5f-4ce5-9f10-203b3d7d2da3 None None] MFA Rules not processed for user `b5065084bf664b99bdeac46067cb0f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:55:10.825083 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-7c278cbb-2a5f-4ce5-9f10-203b3d7d2da3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:55:10.833601 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 942/1874] 10.222.0.65 () {58 vars in 958 bytes} [Thu Oct 27 09:55:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 09:55:10.838023 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa31139-fa9d-4489-baaa-afa16448a400 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:55:10.852752 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa31139-fa9d-4489-baaa-afa16448a400 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:55:10.861189 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ffca8d-f8a6-4271-b1e0-d528feee265b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:55:10.861819 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ffca8d-f8a6-4271-b1e0-d528feee265b admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:55:10.862100 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ffca8d-f8a6-4271-b1e0-d528feee265b admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:55:10.862367 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ffca8d-f8a6-4271-b1e0-d528feee265b admin admin] PATH_INFO: `/v3/domains` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:55:10.863051 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ffca8d-f8a6-4271-b1e0-d528feee265b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 09:55:10.863354 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ffca8d-f8a6-4271-b1e0-d528feee265b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:55:10.865140 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ffca8d-f8a6-4271-b1e0-d528feee265b admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:55:10.879196 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 933/1875] 10.222.0.65 () {58 vars in 1153 bytes} [Thu Oct 27 09:55:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 09:55:10.882976 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c278cbb-2a5f-4ce5-9f10-203b3d7d2da3 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:55:10.893672 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c278cbb-2a5f-4ce5-9f10-203b3d7d2da3 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:55:10.898719 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf7ba41-a886-4b9c-b4a7-0927a7c0604f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:55:10.899438 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf7ba41-a886-4b9c-b4a7-0927a7c0604f admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:55:10.899718 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf7ba41-a886-4b9c-b4a7-0927a7c0604f admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:55:10.899990 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf7ba41-a886-4b9c-b4a7-0927a7c0604f admin admin] PATH_INFO: `/v3/projects` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:55:10.900613 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf7ba41-a886-4b9c-b4a7-0927a7c0604f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:55:10.902605 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf7ba41-a886-4b9c-b4a7-0927a7c0604f admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:55:11.018610 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 943/1876] 10.222.0.65 () {60 vars in 1153 bytes} [Thu Oct 27 09:55:10 2022] POST /identity/v3/projects => generated 399 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 09:55:11.023394 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ffca8d-f8a6-4271-b1e0-d528feee265b admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:55:11.037092 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ffca8d-f8a6-4271-b1e0-d528feee265b admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:55:11.101747 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4467e0f2-0dda-4f23-9ce5-e79b8706669e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:55:11.102367 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4467e0f2-0dda-4f23-9ce5-e79b8706669e admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:55:11.102688 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4467e0f2-0dda-4f23-9ce5-e79b8706669e admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:55:11.102966 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4467e0f2-0dda-4f23-9ce5-e79b8706669e admin admin] PATH_INFO: `/v3/users` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:55:11.103645 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4467e0f2-0dda-4f23-9ce5-e79b8706669e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:55:11.105596 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4467e0f2-0dda-4f23-9ce5-e79b8706669e admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:55:11.212311 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 934/1877] 10.222.0.65 () {60 vars in 1144 bytes} [Thu Oct 27 09:55:11 2022] POST /identity/v3/users => generated 300 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 09:55:11.214839 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf7ba41-a886-4b9c-b4a7-0927a7c0604f admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:55:11.225658 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf7ba41-a886-4b9c-b4a7-0927a7c0604f admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:55:11.230338 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75725c46-3a42-4400-8587-ef2cdec08086 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:55:11.231034 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75725c46-3a42-4400-8587-ef2cdec08086 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:55:11.231261 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75725c46-3a42-4400-8587-ef2cdec08086 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:55:11.231539 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75725c46-3a42-4400-8587-ef2cdec08086 admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:55:11.232188 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75725c46-3a42-4400-8587-ef2cdec08086 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:55:11.233790 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75725c46-3a42-4400-8587-ef2cdec08086 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:55:11.247609 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 944/1878] 10.222.0.65 () {58 vars in 1122 bytes} [Thu Oct 27 09:55:11 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 09:55:11.248898 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4467e0f2-0dda-4f23-9ce5-e79b8706669e admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:55:11.259786 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4467e0f2-0dda-4f23-9ce5-e79b8706669e admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:55:11.264537 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5479f95-811f-4483-a1e2-40fae0e7b3ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:55:11.265225 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5479f95-811f-4483-a1e2-40fae0e7b3ae admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:55:11.269972 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5479f95-811f-4483-a1e2-40fae0e7b3ae admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:55:11.269972 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5479f95-811f-4483-a1e2-40fae0e7b3ae admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:55:11.269972 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5479f95-811f-4483-a1e2-40fae0e7b3ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:55:11.269972 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5479f95-811f-4483-a1e2-40fae0e7b3ae admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:55:11.280384 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 935/1879] 10.222.0.65 () {58 vars in 1122 bytes} [Thu Oct 27 09:55:11 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 09:55:11.284699 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75725c46-3a42-4400-8587-ef2cdec08086 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:55:11.295335 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75725c46-3a42-4400-8587-ef2cdec08086 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:55:11.300611 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274449fa-03f8-4178-b90c-ad3a29a7ffb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:55:11.301283 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274449fa-03f8-4178-b90c-ad3a29a7ffb0 admin admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:55:11.301638 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274449fa-03f8-4178-b90c-ad3a29a7ffb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:55:11.302123 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274449fa-03f8-4178-b90c-ad3a29a7ffb0 admin admin] PATH_INFO: `/v3/projects/5c90e0c4aa094876b824a3d55e4eac8f/users/b2c6eb510c6b47c48d7a898dd1527474/roles/43543ce1450245af9661cb017bac17bd` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:55:11.319979 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274449fa-03f8-4178-b90c-ad3a29a7ffb0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c90e0c4aa094876b824a3d55e4eac8f, user_id=b2c6eb510c6b47c48d7a898dd1527474, role_id=43543ce1450245af9661cb017bac17bd)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:55:11.323066 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274449fa-03f8-4178-b90c-ad3a29a7ffb0 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:55:11.413370 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 945/1880] 10.222.0.65 () {60 vars in 1483 bytes} [Thu Oct 27 09:55:11 2022] PUT /identity/v3/projects/5c90e0c4aa094876b824a3d55e4eac8f/users/b2c6eb510c6b47c48d7a898dd1527474/roles/43543ce1450245af9661cb017bac17bd => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 09:55:11.424698 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf202eb3-406c-4391-98bd-2e87a4b58341 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:55:11.425003 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf202eb3-406c-4391-98bd-2e87a4b58341 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:55:11.425279 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf202eb3-406c-4391-98bd-2e87a4b58341 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:55:11.455413 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-bf202eb3-406c-4391-98bd-2e87a4b58341 None None] MFA Rules not processed for user `b2c6eb510c6b47c48d7a898dd1527474`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:55:11.456621 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-bf202eb3-406c-4391-98bd-2e87a4b58341 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:55:11.526749 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 936/1881] 10.222.0.65 () {58 vars in 958 bytes} [Thu Oct 27 09:55:11 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 09:55:11.538647 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274449fa-03f8-4178-b90c-ad3a29a7ffb0 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:55:11.540109 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-274449fa-03f8-4178-b90c-ad3a29a7ffb0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:55:11.573490 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:55:11.602853 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274449fa-03f8-4178-b90c-ad3a29a7ffb0 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:55:11.606755 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c47942-c022-47ff-8a58-ea10c2041b65 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8e5d5f04c4741bb86ca4a0f667d4ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc2e3a7a1bcc480891c0b433291c00b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:55:11.607369 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c47942-c022-47ff-8a58-ea10c2041b65 service cinder] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:55:11.607648 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c47942-c022-47ff-8a58-ea10c2041b65 service cinder] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:55:11.607922 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c47942-c022-47ff-8a58-ea10c2041b65 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:55:11.617678 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c47942-c022-47ff-8a58-ea10c2041b65 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:55:11.619224 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c47942-c022-47ff-8a58-ea10c2041b65 service cinder] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:55:11.632720 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 946/1882] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Oct 27 09:55:11 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 09:55:17.607593 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf202eb3-406c-4391-98bd-2e87a4b58341 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:55:17.684920 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:55:17.699063 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf202eb3-406c-4391-98bd-2e87a4b58341 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:55:17.704247 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa00dea-d629-4147-97f6-491d4e266ade admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:55:17.705073 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa00dea-d629-4147-97f6-491d4e266ade admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:55:17.705436 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa00dea-d629-4147-97f6-491d4e266ade admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:55:17.706036 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa00dea-d629-4147-97f6-491d4e266ade admin admin] PATH_INFO: `/v3/users/b2c6eb510c6b47c48d7a898dd1527474` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:55:17.707351 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa00dea-d629-4147-97f6-491d4e266ade admin admin] RBAC: Authorizing `identity:delete_user(user_id=b2c6eb510c6b47c48d7a898dd1527474)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:55:17.710125 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa00dea-d629-4147-97f6-491d4e266ade admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:55:17.947881 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-aaa00dea-d629-4147-97f6-491d4e266ade admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b2c6eb510c6b47c48d7a898dd1527474'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:55:17.948478 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-aaa00dea-d629-4147-97f6-491d4e266ade admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b2c6eb510c6b47c48d7a898dd1527474'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:55:17.955488 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-aaa00dea-d629-4147-97f6-491d4e266ade admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b2c6eb510c6b47c48d7a898dd1527474'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:55:17.956132 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-aaa00dea-d629-4147-97f6-491d4e266ade admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b2c6eb510c6b47c48d7a898dd1527474'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:55:17.968946 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-aaa00dea-d629-4147-97f6-491d4e266ade admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b2c6eb510c6b47c48d7a898dd1527474'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:55:18.092977 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 937/1883] 10.222.0.65 () {58 vars in 1224 bytes} [Thu Oct 27 09:55:17 2022] DELETE /identity/v3/users/b2c6eb510c6b47c48d7a898dd1527474 => generated 0 bytes in 486 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 09:55:18.104315 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2930dceb-6441-4ded-ba77-c408b4e4736b None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:55:18.104849 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2930dceb-6441-4ded-ba77-c408b4e4736b None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:55:18.104943 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2930dceb-6441-4ded-ba77-c408b4e4736b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:55:18.135100 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-2930dceb-6441-4ded-ba77-c408b4e4736b None None] MFA Rules not processed for user `b5065084bf664b99bdeac46067cb0f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:55:18.135100 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-2930dceb-6441-4ded-ba77-c408b4e4736b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:55:18.198696 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 947/1884] 10.222.0.65 () {58 vars in 958 bytes} [Thu Oct 27 09:55:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 09:55:18.209179 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa00dea-d629-4147-97f6-491d4e266ade admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:55:18.210648 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-aaa00dea-d629-4147-97f6-491d4e266ade admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:55:18.269963 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa00dea-d629-4147-97f6-491d4e266ade admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:55:18.274361 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479b5cee-a11a-4fbb-913f-0ae9a3317810 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6191cc41efa74f46b49022cf387f7a4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc2e3a7a1bcc480891c0b433291c00b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:55:18.274997 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479b5cee-a11a-4fbb-913f-0ae9a3317810 service neutron] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:55:18.275276 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479b5cee-a11a-4fbb-913f-0ae9a3317810 service neutron] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:55:18.275551 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479b5cee-a11a-4fbb-913f-0ae9a3317810 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:55:18.285133 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479b5cee-a11a-4fbb-913f-0ae9a3317810 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:55:18.286775 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479b5cee-a11a-4fbb-913f-0ae9a3317810 service neutron] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:55:18.296866 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 938/1885] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Oct 27 09:55:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 09:55:18.757095 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2930dceb-6441-4ded-ba77-c408b4e4736b None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:55:18.758657 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-2930dceb-6441-4ded-ba77-c408b4e4736b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:55:18.779663 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2930dceb-6441-4ded-ba77-c408b4e4736b None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:55:18.786377 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2c49ff-d823-486e-8315-fe5bd3cd25d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:55:18.787296 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2c49ff-d823-486e-8315-fe5bd3cd25d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:55:18.787640 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2c49ff-d823-486e-8315-fe5bd3cd25d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:55:18.788815 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2c49ff-d823-486e-8315-fe5bd3cd25d7 admin admin] PATH_INFO: `/v3/projects/5c90e0c4aa094876b824a3d55e4eac8f` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:55:18.790225 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2c49ff-d823-486e-8315-fe5bd3cd25d7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5c90e0c4aa094876b824a3d55e4eac8f)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:55:18.792158 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2c49ff-d823-486e-8315-fe5bd3cd25d7 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:55:18.962856 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-8a2c49ff-d823-486e-8315-fe5bd3cd25d7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5c90e0c4aa094876b824a3d55e4eac8f', 'request_id': 'req-8a2c49ff-d823-486e-8315-fe5bd3cd25d7'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:55:19.040209 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-8a2c49ff-d823-486e-8315-fe5bd3cd25d7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5c90e0c4aa094876b824a3d55e4eac8f', 'request_id': 'req-8a2c49ff-d823-486e-8315-fe5bd3cd25d7'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:55:19.047244 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-8a2c49ff-d823-486e-8315-fe5bd3cd25d7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5c90e0c4aa094876b824a3d55e4eac8f', 'request_id': 'req-8a2c49ff-d823-486e-8315-fe5bd3cd25d7'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:55:19.061242 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-8a2c49ff-d823-486e-8315-fe5bd3cd25d7 admin admin] The token cache is being invalidate because project 5c90e0c4aa094876b824a3d55e4eac8f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 09:55:19.061559 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-8a2c49ff-d823-486e-8315-fe5bd3cd25d7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:55:19.062213 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-8a2c49ff-d823-486e-8315-fe5bd3cd25d7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:55:19.063741 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 948/1886] 10.222.0.65 () {58 vars in 1233 bytes} [Thu Oct 27 09:55:18 2022] DELETE /identity/v3/projects/5c90e0c4aa094876b824a3d55e4eac8f => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 09:55:28.292293 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=56,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:55:28.450019 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48bf530-2ba9-4557-9218-c1a7a094241e None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:55:28.450306 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48bf530-2ba9-4557-9218-c1a7a094241e None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:55:28.450636 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48bf530-2ba9-4557-9218-c1a7a094241e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:55:28.471746 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-a48bf530-2ba9-4557-9218-c1a7a094241e None None] MFA Rules not processed for user `c18a92a796934277ad64a51ef3f7bb23`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:55:28.473045 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-a48bf530-2ba9-4557-9218-c1a7a094241e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:55:28.531260 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 939/1887] 10.222.0.65 () {58 vars in 1009 bytes} [Thu Oct 27 09:55:28 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 09:55:28.574407 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2c49ff-d823-486e-8315-fe5bd3cd25d7 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:55:28.575889 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-8a2c49ff-d823-486e-8315-fe5bd3cd25d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:55:28.637494 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:55:28.654895 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2c49ff-d823-486e-8315-fe5bd3cd25d7 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:55:28.660412 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f466aa52-e0b1-4dfd-b5c1-69d677e2922a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e32fc35c8b467e9604b325cf1527aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc2e3a7a1bcc480891c0b433291c00b1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:55:28.661036 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f466aa52-e0b1-4dfd-b5c1-69d677e2922a service swift] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:55:28.661320 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f466aa52-e0b1-4dfd-b5c1-69d677e2922a service swift] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:55:28.661595 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f466aa52-e0b1-4dfd-b5c1-69d677e2922a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:55:28.670698 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f466aa52-e0b1-4dfd-b5c1-69d677e2922a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:55:28.672294 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f466aa52-e0b1-4dfd-b5c1-69d677e2922a service swift] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:55:28.680457 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 949/1888] 10.222.0.65 () {60 vars in 1384 bytes} [Thu Oct 27 09:55:28 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 27 09:55:34.655070 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48bf530-2ba9-4557-9218-c1a7a094241e None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:55:34.656533 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-a48bf530-2ba9-4557-9218-c1a7a094241e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:55:34.744076 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48bf530-2ba9-4557-9218-c1a7a094241e None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:55:34.750497 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878af544-f434-4347-95e0-552a6cbda0fa service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8c47ff5d72943f6bab09b5df6198d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc2e3a7a1bcc480891c0b433291c00b1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:55:34.752575 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878af544-f434-4347-95e0-552a6cbda0fa service placement] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:55:34.752575 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878af544-f434-4347-95e0-552a6cbda0fa service placement] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:55:34.752575 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878af544-f434-4347-95e0-552a6cbda0fa service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:55:34.753851 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-878af544-f434-4347-95e0-552a6cbda0fa service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:55:34.769577 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878af544-f434-4347-95e0-552a6cbda0fa service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:55:34.771538 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878af544-f434-4347-95e0-552a6cbda0fa service placement] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:55:34.788513 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 940/1889] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Oct 27 09:55:34 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 09:55:38.731309 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=8 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:55:44.782775 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=57 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:55:45.118163 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d83025-f759-438d-93dd-132dd25318b8 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:55:45.118604 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d83025-f759-438d-93dd-132dd25318b8 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:55:45.118722 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d83025-f759-438d-93dd-132dd25318b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:55:45.138934 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-70d83025-f759-438d-93dd-132dd25318b8 None None] MFA Rules not processed for user `c18a92a796934277ad64a51ef3f7bb23`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:55:45.140262 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-70d83025-f759-438d-93dd-132dd25318b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:55:45.147860 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 950/1890] 10.222.0.65 () {58 vars in 967 bytes} [Thu Oct 27 09:55:45 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 09:55:45.161103 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878af544-f434-4347-95e0-552a6cbda0fa service placement] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:55:45.174051 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878af544-f434-4347-95e0-552a6cbda0fa service placement] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:55:45.179615 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a203ae-3022-439f-b5b8-0ec4fc045bb2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e32fc35c8b467e9604b325cf1527aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc2e3a7a1bcc480891c0b433291c00b1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:55:45.180422 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a203ae-3022-439f-b5b8-0ec4fc045bb2 service swift] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:55:45.180557 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a203ae-3022-439f-b5b8-0ec4fc045bb2 service swift] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:55:45.180826 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a203ae-3022-439f-b5b8-0ec4fc045bb2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:55:45.189883 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a203ae-3022-439f-b5b8-0ec4fc045bb2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:55:45.191487 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a203ae-3022-439f-b5b8-0ec4fc045bb2 service swift] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:55:45.199799 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 941/1891] 10.222.0.65 () {60 vars in 1384 bytes} [Thu Oct 27 09:55:45 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 27 09:55:48.681684 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fe9861-ab3d-4e85-a55b-af90d04e45f2 None None] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:55:48.682799 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fe9861-ab3d-4e85-a55b-af90d04e45f2 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:55:48.683343 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fe9861-ab3d-4e85-a55b-af90d04e45f2 None None] PATH_INFO: `/` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:55:48.684895 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 951/1892] 10.222.0.65 () {54 vars in 921 bytes} [Thu Oct 27 09:55:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 09:55:48.699593 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c519df-b5d1-42a6-aef8-5cf08a8072a1 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:55:48.700218 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c519df-b5d1-42a6-aef8-5cf08a8072a1 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:55:48.700497 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c519df-b5d1-42a6-aef8-5cf08a8072a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:55:48.739085 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-11c519df-b5d1-42a6-aef8-5cf08a8072a1 None None] MFA Rules not processed for user `f8c47ff5d72943f6bab09b5df6198d64`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:55:48.740450 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-11c519df-b5d1-42a6-aef8-5cf08a8072a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:55:48.752380 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 942/1893] 10.222.0.65 () {58 vars in 1018 bytes} [Thu Oct 27 09:55:48 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 09:55:48.763715 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fe9861-ab3d-4e85-a55b-af90d04e45f2 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:55:48.778268 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fe9861-ab3d-4e85-a55b-af90d04e45f2 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:55:48.784389 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46006e00-dde1-4683-800e-45fef50befb3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8c47ff5d72943f6bab09b5df6198d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc2e3a7a1bcc480891c0b433291c00b1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:55:48.785026 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46006e00-dde1-4683-800e-45fef50befb3 service placement] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:55:48.785333 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46006e00-dde1-4683-800e-45fef50befb3 service placement] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:55:48.785611 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46006e00-dde1-4683-800e-45fef50befb3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:55:48.794682 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46006e00-dde1-4683-800e-45fef50befb3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:55:48.796885 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46006e00-dde1-4683-800e-45fef50befb3 service placement] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:55:48.808509 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 952/1894] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Oct 27 09:55:48 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 09:55:48.857089 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c519df-b5d1-42a6-aef8-5cf08a8072a1 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:55:48.859205 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-11c519df-b5d1-42a6-aef8-5cf08a8072a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:55:48.932425 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c519df-b5d1-42a6-aef8-5cf08a8072a1 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:55:48.937914 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ae1ea6-b4b1-4ffd-a9ba-d2af6ac57917 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:55:48.938592 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ae1ea6-b4b1-4ffd-a9ba-d2af6ac57917 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:55:48.938882 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ae1ea6-b4b1-4ffd-a9ba-d2af6ac57917 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:55:48.939215 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ae1ea6-b4b1-4ffd-a9ba-d2af6ac57917 admin admin] PATH_INFO: `/v3/users/c2d74550d0234a33a93993ca68197751` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:55:48.940390 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ae1ea6-b4b1-4ffd-a9ba-d2af6ac57917 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c2d74550d0234a33a93993ca68197751)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:55:48.942401 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ae1ea6-b4b1-4ffd-a9ba-d2af6ac57917 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:55:49.162905 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-13ae1ea6-b4b1-4ffd-a9ba-d2af6ac57917 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c2d74550d0234a33a93993ca68197751'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:55:49.163827 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-13ae1ea6-b4b1-4ffd-a9ba-d2af6ac57917 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c2d74550d0234a33a93993ca68197751'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:55:49.172459 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-13ae1ea6-b4b1-4ffd-a9ba-d2af6ac57917 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c2d74550d0234a33a93993ca68197751'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:55:49.173214 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-13ae1ea6-b4b1-4ffd-a9ba-d2af6ac57917 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c2d74550d0234a33a93993ca68197751'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:55:49.186066 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-13ae1ea6-b4b1-4ffd-a9ba-d2af6ac57917 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c2d74550d0234a33a93993ca68197751'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:55:49.300370 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 943/1895] 10.222.0.65 () {58 vars in 1224 bytes} [Thu Oct 27 09:55:48 2022] DELETE /identity/v3/users/c2d74550d0234a33a93993ca68197751 => generated 0 bytes in 444 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 09:55:49.605681 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46006e00-dde1-4683-800e-45fef50befb3 service placement] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:55:49.630194 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46006e00-dde1-4683-800e-45fef50befb3 service placement] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:55:49.694629 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99af0ed3-e17c-4d88-8a6d-f7b60a01a74d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:55:49.695508 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99af0ed3-e17c-4d88-8a6d-f7b60a01a74d admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:55:49.695780 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99af0ed3-e17c-4d88-8a6d-f7b60a01a74d admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:55:49.696307 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99af0ed3-e17c-4d88-8a6d-f7b60a01a74d admin admin] PATH_INFO: `/v3/projects/5849d94c8cd44c0f8f3cb12ba2f6bee5` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:55:49.697321 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99af0ed3-e17c-4d88-8a6d-f7b60a01a74d admin admin] RBAC: Authorizing `identity:delete_project(project_id=5849d94c8cd44c0f8f3cb12ba2f6bee5)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:55:49.699212 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99af0ed3-e17c-4d88-8a6d-f7b60a01a74d admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:55:49.847054 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-99af0ed3-e17c-4d88-8a6d-f7b60a01a74d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5849d94c8cd44c0f8f3cb12ba2f6bee5', 'request_id': 'req-99af0ed3-e17c-4d88-8a6d-f7b60a01a74d'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:55:49.918454 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-99af0ed3-e17c-4d88-8a6d-f7b60a01a74d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5849d94c8cd44c0f8f3cb12ba2f6bee5', 'request_id': 'req-99af0ed3-e17c-4d88-8a6d-f7b60a01a74d'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:55:49.925448 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-99af0ed3-e17c-4d88-8a6d-f7b60a01a74d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5849d94c8cd44c0f8f3cb12ba2f6bee5', 'request_id': 'req-99af0ed3-e17c-4d88-8a6d-f7b60a01a74d'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:55:49.937638 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-99af0ed3-e17c-4d88-8a6d-f7b60a01a74d admin admin] The token cache is being invalidate because project 5849d94c8cd44c0f8f3cb12ba2f6bee5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 09:55:49.938122 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-99af0ed3-e17c-4d88-8a6d-f7b60a01a74d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:55:49.938642 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-99af0ed3-e17c-4d88-8a6d-f7b60a01a74d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:55:49.940177 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 953/1896] 10.222.0.65 () {58 vars in 1233 bytes} [Thu Oct 27 09:55:49 2022] DELETE /identity/v3/projects/5849d94c8cd44c0f8f3cb12ba2f6bee5 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 09:55:49.946662 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac98c8f5-ee19-4908-b4cc-2d53d9a1077d None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:55:49.947169 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac98c8f5-ee19-4908-b4cc-2d53d9a1077d None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:55:49.947289 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac98c8f5-ee19-4908-b4cc-2d53d9a1077d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:55:49.969417 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-ac98c8f5-ee19-4908-b4cc-2d53d9a1077d None None] MFA Rules not processed for user `b5065084bf664b99bdeac46067cb0f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:55:49.970658 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-ac98c8f5-ee19-4908-b4cc-2d53d9a1077d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:55:50.003067 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bd08ba-eace-434b-81b2-42e0c318ed68 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:55:50.005108 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bd08ba-eace-434b-81b2-42e0c318ed68 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:55:50.005416 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bd08ba-eace-434b-81b2-42e0c318ed68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:55:50.027108 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-e3bd08ba-eace-434b-81b2-42e0c318ed68 None None] MFA Rules not processed for user `2acf9b6c3a394be389cd17d7fade3cf4`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:55:50.028505 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-e3bd08ba-eace-434b-81b2-42e0c318ed68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:55:50.034794 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:55:50.046052 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 944/1897] 10.222.0.65 () {58 vars in 958 bytes} [Thu Oct 27 09:55:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 09:55:50.054459 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1411d05e-b0ee-4110-9929-819350a64f04 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:55:50.054929 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1411d05e-b0ee-4110-9929-819350a64f04 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:55:50.055298 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1411d05e-b0ee-4110-9929-819350a64f04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:55:50.084280 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-1411d05e-b0ee-4110-9929-819350a64f04 None None] MFA Rules not processed for user `b5065084bf664b99bdeac46067cb0f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:55:50.086455 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-1411d05e-b0ee-4110-9929-819350a64f04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:55:50.092306 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 954/1898] 10.222.0.65 () {58 vars in 958 bytes} [Thu Oct 27 09:55:49 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 09:55:50.097173 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 945/1899] 10.222.0.65 () {58 vars in 958 bytes} [Thu Oct 27 09:55:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 09:55:50.103734 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bd08ba-eace-434b-81b2-42e0c318ed68 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:55:50.115546 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bd08ba-eace-434b-81b2-42e0c318ed68 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:55:50.120349 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ce3eb2-85b5-44fd-a233-192df067c14d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:55:50.120955 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ce3eb2-85b5-44fd-a233-192df067c14d admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:55:50.121232 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ce3eb2-85b5-44fd-a233-192df067c14d admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:55:50.121502 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ce3eb2-85b5-44fd-a233-192df067c14d admin admin] PATH_INFO: `/v3/domains` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:55:50.122152 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ce3eb2-85b5-44fd-a233-192df067c14d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 09:55:50.122454 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ce3eb2-85b5-44fd-a233-192df067c14d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:55:50.124098 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ce3eb2-85b5-44fd-a233-192df067c14d admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:55:50.137009 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 955/1900] 10.222.0.65 () {58 vars in 1153 bytes} [Thu Oct 27 09:55:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 09:55:50.141261 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1411d05e-b0ee-4110-9929-819350a64f04 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:55:50.150349 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1411d05e-b0ee-4110-9929-819350a64f04 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:55:50.156021 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802d5631-4587-4932-a266-96a299b00788 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:55:50.156631 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802d5631-4587-4932-a266-96a299b00788 admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:55:50.156907 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802d5631-4587-4932-a266-96a299b00788 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:55:50.157208 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802d5631-4587-4932-a266-96a299b00788 admin admin] PATH_INFO: `/v3/projects` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:55:50.157859 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802d5631-4587-4932-a266-96a299b00788 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:55:50.160088 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802d5631-4587-4932-a266-96a299b00788 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:55:50.275093 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 946/1901] 10.222.0.65 () {60 vars in 1153 bytes} [Thu Oct 27 09:55:50 2022] POST /identity/v3/projects => generated 383 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 09:55:50.279379 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ce3eb2-85b5-44fd-a233-192df067c14d admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:55:50.285740 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:55:50.293678 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ce3eb2-85b5-44fd-a233-192df067c14d admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:55:50.368934 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e940a25-e394-4621-98ad-52b8c5e0496c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:55:50.369558 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e940a25-e394-4621-98ad-52b8c5e0496c admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:55:50.369835 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e940a25-e394-4621-98ad-52b8c5e0496c admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:55:50.370112 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e940a25-e394-4621-98ad-52b8c5e0496c admin admin] PATH_INFO: `/v3/users` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:55:50.370792 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e940a25-e394-4621-98ad-52b8c5e0496c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:55:50.372723 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e940a25-e394-4621-98ad-52b8c5e0496c admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:55:50.467532 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 956/1902] 10.222.0.65 () {60 vars in 1144 bytes} [Thu Oct 27 09:55:50 2022] POST /identity/v3/users => generated 292 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 09:55:50.471603 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802d5631-4587-4932-a266-96a299b00788 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:55:50.483517 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802d5631-4587-4932-a266-96a299b00788 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:55:50.488466 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945d5950-41ba-4546-9261-d3ae2dd92a1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:55:50.489968 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945d5950-41ba-4546-9261-d3ae2dd92a1c admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:55:50.491166 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945d5950-41ba-4546-9261-d3ae2dd92a1c admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:55:50.492175 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945d5950-41ba-4546-9261-d3ae2dd92a1c admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:55:50.493624 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945d5950-41ba-4546-9261-d3ae2dd92a1c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:55:50.495377 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945d5950-41ba-4546-9261-d3ae2dd92a1c admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:55:50.509619 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 947/1903] 10.222.0.65 () {58 vars in 1122 bytes} [Thu Oct 27 09:55:50 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 09:55:50.511329 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e940a25-e394-4621-98ad-52b8c5e0496c admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:55:50.526844 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e940a25-e394-4621-98ad-52b8c5e0496c admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:55:50.532513 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6daad8-aba4-44ff-90dd-45a3e0b86152 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:55:50.533220 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6daad8-aba4-44ff-90dd-45a3e0b86152 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:55:50.533598 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6daad8-aba4-44ff-90dd-45a3e0b86152 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:55:50.533947 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6daad8-aba4-44ff-90dd-45a3e0b86152 admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:55:50.534712 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6daad8-aba4-44ff-90dd-45a3e0b86152 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:55:50.536478 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6daad8-aba4-44ff-90dd-45a3e0b86152 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:55:50.549801 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 957/1904] 10.222.0.65 () {58 vars in 1122 bytes} [Thu Oct 27 09:55:50 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 09:55:50.554345 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945d5950-41ba-4546-9261-d3ae2dd92a1c admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:55:50.566717 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945d5950-41ba-4546-9261-d3ae2dd92a1c admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:55:50.571771 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa854470-da6b-46a3-adf8-0a6b8f991537 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:55:50.572533 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa854470-da6b-46a3-adf8-0a6b8f991537 admin admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:55:50.573345 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa854470-da6b-46a3-adf8-0a6b8f991537 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:55:50.573345 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa854470-da6b-46a3-adf8-0a6b8f991537 admin admin] PATH_INFO: `/v3/projects/406aa3937b4346e8a0053d62ffaf0926/users/cd9d226e6d994e769c1954a9c5bd4fcf/roles/43543ce1450245af9661cb017bac17bd` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:55:50.594169 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa854470-da6b-46a3-adf8-0a6b8f991537 admin admin] RBAC: Authorizing `identity:create_grant(project_id=406aa3937b4346e8a0053d62ffaf0926, user_id=cd9d226e6d994e769c1954a9c5bd4fcf, role_id=43543ce1450245af9661cb017bac17bd)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:55:50.598145 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa854470-da6b-46a3-adf8-0a6b8f991537 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:55:50.686570 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 948/1905] 10.222.0.65 () {60 vars in 1483 bytes} [Thu Oct 27 09:55:50 2022] PUT /identity/v3/projects/406aa3937b4346e8a0053d62ffaf0926/users/cd9d226e6d994e769c1954a9c5bd4fcf/roles/43543ce1450245af9661cb017bac17bd => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 09:55:50.692500 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3285446e-a647-4a36-9aa1-56e72a216db5 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:55:50.692928 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3285446e-a647-4a36-9aa1-56e72a216db5 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:55:50.693038 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3285446e-a647-4a36-9aa1-56e72a216db5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:55:50.713036 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-3285446e-a647-4a36-9aa1-56e72a216db5 None None] MFA Rules not processed for user `b5065084bf664b99bdeac46067cb0f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:55:50.714271 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-3285446e-a647-4a36-9aa1-56e72a216db5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:55:50.777745 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 958/1906] 10.222.0.65 () {58 vars in 958 bytes} [Thu Oct 27 09:55:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 09:55:50.787933 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa854470-da6b-46a3-adf8-0a6b8f991537 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:55:50.789667 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-aa854470-da6b-46a3-adf8-0a6b8f991537 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:55:50.868774 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa854470-da6b-46a3-adf8-0a6b8f991537 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:55:50.873794 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87be53ac-a671-4696-bc22-79c6604bcd45 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6191cc41efa74f46b49022cf387f7a4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc2e3a7a1bcc480891c0b433291c00b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:55:50.874340 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87be53ac-a671-4696-bc22-79c6604bcd45 service neutron] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:55:50.875701 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87be53ac-a671-4696-bc22-79c6604bcd45 service neutron] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:55:50.876212 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87be53ac-a671-4696-bc22-79c6604bcd45 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:55:50.890355 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87be53ac-a671-4696-bc22-79c6604bcd45 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:55:50.892403 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87be53ac-a671-4696-bc22-79c6604bcd45 service neutron] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:55:50.909419 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 949/1907] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Oct 27 09:55:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 09:55:57.827935 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37c4be6-3e25-4814-b6a3-9330ab5a45e0 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:55:57.828436 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37c4be6-3e25-4814-b6a3-9330ab5a45e0 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:55:57.828516 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37c4be6-3e25-4814-b6a3-9330ab5a45e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:55:57.861229 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-a37c4be6-3e25-4814-b6a3-9330ab5a45e0 None None] MFA Rules not processed for user `cd9d226e6d994e769c1954a9c5bd4fcf`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:55:57.862507 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-a37c4be6-3e25-4814-b6a3-9330ab5a45e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:55:57.937970 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 959/1908] 10.222.0.65 () {58 vars in 958 bytes} [Thu Oct 27 09:55:57 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 09:55:57.943190 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87be53ac-a671-4696-bc22-79c6604bcd45 service neutron] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:55:57.953367 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87be53ac-a671-4696-bc22-79c6604bcd45 service neutron] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:55:57.958809 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee6a645-3283-41bb-a87f-fb5c721bc71c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:55:57.959421 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee6a645-3283-41bb-a87f-fb5c721bc71c admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:55:57.959730 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee6a645-3283-41bb-a87f-fb5c721bc71c admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:55:57.960156 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee6a645-3283-41bb-a87f-fb5c721bc71c admin admin] PATH_INFO: `/v3/projects` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:55:57.960811 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee6a645-3283-41bb-a87f-fb5c721bc71c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:55:57.962761 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee6a645-3283-41bb-a87f-fb5c721bc71c admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:55:58.062347 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 950/1909] 10.222.0.65 () {60 vars in 1153 bytes} [Thu Oct 27 09:55:57 2022] POST /identity/v3/projects => generated 383 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 09:55:58.064573 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37c4be6-3e25-4814-b6a3-9330ab5a45e0 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:55:58.077508 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37c4be6-3e25-4814-b6a3-9330ab5a45e0 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:55:58.088696 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:55:58.148866 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02afb2ce-a928-4ce7-8f83-449993401270 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:55:58.149480 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02afb2ce-a928-4ce7-8f83-449993401270 admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:55:58.149760 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02afb2ce-a928-4ce7-8f83-449993401270 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:55:58.150034 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02afb2ce-a928-4ce7-8f83-449993401270 admin admin] PATH_INFO: `/v3/users` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:55:58.150851 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02afb2ce-a928-4ce7-8f83-449993401270 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:55:58.152779 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02afb2ce-a928-4ce7-8f83-449993401270 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:55:58.245290 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 960/1910] 10.222.0.65 () {60 vars in 1144 bytes} [Thu Oct 27 09:55:58 2022] POST /identity/v3/users => generated 298 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 09:55:58.246666 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee6a645-3283-41bb-a87f-fb5c721bc71c admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:55:58.258122 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee6a645-3283-41bb-a87f-fb5c721bc71c admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:55:58.263011 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472254d3-c78d-4389-8cc1-0fd20ba0c68e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:55:58.263618 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472254d3-c78d-4389-8cc1-0fd20ba0c68e admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:55:58.263903 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472254d3-c78d-4389-8cc1-0fd20ba0c68e admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:55:58.264179 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472254d3-c78d-4389-8cc1-0fd20ba0c68e admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:55:58.264854 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472254d3-c78d-4389-8cc1-0fd20ba0c68e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:55:58.266475 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472254d3-c78d-4389-8cc1-0fd20ba0c68e admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:55:58.281888 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 951/1911] 10.222.0.65 () {58 vars in 1122 bytes} [Thu Oct 27 09:55:58 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 09:55:58.284194 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02afb2ce-a928-4ce7-8f83-449993401270 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:55:58.295533 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02afb2ce-a928-4ce7-8f83-449993401270 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:55:58.300848 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a157f5b4-dac6-40af-9910-37c7e4bdc3b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:55:58.301619 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a157f5b4-dac6-40af-9910-37c7e4bdc3b6 admin admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:55:58.301972 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a157f5b4-dac6-40af-9910-37c7e4bdc3b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:55:58.302320 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a157f5b4-dac6-40af-9910-37c7e4bdc3b6 admin admin] PATH_INFO: `/v3/projects/41f81fce52884ead9edd23a4d2621f2e/users/9983066410de406a970048543b603e36/roles/6ad17b9f9dea4b66ab2da3677d7e715d` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:55:58.321163 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a157f5b4-dac6-40af-9910-37c7e4bdc3b6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=41f81fce52884ead9edd23a4d2621f2e, user_id=9983066410de406a970048543b603e36, role_id=6ad17b9f9dea4b66ab2da3677d7e715d)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:55:58.323808 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a157f5b4-dac6-40af-9910-37c7e4bdc3b6 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:55:58.401371 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 961/1912] 10.222.0.65 () {60 vars in 1483 bytes} [Thu Oct 27 09:55:58 2022] PUT /identity/v3/projects/41f81fce52884ead9edd23a4d2621f2e/users/9983066410de406a970048543b603e36/roles/6ad17b9f9dea4b66ab2da3677d7e715d => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 09:55:58.405329 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472254d3-c78d-4389-8cc1-0fd20ba0c68e admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:55:58.416948 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472254d3-c78d-4389-8cc1-0fd20ba0c68e admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:55:58.495785 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd13d648-588a-457f-b47c-bce08277d719 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:55:58.496515 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd13d648-588a-457f-b47c-bce08277d719 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:55:58.496797 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd13d648-588a-457f-b47c-bce08277d719 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:55:58.497072 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd13d648-588a-457f-b47c-bce08277d719 admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:55:58.497813 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd13d648-588a-457f-b47c-bce08277d719 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:55:58.499549 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd13d648-588a-457f-b47c-bce08277d719 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:55:58.512612 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 952/1913] 10.222.0.65 () {58 vars in 1122 bytes} [Thu Oct 27 09:55:58 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 09:55:58.516885 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a157f5b4-dac6-40af-9910-37c7e4bdc3b6 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:55:58.528746 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a157f5b4-dac6-40af-9910-37c7e4bdc3b6 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:55:58.541235 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f371b49-35b4-4b29-84c8-a2a600a31fc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:55:58.541937 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f371b49-35b4-4b29-84c8-a2a600a31fc7 admin admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:55:58.542253 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f371b49-35b4-4b29-84c8-a2a600a31fc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:55:58.542556 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f371b49-35b4-4b29-84c8-a2a600a31fc7 admin admin] PATH_INFO: `/v3/projects/41f81fce52884ead9edd23a4d2621f2e/users/9983066410de406a970048543b603e36/roles/6ad17b9f9dea4b66ab2da3677d7e715d` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:55:58.544629 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f371b49-35b4-4b29-84c8-a2a600a31fc7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=41f81fce52884ead9edd23a4d2621f2e, user_id=9983066410de406a970048543b603e36, role_id=6ad17b9f9dea4b66ab2da3677d7e715d)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:55:58.547385 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f371b49-35b4-4b29-84c8-a2a600a31fc7 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:55:58.559182 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 962/1914] 10.222.0.65 () {60 vars in 1483 bytes} [Thu Oct 27 09:55:58 2022] PUT /identity/v3/projects/41f81fce52884ead9edd23a4d2621f2e/users/9983066410de406a970048543b603e36/roles/6ad17b9f9dea4b66ab2da3677d7e715d => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 09:56:05.189901 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4933df54-a063-420a-90e3-5edff9ea984c None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:56:05.190391 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4933df54-a063-420a-90e3-5edff9ea984c None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:56:05.190768 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4933df54-a063-420a-90e3-5edff9ea984c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:56:05.208200 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:56:05.234932 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-4933df54-a063-420a-90e3-5edff9ea984c None None] MFA Rules not processed for user `9983066410de406a970048543b603e36`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:56:05.236362 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-4933df54-a063-420a-90e3-5edff9ea984c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:56:05.325040 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 953/1915] 10.222.0.65 () {58 vars in 958 bytes} [Thu Oct 27 09:56:05 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 09:56:05.333609 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f371b49-35b4-4b29-84c8-a2a600a31fc7 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:56:05.335446 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-4f371b49-35b4-4b29-84c8-a2a600a31fc7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:56:05.401454 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f371b49-35b4-4b29-84c8-a2a600a31fc7 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:56:05.405472 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1608573-9ef9-45b2-95c7-3f52f6051154 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4b0886666584397be686ee02a505269', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc2e3a7a1bcc480891c0b433291c00b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:56:05.406090 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1608573-9ef9-45b2-95c7-3f52f6051154 service glance] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:56:05.406374 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1608573-9ef9-45b2-95c7-3f52f6051154 service glance] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:56:05.406719 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1608573-9ef9-45b2-95c7-3f52f6051154 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:56:05.469262 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1608573-9ef9-45b2-95c7-3f52f6051154 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:56:05.470766 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1608573-9ef9-45b2-95c7-3f52f6051154 service glance] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:56:05.480934 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 963/1916] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Oct 27 09:56:05 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 09:56:05.821386 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee826138-d897-4416-bb6f-e0e9fe920d4c None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:56:05.821675 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee826138-d897-4416-bb6f-e0e9fe920d4c None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:56:05.821947 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee826138-d897-4416-bb6f-e0e9fe920d4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:56:05.867144 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-ee826138-d897-4416-bb6f-e0e9fe920d4c None None] MFA Rules not processed for user `c18a92a796934277ad64a51ef3f7bb23`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:56:05.869083 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-ee826138-d897-4416-bb6f-e0e9fe920d4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:56:05.936859 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 954/1917] 10.222.0.65 () {58 vars in 1009 bytes} [Thu Oct 27 09:56:05 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 09:56:05.952776 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1608573-9ef9-45b2-95c7-3f52f6051154 service glance] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:56:05.954339 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-c1608573-9ef9-45b2-95c7-3f52f6051154 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:56:05.980762 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:56:06.047876 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1608573-9ef9-45b2-95c7-3f52f6051154 service glance] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:56:06.053873 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159a06dc-d9f3-444a-9ba5-1abcf4eb2e4a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e32fc35c8b467e9604b325cf1527aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc2e3a7a1bcc480891c0b433291c00b1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:56:06.054495 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159a06dc-d9f3-444a-9ba5-1abcf4eb2e4a service swift] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:56:06.054795 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159a06dc-d9f3-444a-9ba5-1abcf4eb2e4a service swift] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:56:06.055065 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159a06dc-d9f3-444a-9ba5-1abcf4eb2e4a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:56:06.068858 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159a06dc-d9f3-444a-9ba5-1abcf4eb2e4a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:56:06.070572 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159a06dc-d9f3-444a-9ba5-1abcf4eb2e4a service swift] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:56:06.088303 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 964/1918] 10.222.0.65 () {60 vars in 1384 bytes} [Thu Oct 27 09:56:05 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 27 09:56:14.365990 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6aa8a86-fcaa-41d2-bbb6-0cf9b1627593 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:56:14.366492 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6aa8a86-fcaa-41d2-bbb6-0cf9b1627593 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:56:14.366623 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6aa8a86-fcaa-41d2-bbb6-0cf9b1627593 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:56:14.391374 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-a6aa8a86-fcaa-41d2-bbb6-0cf9b1627593 None None] MFA Rules not processed for user `c18a92a796934277ad64a51ef3f7bb23`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:56:14.391374 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-a6aa8a86-fcaa-41d2-bbb6-0cf9b1627593 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:56:14.399678 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 955/1919] 10.222.0.65 () {58 vars in 1009 bytes} [Thu Oct 27 09:56:14 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 09:56:14.416818 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159a06dc-d9f3-444a-9ba5-1abcf4eb2e4a service swift] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:56:14.428667 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159a06dc-d9f3-444a-9ba5-1abcf4eb2e4a service swift] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:56:14.435991 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da920ab-8845-4243-99e6-7fc81b728cab service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e32fc35c8b467e9604b325cf1527aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc2e3a7a1bcc480891c0b433291c00b1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:56:14.435991 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da920ab-8845-4243-99e6-7fc81b728cab service swift] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:56:14.435991 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da920ab-8845-4243-99e6-7fc81b728cab service swift] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:56:14.435991 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da920ab-8845-4243-99e6-7fc81b728cab service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:56:14.450834 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da920ab-8845-4243-99e6-7fc81b728cab service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:56:14.452677 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da920ab-8845-4243-99e6-7fc81b728cab service swift] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:56:14.465574 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 965/1920] 10.222.0.65 () {60 vars in 1384 bytes} [Thu Oct 27 09:56:14 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 27 09:56:18.903758 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a916b485-49af-4683-b17c-c7d465ccb20a None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:56:18.904370 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a916b485-49af-4683-b17c-c7d465ccb20a None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:56:18.904675 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a916b485-49af-4683-b17c-c7d465ccb20a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:56:18.939842 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-a916b485-49af-4683-b17c-c7d465ccb20a None None] MFA Rules not processed for user `cd9d226e6d994e769c1954a9c5bd4fcf`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:56:18.943034 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-a916b485-49af-4683-b17c-c7d465ccb20a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:56:18.950817 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 956/1921] 10.222.0.65 () {58 vars in 958 bytes} [Thu Oct 27 09:56:18 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 09:56:24.045199 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a2bbd7-1c08-490a-b300-276d2fedc3ea None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:56:24.046763 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a2bbd7-1c08-490a-b300-276d2fedc3ea None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:56:24.047239 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a2bbd7-1c08-490a-b300-276d2fedc3ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:56:24.072639 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-b7a2bbd7-1c08-490a-b300-276d2fedc3ea None None] MFA Rules not processed for user `c18a92a796934277ad64a51ef3f7bb23`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:56:24.074630 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-b7a2bbd7-1c08-490a-b300-276d2fedc3ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:56:24.084225 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 966/1922] 10.222.0.65 () {58 vars in 1009 bytes} [Thu Oct 27 09:56:24 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 09:56:24.103585 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a916b485-49af-4683-b17c-c7d465ccb20a None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:56:24.119409 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a916b485-49af-4683-b17c-c7d465ccb20a None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:56:24.127071 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcb4fe2-c8a2-4285-a899-d5ac314fb670 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e32fc35c8b467e9604b325cf1527aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc2e3a7a1bcc480891c0b433291c00b1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:56:24.127956 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcb4fe2-c8a2-4285-a899-d5ac314fb670 service swift] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:56:24.128581 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcb4fe2-c8a2-4285-a899-d5ac314fb670 service swift] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:56:24.129054 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcb4fe2-c8a2-4285-a899-d5ac314fb670 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:56:24.142858 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbcb4fe2-c8a2-4285-a899-d5ac314fb670 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:56:24.144617 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbcb4fe2-c8a2-4285-a899-d5ac314fb670 service swift] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:56:24.154193 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 957/1923] 10.222.0.65 () {60 vars in 1384 bytes} [Thu Oct 27 09:56:24 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 27 09:56:34.064778 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=33 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:56:34.150203 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=70 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:56:49.200674 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc334e6-6166-4af9-93dd-dc30246b8dc7 None None] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:56:49.201282 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc334e6-6166-4af9-93dd-dc30246b8dc7 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:56:49.218966 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc334e6-6166-4af9-93dd-dc30246b8dc7 None None] PATH_INFO: `/` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:56:49.222281 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 967/1924] 10.222.0.65 () {54 vars in 921 bytes} [Thu Oct 27 09:56:49 2022] GET /identity => generated 270 bytes in 22 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 09:56:49.228039 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0d990b-7cea-4917-9a76-4fbe71a19f8d None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:56:49.228623 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0d990b-7cea-4917-9a76-4fbe71a19f8d None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:56:49.228623 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0d990b-7cea-4917-9a76-4fbe71a19f8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:56:49.259189 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-9f0d990b-7cea-4917-9a76-4fbe71a19f8d None None] MFA Rules not processed for user `fd0d23ef039d4f1591a589d302ef165f`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:56:49.260569 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-9f0d990b-7cea-4917-9a76-4fbe71a19f8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:56:49.341202 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 958/1925] 10.222.0.65 () {58 vars in 1018 bytes} [Thu Oct 27 09:56:49 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 09:56:49.354775 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc334e6-6166-4af9-93dd-dc30246b8dc7 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:56:49.369567 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc334e6-6166-4af9-93dd-dc30246b8dc7 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:56:49.375172 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d19c12b-171c-4e6b-bb1d-d347be3cef8f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4b0886666584397be686ee02a505269', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc2e3a7a1bcc480891c0b433291c00b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:56:49.376175 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d19c12b-171c-4e6b-bb1d-d347be3cef8f service glance] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:56:49.376472 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d19c12b-171c-4e6b-bb1d-d347be3cef8f service glance] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:56:49.376790 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d19c12b-171c-4e6b-bb1d-d347be3cef8f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:56:49.390303 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d19c12b-171c-4e6b-bb1d-d347be3cef8f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:56:49.397317 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d19c12b-171c-4e6b-bb1d-d347be3cef8f service glance] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:56:49.412737 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 968/1926] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Oct 27 09:56:49 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 09:56:49.670304 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcacc557-badd-44cb-8295-89ab19b165de None None] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:56:49.672689 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcacc557-badd-44cb-8295-89ab19b165de None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:56:49.672689 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcacc557-badd-44cb-8295-89ab19b165de None None] PATH_INFO: `/` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:56:49.672689 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 959/1927] 10.222.0.65 () {54 vars in 921 bytes} [Thu Oct 27 09:56:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 27 09:56:49.677343 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f9d85a-e189-4d28-995a-4a2e01625709 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:56:49.677637 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f9d85a-e189-4d28-995a-4a2e01625709 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:56:49.677917 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f9d85a-e189-4d28-995a-4a2e01625709 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:56:49.698461 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-f5f9d85a-e189-4d28-995a-4a2e01625709 None None] MFA Rules not processed for user `6191cc41efa74f46b49022cf387f7a4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:56:49.699719 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-f5f9d85a-e189-4d28-995a-4a2e01625709 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:56:49.754269 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 969/1928] 10.222.0.65 () {58 vars in 1018 bytes} [Thu Oct 27 09:56:49 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 09:56:49.766141 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcacc557-badd-44cb-8295-89ab19b165de None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:56:49.778200 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcacc557-badd-44cb-8295-89ab19b165de None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:56:49.781853 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7590c689-06cd-42ee-ae73-e41ecff9c9c2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6191cc41efa74f46b49022cf387f7a4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc2e3a7a1bcc480891c0b433291c00b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:56:49.782445 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7590c689-06cd-42ee-ae73-e41ecff9c9c2 service neutron] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:56:49.782757 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7590c689-06cd-42ee-ae73-e41ecff9c9c2 service neutron] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:56:49.783039 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7590c689-06cd-42ee-ae73-e41ecff9c9c2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:56:49.790634 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7590c689-06cd-42ee-ae73-e41ecff9c9c2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:56:49.792067 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7590c689-06cd-42ee-ae73-e41ecff9c9c2 service neutron] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:56:49.799924 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 960/1929] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Oct 27 09:56:49 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 09:56:49.885280 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e649b5-57e5-4f57-acbb-2bc494a0c95d None None] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:56:49.885577 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e649b5-57e5-4f57-acbb-2bc494a0c95d None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:56:49.885856 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e649b5-57e5-4f57-acbb-2bc494a0c95d None None] PATH_INFO: `/` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:56:49.887295 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 970/1930] 10.222.0.65 () {54 vars in 921 bytes} [Thu Oct 27 09:56:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 09:56:49.908714 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b986ccd-6bd9-4f11-b193-915e29acf809 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:56:49.908714 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b986ccd-6bd9-4f11-b193-915e29acf809 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:56:49.908714 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b986ccd-6bd9-4f11-b193-915e29acf809 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:56:49.926827 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-8b986ccd-6bd9-4f11-b193-915e29acf809 None None] MFA Rules not processed for user `fd0d23ef039d4f1591a589d302ef165f`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:56:49.929825 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-8b986ccd-6bd9-4f11-b193-915e29acf809 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:56:49.938111 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 961/1931] 10.222.0.65 () {58 vars in 1018 bytes} [Thu Oct 27 09:56:49 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 09:56:49.950704 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e649b5-57e5-4f57-acbb-2bc494a0c95d None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:56:49.955476 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-00e649b5-57e5-4f57-acbb-2bc494a0c95d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:56:49.970101 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e649b5-57e5-4f57-acbb-2bc494a0c95d None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:56:49.974945 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f0d00a-732c-4aca-a656-8331ba3b5687 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6191cc41efa74f46b49022cf387f7a4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc2e3a7a1bcc480891c0b433291c00b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:56:49.975555 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f0d00a-732c-4aca-a656-8331ba3b5687 service neutron] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:56:49.975835 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f0d00a-732c-4aca-a656-8331ba3b5687 service neutron] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:56:49.976180 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f0d00a-732c-4aca-a656-8331ba3b5687 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:56:49.986498 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f0d00a-732c-4aca-a656-8331ba3b5687 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:56:49.989078 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f0d00a-732c-4aca-a656-8331ba3b5687 service neutron] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:56:50.000754 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 971/1932] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Oct 27 09:56:49 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 09:56:54.448286 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e67a3a-28c2-4873-a30c-e63cb7dde694 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:56:54.448813 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e67a3a-28c2-4873-a30c-e63cb7dde694 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:56:54.448925 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e67a3a-28c2-4873-a30c-e63cb7dde694 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:56:54.473645 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-e8e67a3a-28c2-4873-a30c-e63cb7dde694 None None] MFA Rules not processed for user `c18a92a796934277ad64a51ef3f7bb23`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:56:54.476233 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-e8e67a3a-28c2-4873-a30c-e63cb7dde694 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:56:54.483899 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 962/1933] 10.222.0.65 () {58 vars in 1009 bytes} [Thu Oct 27 09:56:54 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 09:56:54.506412 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f0d00a-732c-4aca-a656-8331ba3b5687 service neutron] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:56:54.517687 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f0d00a-732c-4aca-a656-8331ba3b5687 service neutron] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:56:54.523097 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c14ec4-1184-4b15-acf9-f76510ee4159 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e32fc35c8b467e9604b325cf1527aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc2e3a7a1bcc480891c0b433291c00b1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:56:54.523694 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c14ec4-1184-4b15-acf9-f76510ee4159 service swift] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:56:54.523979 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c14ec4-1184-4b15-acf9-f76510ee4159 service swift] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:56:54.524280 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c14ec4-1184-4b15-acf9-f76510ee4159 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:56:54.533078 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c14ec4-1184-4b15-acf9-f76510ee4159 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:56:54.534641 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c14ec4-1184-4b15-acf9-f76510ee4159 service swift] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:56:54.544383 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 972/1934] 10.222.0.65 () {60 vars in 1384 bytes} [Thu Oct 27 09:56:54 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 27 09:57:04.466951 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=43 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:57:04.541154 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=41 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:57:10.521781 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e67a3a-28c2-4873-a30c-e63cb7dde694 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:57:10.531834 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e67a3a-28c2-4873-a30c-e63cb7dde694 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:57:10.535429 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a691f91-9a68-4dee-a8e7-76f2c0cbab27 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6191cc41efa74f46b49022cf387f7a4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc2e3a7a1bcc480891c0b433291c00b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:57:10.536027 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a691f91-9a68-4dee-a8e7-76f2c0cbab27 service neutron] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:57:10.536308 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a691f91-9a68-4dee-a8e7-76f2c0cbab27 service neutron] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:57:10.536580 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a691f91-9a68-4dee-a8e7-76f2c0cbab27 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:57:10.546510 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a691f91-9a68-4dee-a8e7-76f2c0cbab27 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:57:10.547970 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a691f91-9a68-4dee-a8e7-76f2c0cbab27 service neutron] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:57:10.557880 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 963/1935] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Oct 27 09:57:10 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 09:57:18.428287 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84bd22d-93bc-4fbf-93ad-cf3d45bd3e57 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:57:18.428808 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84bd22d-93bc-4fbf-93ad-cf3d45bd3e57 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:57:18.428808 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84bd22d-93bc-4fbf-93ad-cf3d45bd3e57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:57:18.448894 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-a84bd22d-93bc-4fbf-93ad-cf3d45bd3e57 None None] MFA Rules not processed for user `94fd43de1d8343d18e229b6e9429ce66`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:57:18.450099 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-a84bd22d-93bc-4fbf-93ad-cf3d45bd3e57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:57:18.508749 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 973/1936] 10.222.0.65 () {58 vars in 958 bytes} [Thu Oct 27 09:57:18 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 09:57:20.553249 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=6 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:57:23.393752 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacf30ae-6a05-43a2-8a37-97f3b4b882d3 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:57:23.394344 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacf30ae-6a05-43a2-8a37-97f3b4b882d3 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:57:23.394344 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacf30ae-6a05-43a2-8a37-97f3b4b882d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:57:23.414302 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-eacf30ae-6a05-43a2-8a37-97f3b4b882d3 None None] MFA Rules not processed for user `c18a92a796934277ad64a51ef3f7bb23`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:57:23.415585 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-eacf30ae-6a05-43a2-8a37-97f3b4b882d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:57:23.423919 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 964/1937] 10.222.0.65 () {58 vars in 967 bytes} [Thu Oct 27 09:57:23 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 09:57:23.438193 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84bd22d-93bc-4fbf-93ad-cf3d45bd3e57 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:57:23.450246 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84bd22d-93bc-4fbf-93ad-cf3d45bd3e57 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:57:23.455707 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb047c39-0a46-4df6-8538-4df4611b2e6c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e32fc35c8b467e9604b325cf1527aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc2e3a7a1bcc480891c0b433291c00b1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:57:23.456321 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb047c39-0a46-4df6-8538-4df4611b2e6c service swift] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:57:23.456605 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb047c39-0a46-4df6-8538-4df4611b2e6c service swift] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:57:23.456883 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb047c39-0a46-4df6-8538-4df4611b2e6c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:57:23.465648 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb047c39-0a46-4df6-8538-4df4611b2e6c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:57:23.467826 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb047c39-0a46-4df6-8538-4df4611b2e6c service swift] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:57:23.476120 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 974/1938] 10.222.0.65 () {60 vars in 1384 bytes} [Thu Oct 27 09:57:23 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 27 09:57:33.409344 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=3 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:57:33.472687 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=31 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:57:34.664643 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacf30ae-6a05-43a2-8a37-97f3b4b882d3 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:57:34.674385 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacf30ae-6a05-43a2-8a37-97f3b4b882d3 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:57:34.678330 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166ab88f-da02-42eb-b3ac-9580de59274f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6191cc41efa74f46b49022cf387f7a4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc2e3a7a1bcc480891c0b433291c00b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:57:34.678969 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166ab88f-da02-42eb-b3ac-9580de59274f service neutron] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:57:34.679257 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166ab88f-da02-42eb-b3ac-9580de59274f service neutron] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:57:34.679531 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166ab88f-da02-42eb-b3ac-9580de59274f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:57:34.681269 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-166ab88f-da02-42eb-b3ac-9580de59274f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:57:34.696416 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166ab88f-da02-42eb-b3ac-9580de59274f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:57:34.697916 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166ab88f-da02-42eb-b3ac-9580de59274f service neutron] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:57:34.710062 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 965/1939] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Oct 27 09:57:34 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 09:57:35.910891 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb047c39-0a46-4df6-8538-4df4611b2e6c service swift] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:57:35.921101 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb047c39-0a46-4df6-8538-4df4611b2e6c service swift] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:57:35.925679 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf8a425-1827-438f-b374-23af2976bc58 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6191cc41efa74f46b49022cf387f7a4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc2e3a7a1bcc480891c0b433291c00b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:57:35.926284 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf8a425-1827-438f-b374-23af2976bc58 service neutron] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:57:35.926597 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf8a425-1827-438f-b374-23af2976bc58 service neutron] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:57:35.926898 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf8a425-1827-438f-b374-23af2976bc58 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:57:35.928647 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-baf8a425-1827-438f-b374-23af2976bc58 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:57:35.943070 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf8a425-1827-438f-b374-23af2976bc58 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:57:35.944510 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf8a425-1827-438f-b374-23af2976bc58 service neutron] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:57:35.956258 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 975/1940] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Oct 27 09:57:35 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 09:57:43.451602 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166ab88f-da02-42eb-b3ac-9580de59274f service neutron] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:57:43.453120 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-166ab88f-da02-42eb-b3ac-9580de59274f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:57:43.467422 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166ab88f-da02-42eb-b3ac-9580de59274f service neutron] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:57:43.473984 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bccfd5-4d6e-41d8-8b85-86a71babbfe6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd0d23ef039d4f1591a589d302ef165f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc2e3a7a1bcc480891c0b433291c00b1', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:57:43.474830 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bccfd5-4d6e-41d8-8b85-86a71babbfe6 service nova] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:57:43.475148 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bccfd5-4d6e-41d8-8b85-86a71babbfe6 service nova] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:57:43.475422 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bccfd5-4d6e-41d8-8b85-86a71babbfe6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:57:43.477147 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-40bccfd5-4d6e-41d8-8b85-86a71babbfe6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:57:43.540928 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40bccfd5-4d6e-41d8-8b85-86a71babbfe6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:57:43.542766 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40bccfd5-4d6e-41d8-8b85-86a71babbfe6 service nova] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:57:43.552651 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 966/1941] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Oct 27 09:57:43 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 09:57:45.950923 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=6 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:57:49.415720 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf8a425-1827-438f-b374-23af2976bc58 service neutron] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:57:49.417159 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-baf8a425-1827-438f-b374-23af2976bc58 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:57:49.431794 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf8a425-1827-438f-b374-23af2976bc58 service neutron] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:57:49.437543 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e11a84c-bcad-4bd8-8279-681d4c2239dc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd0d23ef039d4f1591a589d302ef165f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc2e3a7a1bcc480891c0b433291c00b1', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:57:49.438154 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e11a84c-bcad-4bd8-8279-681d4c2239dc service nova] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:57:49.438436 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e11a84c-bcad-4bd8-8279-681d4c2239dc service nova] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:57:49.439129 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e11a84c-bcad-4bd8-8279-681d4c2239dc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:57:49.440647 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-4e11a84c-bcad-4bd8-8279-681d4c2239dc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:57:49.502936 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e11a84c-bcad-4bd8-8279-681d4c2239dc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:57:49.504542 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e11a84c-bcad-4bd8-8279-681d4c2239dc service nova] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:57:49.514109 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 976/1942] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Oct 27 09:57:49 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 09:57:53.547615 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=34 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:57:55.379228 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cd6dd0-8b58-46e8-b936-0bb8fcf6287b None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:57:55.379870 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cd6dd0-8b58-46e8-b936-0bb8fcf6287b None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:57:55.379870 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cd6dd0-8b58-46e8-b936-0bb8fcf6287b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:57:55.400331 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-67cd6dd0-8b58-46e8-b936-0bb8fcf6287b None None] MFA Rules not processed for user `2acf9b6c3a394be389cd17d7fade3cf4`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:57:55.401556 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-67cd6dd0-8b58-46e8-b936-0bb8fcf6287b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:57:55.408788 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 967/1943] 10.222.0.65 () {58 vars in 958 bytes} [Thu Oct 27 09:57:55 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 09:57:55.723856 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e11a84c-bcad-4bd8-8279-681d4c2239dc service nova] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:57:55.734353 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e11a84c-bcad-4bd8-8279-681d4c2239dc service nova] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:57:55.738003 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433879b5-a935-41fb-abce-ad7787203c25 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6191cc41efa74f46b49022cf387f7a4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc2e3a7a1bcc480891c0b433291c00b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:57:55.738644 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433879b5-a935-41fb-abce-ad7787203c25 service neutron] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:57:55.738930 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433879b5-a935-41fb-abce-ad7787203c25 service neutron] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:57:55.739217 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433879b5-a935-41fb-abce-ad7787203c25 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:57:55.740931 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-433879b5-a935-41fb-abce-ad7787203c25 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:57:55.750738 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433879b5-a935-41fb-abce-ad7787203c25 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:57:55.752175 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433879b5-a935-41fb-abce-ad7787203c25 service neutron] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:57:55.760442 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 977/1944] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Oct 27 09:57:55 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 09:57:57.160300 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cd6dd0-8b58-46e8-b936-0bb8fcf6287b None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:57:57.161699 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-67cd6dd0-8b58-46e8-b936-0bb8fcf6287b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:57:57.241100 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cd6dd0-8b58-46e8-b936-0bb8fcf6287b None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:57:57.246315 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6705cb68-3055-41a1-949b-b1d7f95d51f8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8c47ff5d72943f6bab09b5df6198d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc2e3a7a1bcc480891c0b433291c00b1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:57:57.246956 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6705cb68-3055-41a1-949b-b1d7f95d51f8 service placement] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:57:57.247235 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6705cb68-3055-41a1-949b-b1d7f95d51f8 service placement] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:57:57.247505 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6705cb68-3055-41a1-949b-b1d7f95d51f8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:57:57.249282 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-6705cb68-3055-41a1-949b-b1d7f95d51f8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:57:57.261196 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6705cb68-3055-41a1-949b-b1d7f95d51f8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:57:57.262862 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6705cb68-3055-41a1-949b-b1d7f95d51f8 service placement] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:57:57.274238 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 968/1945] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Oct 27 09:57:57 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 09:58:05.756558 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=34 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:58:07.268816 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=35 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:58:09.450590 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433879b5-a935-41fb-abce-ad7787203c25 service neutron] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:58:09.459446 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433879b5-a935-41fb-abce-ad7787203c25 service neutron] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:58:09.463194 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157360c5-56dc-43a9-9a1d-53d911103443 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6191cc41efa74f46b49022cf387f7a4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc2e3a7a1bcc480891c0b433291c00b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:58:09.465028 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157360c5-56dc-43a9-9a1d-53d911103443 service neutron] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:58:09.465359 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157360c5-56dc-43a9-9a1d-53d911103443 service neutron] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:58:09.465594 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157360c5-56dc-43a9-9a1d-53d911103443 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:58:09.467387 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-157360c5-56dc-43a9-9a1d-53d911103443 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:58:09.477050 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157360c5-56dc-43a9-9a1d-53d911103443 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:58:09.478467 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157360c5-56dc-43a9-9a1d-53d911103443 service neutron] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:58:09.488062 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 978/1946] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Oct 27 09:58:09 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 09:58:19.483506 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=6 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:58:30.728945 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6705cb68-3055-41a1-949b-b1d7f95d51f8 service placement] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:58:30.741376 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6705cb68-3055-41a1-949b-b1d7f95d51f8 service placement] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:58:30.746916 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bed3fe-52e5-401e-aa4e-052e91f11345 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd0d23ef039d4f1591a589d302ef165f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc2e3a7a1bcc480891c0b433291c00b1', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:58:30.747514 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bed3fe-52e5-401e-aa4e-052e91f11345 service nova] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:58:30.747796 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bed3fe-52e5-401e-aa4e-052e91f11345 service nova] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:58:30.748068 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bed3fe-52e5-401e-aa4e-052e91f11345 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:58:30.749788 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-d2bed3fe-52e5-401e-aa4e-052e91f11345 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:58:30.810012 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2bed3fe-52e5-401e-aa4e-052e91f11345 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:58:30.811571 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2bed3fe-52e5-401e-aa4e-052e91f11345 service nova] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:58:30.821828 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 969/1947] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Oct 27 09:58:30 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 09:58:32.740927 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157360c5-56dc-43a9-9a1d-53d911103443 service neutron] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:58:32.742333 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-157360c5-56dc-43a9-9a1d-53d911103443 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:58:32.800399 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157360c5-56dc-43a9-9a1d-53d911103443 service neutron] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:58:32.803899 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b79cb56-4412-42ff-9b81-7d9b6297b17a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8e5d5f04c4741bb86ca4a0f667d4ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc2e3a7a1bcc480891c0b433291c00b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:58:32.804500 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b79cb56-4412-42ff-9b81-7d9b6297b17a service cinder] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:58:32.804787 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b79cb56-4412-42ff-9b81-7d9b6297b17a service cinder] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:58:32.805063 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b79cb56-4412-42ff-9b81-7d9b6297b17a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:58:32.806859 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-5b79cb56-4412-42ff-9b81-7d9b6297b17a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:58:32.819019 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b79cb56-4412-42ff-9b81-7d9b6297b17a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:58:32.820442 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b79cb56-4412-42ff-9b81-7d9b6297b17a service cinder] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:58:32.829899 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 979/1948] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Oct 27 09:58:32 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 09:58:37.332197 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bed3fe-52e5-401e-aa4e-052e91f11345 service nova] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:58:37.343593 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bed3fe-52e5-401e-aa4e-052e91f11345 service nova] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:58:37.349821 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e268b35d-7f41-416f-9d82-08e756621b58 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd0d23ef039d4f1591a589d302ef165f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc2e3a7a1bcc480891c0b433291c00b1', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:58:37.350442 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e268b35d-7f41-416f-9d82-08e756621b58 service nova] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:58:37.350745 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e268b35d-7f41-416f-9d82-08e756621b58 service nova] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:58:37.351019 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e268b35d-7f41-416f-9d82-08e756621b58 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:58:37.352760 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-e268b35d-7f41-416f-9d82-08e756621b58 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:58:37.365668 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e268b35d-7f41-416f-9d82-08e756621b58 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:58:37.367895 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e268b35d-7f41-416f-9d82-08e756621b58 service nova] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:58:37.379213 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 970/1949] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Oct 27 09:58:37 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 09:58:42.825392 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=26 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:58:45.847583 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f3791b-d985-4ac9-932f-9ef8be5ea6d3 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:58:45.850086 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f3791b-d985-4ac9-932f-9ef8be5ea6d3 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:58:45.850086 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f3791b-d985-4ac9-932f-9ef8be5ea6d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:58:45.868079 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-06f3791b-d985-4ac9-932f-9ef8be5ea6d3 None None] MFA Rules not processed for user `c46fe9f4b4db4dcb981c5a1a2cc5f463`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:58:45.869295 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-06f3791b-d985-4ac9-932f-9ef8be5ea6d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:58:45.876759 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 980/1950] 10.222.0.65 () {58 vars in 958 bytes} [Thu Oct 27 09:58:45 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 09:58:46.200090 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e268b35d-7f41-416f-9d82-08e756621b58 service nova] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:58:46.211034 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e268b35d-7f41-416f-9d82-08e756621b58 service nova] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:58:46.214836 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4abe19-a282-4342-b441-a4b046999b1e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6191cc41efa74f46b49022cf387f7a4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc2e3a7a1bcc480891c0b433291c00b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:58:46.215442 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4abe19-a282-4342-b441-a4b046999b1e service neutron] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:58:46.215725 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4abe19-a282-4342-b441-a4b046999b1e service neutron] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:58:46.216002 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4abe19-a282-4342-b441-a4b046999b1e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:58:46.217807 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-9e4abe19-a282-4342-b441-a4b046999b1e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:58:46.228452 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4abe19-a282-4342-b441-a4b046999b1e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:58:46.229926 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4abe19-a282-4342-b441-a4b046999b1e service neutron] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:58:46.239288 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 971/1951] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Oct 27 09:58:46 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 09:58:55.862121 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=3 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:58:56.234881 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=40 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:58:58.661010 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f3791b-d985-4ac9-932f-9ef8be5ea6d3 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:58:58.677948 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f3791b-d985-4ac9-932f-9ef8be5ea6d3 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:58:58.684125 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfeef48-b01f-41a6-a731-beefbf2d0bde service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd0d23ef039d4f1591a589d302ef165f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc2e3a7a1bcc480891c0b433291c00b1', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:58:58.684985 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfeef48-b01f-41a6-a731-beefbf2d0bde service nova] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:58:58.685307 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfeef48-b01f-41a6-a731-beefbf2d0bde service nova] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:58:58.685603 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfeef48-b01f-41a6-a731-beefbf2d0bde service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:58:58.687398 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-acfeef48-b01f-41a6-a731-beefbf2d0bde service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:58:58.700401 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfeef48-b01f-41a6-a731-beefbf2d0bde service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:58:58.702009 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfeef48-b01f-41a6-a731-beefbf2d0bde service nova] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:58:58.714188 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 981/1952] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Oct 27 09:58:58 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 09:59:01.132943 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4abe19-a282-4342-b441-a4b046999b1e service neutron] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:59:01.142316 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4abe19-a282-4342-b441-a4b046999b1e service neutron] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:59:01.145996 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4db20e-9d73-4e7f-9533-c7606767242d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6191cc41efa74f46b49022cf387f7a4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc2e3a7a1bcc480891c0b433291c00b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:59:01.146620 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4db20e-9d73-4e7f-9533-c7606767242d service neutron] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:59:01.146904 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4db20e-9d73-4e7f-9533-c7606767242d service neutron] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:59:01.147180 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4db20e-9d73-4e7f-9533-c7606767242d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:59:01.148885 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-2f4db20e-9d73-4e7f-9533-c7606767242d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:59:01.216440 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4db20e-9d73-4e7f-9533-c7606767242d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:59:01.216965 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4db20e-9d73-4e7f-9533-c7606767242d service neutron] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:59:01.227363 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 972/1953] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Oct 27 09:59:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 09:59:01.409821 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfeef48-b01f-41a6-a731-beefbf2d0bde service nova] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:59:01.424180 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfeef48-b01f-41a6-a731-beefbf2d0bde service nova] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:59:01.431007 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27602a4b-bb8b-4628-a7fa-458a61a9f0c0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd0d23ef039d4f1591a589d302ef165f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc2e3a7a1bcc480891c0b433291c00b1', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:59:01.431656 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27602a4b-bb8b-4628-a7fa-458a61a9f0c0 service nova] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:59:01.431945 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27602a4b-bb8b-4628-a7fa-458a61a9f0c0 service nova] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:59:01.432227 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27602a4b-bb8b-4628-a7fa-458a61a9f0c0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:59:01.434466 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-27602a4b-bb8b-4628-a7fa-458a61a9f0c0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:59:01.450559 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27602a4b-bb8b-4628-a7fa-458a61a9f0c0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:59:01.455529 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27602a4b-bb8b-4628-a7fa-458a61a9f0c0 service nova] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:59:01.474986 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 982/1954] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Oct 27 09:59:01 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 09:59:04.830302 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4822ded6-1f27-42dc-a669-df768658aa31 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:59:04.830859 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4822ded6-1f27-42dc-a669-df768658aa31 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:59:04.831187 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4822ded6-1f27-42dc-a669-df768658aa31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:59:04.859255 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-4822ded6-1f27-42dc-a669-df768658aa31 None None] MFA Rules not processed for user `15b5a9cc367d490cb4de4b6a2759144a`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:59:04.860537 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-4822ded6-1f27-42dc-a669-df768658aa31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:59:04.873114 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 973/1955] 10.222.0.65 () {58 vars in 958 bytes} [Thu Oct 27 09:59:04 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 09:59:05.787710 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27602a4b-bb8b-4628-a7fa-458a61a9f0c0 service nova] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:59:05.812958 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27602a4b-bb8b-4628-a7fa-458a61a9f0c0 service nova] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:59:05.820749 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed07859-8ef5-4f13-92e9-f3462c0fd352 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8c47ff5d72943f6bab09b5df6198d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc2e3a7a1bcc480891c0b433291c00b1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:59:05.822302 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed07859-8ef5-4f13-92e9-f3462c0fd352 service placement] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:59:05.823930 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed07859-8ef5-4f13-92e9-f3462c0fd352 service placement] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:59:05.824310 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed07859-8ef5-4f13-92e9-f3462c0fd352 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:59:05.827913 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-bed07859-8ef5-4f13-92e9-f3462c0fd352 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:59:05.849033 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed07859-8ef5-4f13-92e9-f3462c0fd352 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:59:05.851459 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed07859-8ef5-4f13-92e9-f3462c0fd352 service placement] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:59:05.877007 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 983/1956] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Oct 27 09:59:05 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 09:59:05.951722 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4822ded6-1f27-42dc-a669-df768658aa31 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:59:05.953914 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-4822ded6-1f27-42dc-a669-df768658aa31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:59:05.974442 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4822ded6-1f27-42dc-a669-df768658aa31 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:59:05.974872 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208fd452-e831-4077-90d2-2e2b0cafed68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:59:05.975640 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208fd452-e831-4077-90d2-2e2b0cafed68 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:59:05.976043 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208fd452-e831-4077-90d2-2e2b0cafed68 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:59:05.976497 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208fd452-e831-4077-90d2-2e2b0cafed68 admin admin] PATH_INFO: `/v3/users/94fd43de1d8343d18e229b6e9429ce66` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:59:05.977683 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208fd452-e831-4077-90d2-2e2b0cafed68 admin admin] RBAC: Authorizing `identity:delete_user(user_id=94fd43de1d8343d18e229b6e9429ce66)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:59:05.979985 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208fd452-e831-4077-90d2-2e2b0cafed68 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:59:06.250643 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-208fd452-e831-4077-90d2-2e2b0cafed68 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '94fd43de1d8343d18e229b6e9429ce66'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:59:06.251358 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-208fd452-e831-4077-90d2-2e2b0cafed68 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '94fd43de1d8343d18e229b6e9429ce66'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:59:06.260767 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-208fd452-e831-4077-90d2-2e2b0cafed68 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '94fd43de1d8343d18e229b6e9429ce66'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:59:06.261490 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-208fd452-e831-4077-90d2-2e2b0cafed68 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '94fd43de1d8343d18e229b6e9429ce66'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:59:06.275559 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-208fd452-e831-4077-90d2-2e2b0cafed68 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '94fd43de1d8343d18e229b6e9429ce66'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:59:06.396036 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 974/1957] 10.222.0.65 () {58 vars in 1224 bytes} [Thu Oct 27 09:59:05 2022] DELETE /identity/v3/users/94fd43de1d8343d18e229b6e9429ce66 => generated 0 bytes in 445 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 09:59:06.689139 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed07859-8ef5-4f13-92e9-f3462c0fd352 service placement] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:59:06.706607 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed07859-8ef5-4f13-92e9-f3462c0fd352 service placement] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:59:06.784362 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97101a42-d699-4dee-a7df-d567d8cd49df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:59:06.784596 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97101a42-d699-4dee-a7df-d567d8cd49df admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:59:06.784865 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97101a42-d699-4dee-a7df-d567d8cd49df admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:59:06.785155 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97101a42-d699-4dee-a7df-d567d8cd49df admin admin] PATH_INFO: `/v3/projects/8cbba5a640c3478daaeae91431680f1e` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:59:06.786801 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97101a42-d699-4dee-a7df-d567d8cd49df admin admin] RBAC: Authorizing `identity:delete_project(project_id=8cbba5a640c3478daaeae91431680f1e)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:59:06.788888 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97101a42-d699-4dee-a7df-d567d8cd49df admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:59:06.957192 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-97101a42-d699-4dee-a7df-d567d8cd49df admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8cbba5a640c3478daaeae91431680f1e', 'request_id': 'req-97101a42-d699-4dee-a7df-d567d8cd49df'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:59:07.024255 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-97101a42-d699-4dee-a7df-d567d8cd49df admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8cbba5a640c3478daaeae91431680f1e', 'request_id': 'req-97101a42-d699-4dee-a7df-d567d8cd49df'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:59:07.031048 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-97101a42-d699-4dee-a7df-d567d8cd49df admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8cbba5a640c3478daaeae91431680f1e', 'request_id': 'req-97101a42-d699-4dee-a7df-d567d8cd49df'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:59:07.045158 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-97101a42-d699-4dee-a7df-d567d8cd49df admin admin] The token cache is being invalidate because project 8cbba5a640c3478daaeae91431680f1e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 09:59:07.045463 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-97101a42-d699-4dee-a7df-d567d8cd49df admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:59:07.046338 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-97101a42-d699-4dee-a7df-d567d8cd49df admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:59:07.047876 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 984/1958] 10.222.0.65 () {58 vars in 1233 bytes} [Thu Oct 27 09:59:06 2022] DELETE /identity/v3/projects/8cbba5a640c3478daaeae91431680f1e => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 09:59:07.053062 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b79950c-8394-4a84-9e0e-99fafa997bd2 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:59:07.053542 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b79950c-8394-4a84-9e0e-99fafa997bd2 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:59:07.053658 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b79950c-8394-4a84-9e0e-99fafa997bd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:59:07.075614 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-6b79950c-8394-4a84-9e0e-99fafa997bd2 None None] MFA Rules not processed for user `b5065084bf664b99bdeac46067cb0f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:59:07.076831 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-6b79950c-8394-4a84-9e0e-99fafa997bd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:59:07.138993 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:59:07.147979 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 975/1959] 10.222.0.65 () {58 vars in 958 bytes} [Thu Oct 27 09:59:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 09:59:07.155719 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813bc61e-5d17-49c8-bfef-12ca2278045d None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:59:07.156120 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813bc61e-5d17-49c8-bfef-12ca2278045d None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:59:07.156411 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813bc61e-5d17-49c8-bfef-12ca2278045d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:59:07.182810 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-813bc61e-5d17-49c8-bfef-12ca2278045d None None] MFA Rules not processed for user `b5065084bf664b99bdeac46067cb0f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:59:07.184057 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-813bc61e-5d17-49c8-bfef-12ca2278045d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:59:07.193232 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 985/1960] 10.222.0.65 () {58 vars in 958 bytes} [Thu Oct 27 09:59:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 09:59:07.199325 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b79950c-8394-4a84-9e0e-99fafa997bd2 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:59:07.223920 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b79950c-8394-4a84-9e0e-99fafa997bd2 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:59:07.229281 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fba4da-66aa-466b-ab3e-3af6798dea43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:59:07.231661 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fba4da-66aa-466b-ab3e-3af6798dea43 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:59:07.231996 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fba4da-66aa-466b-ab3e-3af6798dea43 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:59:07.232497 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fba4da-66aa-466b-ab3e-3af6798dea43 admin admin] PATH_INFO: `/v3/domains` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:59:07.233326 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fba4da-66aa-466b-ab3e-3af6798dea43 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 09:59:07.233788 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fba4da-66aa-466b-ab3e-3af6798dea43 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:59:07.235461 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fba4da-66aa-466b-ab3e-3af6798dea43 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:59:07.269019 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 976/1961] 10.222.0.65 () {58 vars in 1153 bytes} [Thu Oct 27 09:59:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 09:59:07.272998 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813bc61e-5d17-49c8-bfef-12ca2278045d None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:59:07.283415 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813bc61e-5d17-49c8-bfef-12ca2278045d None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:59:07.288220 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a2c72b-5745-4ece-97ab-393f83e75c92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:59:07.288837 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a2c72b-5745-4ece-97ab-393f83e75c92 admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:59:07.298469 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a2c72b-5745-4ece-97ab-393f83e75c92 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:59:07.298469 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a2c72b-5745-4ece-97ab-393f83e75c92 admin admin] PATH_INFO: `/v3/projects` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:59:07.298469 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a2c72b-5745-4ece-97ab-393f83e75c92 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:59:07.298469 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a2c72b-5745-4ece-97ab-393f83e75c92 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:59:07.395289 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 986/1962] 10.222.0.65 () {60 vars in 1153 bytes} [Thu Oct 27 09:59:07 2022] POST /identity/v3/projects => generated 379 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 09:59:07.399731 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fba4da-66aa-466b-ab3e-3af6798dea43 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:59:07.411944 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fba4da-66aa-466b-ab3e-3af6798dea43 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:59:07.474073 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0673c738-8583-4221-85d9-90c2267b5afc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:59:07.474769 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0673c738-8583-4221-85d9-90c2267b5afc admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:59:07.475053 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0673c738-8583-4221-85d9-90c2267b5afc admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:59:07.475322 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0673c738-8583-4221-85d9-90c2267b5afc admin admin] PATH_INFO: `/v3/users` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:59:07.475970 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0673c738-8583-4221-85d9-90c2267b5afc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:59:07.478472 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0673c738-8583-4221-85d9-90c2267b5afc admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:59:07.586319 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 977/1963] 10.222.0.65 () {60 vars in 1144 bytes} [Thu Oct 27 09:59:07 2022] POST /identity/v3/users => generated 290 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 09:59:07.588779 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a2c72b-5745-4ece-97ab-393f83e75c92 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:59:07.599441 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a2c72b-5745-4ece-97ab-393f83e75c92 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:59:07.604378 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c08ac1-33c3-4ff9-a32c-f60ca5e190db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:59:07.614362 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c08ac1-33c3-4ff9-a32c-f60ca5e190db admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:59:07.614362 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c08ac1-33c3-4ff9-a32c-f60ca5e190db admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:59:07.614362 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c08ac1-33c3-4ff9-a32c-f60ca5e190db admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:59:07.614362 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c08ac1-33c3-4ff9-a32c-f60ca5e190db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:59:07.614362 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c08ac1-33c3-4ff9-a32c-f60ca5e190db admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:59:07.619728 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 987/1964] 10.222.0.65 () {58 vars in 1122 bytes} [Thu Oct 27 09:59:07 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 09:59:07.623725 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0673c738-8583-4221-85d9-90c2267b5afc admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:59:07.633996 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0673c738-8583-4221-85d9-90c2267b5afc admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:59:07.639490 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626bfe82-b2d7-400f-8b9f-d44b3be5865a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:59:07.640088 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626bfe82-b2d7-400f-8b9f-d44b3be5865a admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:59:07.640375 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626bfe82-b2d7-400f-8b9f-d44b3be5865a admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:59:07.640654 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626bfe82-b2d7-400f-8b9f-d44b3be5865a admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:59:07.641293 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626bfe82-b2d7-400f-8b9f-d44b3be5865a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:59:07.642975 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626bfe82-b2d7-400f-8b9f-d44b3be5865a admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:59:07.655733 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 978/1965] 10.222.0.65 () {58 vars in 1122 bytes} [Thu Oct 27 09:59:07 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 09:59:07.659985 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c08ac1-33c3-4ff9-a32c-f60ca5e190db admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:59:07.671337 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c08ac1-33c3-4ff9-a32c-f60ca5e190db admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:59:07.677226 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3910e1b1-b2b2-450d-b021-8cf751ddd037 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:59:07.677226 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3910e1b1-b2b2-450d-b021-8cf751ddd037 admin admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:59:07.677226 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3910e1b1-b2b2-450d-b021-8cf751ddd037 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:59:07.677226 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3910e1b1-b2b2-450d-b021-8cf751ddd037 admin admin] PATH_INFO: `/v3/projects/72cf1ba9f0cd407884269118dfabd320/users/06bab61e5a1e49429fa32ad1a811face/roles/43543ce1450245af9661cb017bac17bd` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:59:07.685881 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:59:07.693251 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3910e1b1-b2b2-450d-b021-8cf751ddd037 admin admin] RBAC: Authorizing `identity:create_grant(project_id=72cf1ba9f0cd407884269118dfabd320, user_id=06bab61e5a1e49429fa32ad1a811face, role_id=43543ce1450245af9661cb017bac17bd)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:59:07.696237 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3910e1b1-b2b2-450d-b021-8cf751ddd037 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:59:07.842437 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 988/1966] 10.222.0.65 () {60 vars in 1483 bytes} [Thu Oct 27 09:59:07 2022] PUT /identity/v3/projects/72cf1ba9f0cd407884269118dfabd320/users/06bab61e5a1e49429fa32ad1a811face/roles/43543ce1450245af9661cb017bac17bd => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 09:59:07.854356 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc2476d-6eac-40d8-bc19-85b42d39d8f9 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:59:07.854738 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc2476d-6eac-40d8-bc19-85b42d39d8f9 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:59:07.855018 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc2476d-6eac-40d8-bc19-85b42d39d8f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:59:07.884611 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-6dc2476d-6eac-40d8-bc19-85b42d39d8f9 None None] MFA Rules not processed for user `06bab61e5a1e49429fa32ad1a811face`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:59:07.886024 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-6dc2476d-6eac-40d8-bc19-85b42d39d8f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:59:07.955477 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 979/1967] 10.222.0.65 () {58 vars in 958 bytes} [Thu Oct 27 09:59:07 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 09:59:07.968506 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3910e1b1-b2b2-450d-b021-8cf751ddd037 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:59:08.037112 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3910e1b1-b2b2-450d-b021-8cf751ddd037 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:59:08.041982 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efeee17-f1fb-48c0-9b41-737370d04c11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:59:08.042625 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efeee17-f1fb-48c0-9b41-737370d04c11 admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:59:08.042919 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efeee17-f1fb-48c0-9b41-737370d04c11 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:59:08.043196 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efeee17-f1fb-48c0-9b41-737370d04c11 admin admin] PATH_INFO: `/v3/projects` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:59:08.043880 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7efeee17-f1fb-48c0-9b41-737370d04c11 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:59:08.045815 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7efeee17-f1fb-48c0-9b41-737370d04c11 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:59:08.163890 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 989/1968] 10.222.0.65 () {60 vars in 1153 bytes} [Thu Oct 27 09:59:07 2022] POST /identity/v3/projects => generated 381 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 09:59:08.169200 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc2476d-6eac-40d8-bc19-85b42d39d8f9 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:59:08.180338 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc2476d-6eac-40d8-bc19-85b42d39d8f9 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:59:08.230472 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:59:08.237330 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d3dd2e-35e7-41ba-a37f-5dc91babe059 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:59:08.237940 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d3dd2e-35e7-41ba-a37f-5dc91babe059 admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:59:08.238216 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d3dd2e-35e7-41ba-a37f-5dc91babe059 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:59:08.238487 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d3dd2e-35e7-41ba-a37f-5dc91babe059 admin admin] PATH_INFO: `/v3/users` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:59:08.239149 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d3dd2e-35e7-41ba-a37f-5dc91babe059 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:59:08.241076 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d3dd2e-35e7-41ba-a37f-5dc91babe059 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:59:08.320114 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 980/1969] 10.222.0.65 () {60 vars in 1144 bytes} [Thu Oct 27 09:59:08 2022] POST /identity/v3/users => generated 297 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 09:59:08.322301 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efeee17-f1fb-48c0-9b41-737370d04c11 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:59:08.332421 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efeee17-f1fb-48c0-9b41-737370d04c11 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:59:08.338709 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade3e3fb-f4d9-43b6-a69c-c4cd8651cf2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:59:08.339405 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade3e3fb-f4d9-43b6-a69c-c4cd8651cf2a admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:59:08.339756 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade3e3fb-f4d9-43b6-a69c-c4cd8651cf2a admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:59:08.340122 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade3e3fb-f4d9-43b6-a69c-c4cd8651cf2a admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:59:08.340823 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade3e3fb-f4d9-43b6-a69c-c4cd8651cf2a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:59:08.342494 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade3e3fb-f4d9-43b6-a69c-c4cd8651cf2a admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:59:08.356179 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 990/1970] 10.222.0.65 () {58 vars in 1122 bytes} [Thu Oct 27 09:59:08 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 09:59:08.360648 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d3dd2e-35e7-41ba-a37f-5dc91babe059 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:59:08.372095 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d3dd2e-35e7-41ba-a37f-5dc91babe059 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:59:08.377977 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0fed42-114d-40c9-a34e-0d4aff9af7bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:59:08.378767 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0fed42-114d-40c9-a34e-0d4aff9af7bf admin admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:59:08.379534 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0fed42-114d-40c9-a34e-0d4aff9af7bf admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:59:08.379699 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0fed42-114d-40c9-a34e-0d4aff9af7bf admin admin] PATH_INFO: `/v3/projects/82ee81528f7e42b590c3748a32bf4c2e/users/2e17fbacb6194bdd8d43fc3ff470f686/roles/6ad17b9f9dea4b66ab2da3677d7e715d` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:59:08.396423 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0fed42-114d-40c9-a34e-0d4aff9af7bf admin admin] RBAC: Authorizing `identity:create_grant(project_id=82ee81528f7e42b590c3748a32bf4c2e, user_id=2e17fbacb6194bdd8d43fc3ff470f686, role_id=6ad17b9f9dea4b66ab2da3677d7e715d)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:59:08.399242 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0fed42-114d-40c9-a34e-0d4aff9af7bf admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:59:08.482949 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 981/1971] 10.222.0.65 () {60 vars in 1483 bytes} [Thu Oct 27 09:59:08 2022] PUT /identity/v3/projects/82ee81528f7e42b590c3748a32bf4c2e/users/2e17fbacb6194bdd8d43fc3ff470f686/roles/6ad17b9f9dea4b66ab2da3677d7e715d => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 09:59:08.487292 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade3e3fb-f4d9-43b6-a69c-c4cd8651cf2a admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:59:08.498032 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade3e3fb-f4d9-43b6-a69c-c4cd8651cf2a admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:59:08.574913 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92eeb65e-8bf8-40b2-af85-17fd3addd8e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:59:08.575593 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92eeb65e-8bf8-40b2-af85-17fd3addd8e1 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:59:08.575876 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92eeb65e-8bf8-40b2-af85-17fd3addd8e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:59:08.576155 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92eeb65e-8bf8-40b2-af85-17fd3addd8e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:59:08.576800 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92eeb65e-8bf8-40b2-af85-17fd3addd8e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:59:08.578403 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92eeb65e-8bf8-40b2-af85-17fd3addd8e1 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:59:08.590758 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 991/1972] 10.222.0.65 () {58 vars in 1122 bytes} [Thu Oct 27 09:59:08 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 09:59:08.595093 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0fed42-114d-40c9-a34e-0d4aff9af7bf admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:59:08.606770 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0fed42-114d-40c9-a34e-0d4aff9af7bf admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:59:08.614076 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d30f743-df11-45c7-afa5-6a0123507297 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:59:08.614875 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d30f743-df11-45c7-afa5-6a0123507297 admin admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:59:08.615333 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d30f743-df11-45c7-afa5-6a0123507297 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:59:08.615575 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d30f743-df11-45c7-afa5-6a0123507297 admin admin] PATH_INFO: `/v3/projects/82ee81528f7e42b590c3748a32bf4c2e/users/2e17fbacb6194bdd8d43fc3ff470f686/roles/6ad17b9f9dea4b66ab2da3677d7e715d` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:59:08.617511 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d30f743-df11-45c7-afa5-6a0123507297 admin admin] RBAC: Authorizing `identity:create_grant(project_id=82ee81528f7e42b590c3748a32bf4c2e, user_id=2e17fbacb6194bdd8d43fc3ff470f686, role_id=6ad17b9f9dea4b66ab2da3677d7e715d)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:59:08.620337 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d30f743-df11-45c7-afa5-6a0123507297 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:59:08.631682 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 982/1973] 10.222.0.65 () {60 vars in 1483 bytes} [Thu Oct 27 09:59:08 2022] PUT /identity/v3/projects/82ee81528f7e42b590c3748a32bf4c2e/users/2e17fbacb6194bdd8d43fc3ff470f686/roles/6ad17b9f9dea4b66ab2da3677d7e715d => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 09:59:08.642116 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095f7dc7-073f-4e09-9f5c-ec35f948b1dc None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:59:08.642411 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095f7dc7-073f-4e09-9f5c-ec35f948b1dc None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:59:08.642722 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095f7dc7-073f-4e09-9f5c-ec35f948b1dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:59:08.676831 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-095f7dc7-073f-4e09-9f5c-ec35f948b1dc None None] MFA Rules not processed for user `2e17fbacb6194bdd8d43fc3ff470f686`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:59:08.678061 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-095f7dc7-073f-4e09-9f5c-ec35f948b1dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:59:08.731693 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:59:08.758429 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 992/1974] 10.222.0.65 () {58 vars in 958 bytes} [Thu Oct 27 09:59:08 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 09:59:08.770364 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d30f743-df11-45c7-afa5-6a0123507297 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:59:08.772138 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-9d30f743-df11-45c7-afa5-6a0123507297 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:59:08.833688 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d30f743-df11-45c7-afa5-6a0123507297 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:59:08.837361 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7b9aa2-637e-443e-93de-e4d42e97abd8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8e5d5f04c4741bb86ca4a0f667d4ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc2e3a7a1bcc480891c0b433291c00b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:59:08.838627 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7b9aa2-637e-443e-93de-e4d42e97abd8 service cinder] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:59:08.838904 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7b9aa2-637e-443e-93de-e4d42e97abd8 service cinder] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:59:08.839176 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7b9aa2-637e-443e-93de-e4d42e97abd8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:59:08.848864 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7b9aa2-637e-443e-93de-e4d42e97abd8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:59:08.850342 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7b9aa2-637e-443e-93de-e4d42e97abd8 service cinder] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:59:08.862419 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 983/1975] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Oct 27 09:59:08 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 09:59:09.073976 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095f7dc7-073f-4e09-9f5c-ec35f948b1dc None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:59:09.084129 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095f7dc7-073f-4e09-9f5c-ec35f948b1dc None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:59:09.088493 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567bdb6d-6d45-4fa9-9fb6-9bc3e51e3803 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8e5d5f04c4741bb86ca4a0f667d4ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc2e3a7a1bcc480891c0b433291c00b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:59:09.089105 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567bdb6d-6d45-4fa9-9fb6-9bc3e51e3803 service cinder] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:59:09.089384 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567bdb6d-6d45-4fa9-9fb6-9bc3e51e3803 service cinder] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:59:09.089655 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567bdb6d-6d45-4fa9-9fb6-9bc3e51e3803 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:59:09.149045 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567bdb6d-6d45-4fa9-9fb6-9bc3e51e3803 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:59:09.150579 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567bdb6d-6d45-4fa9-9fb6-9bc3e51e3803 service cinder] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:59:09.160710 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 993/1976] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Oct 27 09:59:09 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 09:59:17.811539 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7b9aa2-637e-443e-93de-e4d42e97abd8 service cinder] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:59:17.885752 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7b9aa2-637e-443e-93de-e4d42e97abd8 service cinder] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:59:17.890468 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b281ed3-8f17-4048-bc1b-1978d8104b2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:59:17.894814 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b281ed3-8f17-4048-bc1b-1978d8104b2c admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:59:17.894814 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b281ed3-8f17-4048-bc1b-1978d8104b2c admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:59:17.894814 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b281ed3-8f17-4048-bc1b-1978d8104b2c admin admin] PATH_INFO: `/v3/users/06bab61e5a1e49429fa32ad1a811face` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:59:17.894814 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b281ed3-8f17-4048-bc1b-1978d8104b2c admin admin] RBAC: Authorizing `identity:delete_user(user_id=06bab61e5a1e49429fa32ad1a811face)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:59:17.894814 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b281ed3-8f17-4048-bc1b-1978d8104b2c admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:59:18.107572 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-3b281ed3-8f17-4048-bc1b-1978d8104b2c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '06bab61e5a1e49429fa32ad1a811face'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:59:18.108141 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-3b281ed3-8f17-4048-bc1b-1978d8104b2c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '06bab61e5a1e49429fa32ad1a811face'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:59:18.112830 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:59:18.115786 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-3b281ed3-8f17-4048-bc1b-1978d8104b2c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '06bab61e5a1e49429fa32ad1a811face'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:59:18.116429 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-3b281ed3-8f17-4048-bc1b-1978d8104b2c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '06bab61e5a1e49429fa32ad1a811face'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:59:18.129263 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-3b281ed3-8f17-4048-bc1b-1978d8104b2c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '06bab61e5a1e49429fa32ad1a811face'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:59:18.212735 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 984/1977] 10.222.0.65 () {58 vars in 1224 bytes} [Thu Oct 27 09:59:17 2022] DELETE /identity/v3/users/06bab61e5a1e49429fa32ad1a811face => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 09:59:18.217380 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111cb41f-4fc9-40c7-b3e1-0df6f1f322ef None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:59:18.217887 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111cb41f-4fc9-40c7-b3e1-0df6f1f322ef None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:59:18.217983 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111cb41f-4fc9-40c7-b3e1-0df6f1f322ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:59:18.237018 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-111cb41f-4fc9-40c7-b3e1-0df6f1f322ef None None] MFA Rules not processed for user `b5065084bf664b99bdeac46067cb0f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:59:18.238220 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-111cb41f-4fc9-40c7-b3e1-0df6f1f322ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:59:18.297810 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 994/1978] 10.222.0.65 () {58 vars in 958 bytes} [Thu Oct 27 09:59:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 09:59:18.308124 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b281ed3-8f17-4048-bc1b-1978d8104b2c admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:59:18.310133 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-3b281ed3-8f17-4048-bc1b-1978d8104b2c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:59:18.375365 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b281ed3-8f17-4048-bc1b-1978d8104b2c admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:59:18.379156 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90200a06-8552-4fa5-a54e-affdc53955e9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6191cc41efa74f46b49022cf387f7a4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc2e3a7a1bcc480891c0b433291c00b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:59:18.379779 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90200a06-8552-4fa5-a54e-affdc53955e9 service neutron] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:59:18.380054 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90200a06-8552-4fa5-a54e-affdc53955e9 service neutron] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:59:18.380325 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90200a06-8552-4fa5-a54e-affdc53955e9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:59:18.392490 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90200a06-8552-4fa5-a54e-affdc53955e9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:59:18.394381 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90200a06-8552-4fa5-a54e-affdc53955e9 service neutron] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:59:18.405851 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 985/1979] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Oct 27 09:59:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 09:59:18.896064 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111cb41f-4fc9-40c7-b3e1-0df6f1f322ef None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:59:18.897671 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-111cb41f-4fc9-40c7-b3e1-0df6f1f322ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:59:18.913762 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111cb41f-4fc9-40c7-b3e1-0df6f1f322ef None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:59:18.920011 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7612aab5-c845-455a-8db9-f6442ec1f0a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:59:18.920669 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7612aab5-c845-455a-8db9-f6442ec1f0a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:59:18.920947 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7612aab5-c845-455a-8db9-f6442ec1f0a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:59:18.921220 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7612aab5-c845-455a-8db9-f6442ec1f0a4 admin admin] PATH_INFO: `/v3/projects/72cf1ba9f0cd407884269118dfabd320` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:59:18.922374 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7612aab5-c845-455a-8db9-f6442ec1f0a4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=72cf1ba9f0cd407884269118dfabd320)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:59:18.924348 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7612aab5-c845-455a-8db9-f6442ec1f0a4 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:59:19.034148 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-7612aab5-c845-455a-8db9-f6442ec1f0a4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '72cf1ba9f0cd407884269118dfabd320', 'request_id': 'req-7612aab5-c845-455a-8db9-f6442ec1f0a4'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:59:19.099929 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-7612aab5-c845-455a-8db9-f6442ec1f0a4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '72cf1ba9f0cd407884269118dfabd320', 'request_id': 'req-7612aab5-c845-455a-8db9-f6442ec1f0a4'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:59:19.107660 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-7612aab5-c845-455a-8db9-f6442ec1f0a4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '72cf1ba9f0cd407884269118dfabd320', 'request_id': 'req-7612aab5-c845-455a-8db9-f6442ec1f0a4'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:59:19.126927 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-7612aab5-c845-455a-8db9-f6442ec1f0a4 admin admin] The token cache is being invalidate because project 72cf1ba9f0cd407884269118dfabd320 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 09:59:19.127628 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-7612aab5-c845-455a-8db9-f6442ec1f0a4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:59:19.128394 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-7612aab5-c845-455a-8db9-f6442ec1f0a4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:59:19.131291 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 995/1980] 10.222.0.65 () {58 vars in 1233 bytes} [Thu Oct 27 09:59:18 2022] DELETE /identity/v3/projects/72cf1ba9f0cd407884269118dfabd320 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 09:59:19.136537 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90200a06-8552-4fa5-a54e-affdc53955e9 service neutron] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:59:19.147704 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90200a06-8552-4fa5-a54e-affdc53955e9 service neutron] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:59:19.205915 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312f677d-a51f-436f-8520-cf209ee165de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:59:19.209276 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312f677d-a51f-436f-8520-cf209ee165de admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:59:19.209276 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312f677d-a51f-436f-8520-cf209ee165de admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:59:19.209276 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312f677d-a51f-436f-8520-cf209ee165de admin admin] PATH_INFO: `/v3/users/2e17fbacb6194bdd8d43fc3ff470f686` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:59:19.209276 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312f677d-a51f-436f-8520-cf209ee165de admin admin] RBAC: Authorizing `identity:delete_user(user_id=2e17fbacb6194bdd8d43fc3ff470f686)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:59:19.210164 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312f677d-a51f-436f-8520-cf209ee165de admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:59:19.427279 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-312f677d-a51f-436f-8520-cf209ee165de admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2e17fbacb6194bdd8d43fc3ff470f686'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:59:19.427979 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-312f677d-a51f-436f-8520-cf209ee165de admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2e17fbacb6194bdd8d43fc3ff470f686'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:59:19.435585 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-312f677d-a51f-436f-8520-cf209ee165de admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2e17fbacb6194bdd8d43fc3ff470f686'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:59:19.436338 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-312f677d-a51f-436f-8520-cf209ee165de admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2e17fbacb6194bdd8d43fc3ff470f686'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:59:19.448909 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-312f677d-a51f-436f-8520-cf209ee165de admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2e17fbacb6194bdd8d43fc3ff470f686'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:59:19.451375 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:59:19.528996 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 986/1981] 10.222.0.65 () {58 vars in 1224 bytes} [Thu Oct 27 09:59:19 2022] DELETE /identity/v3/users/2e17fbacb6194bdd8d43fc3ff470f686 => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 09:59:19.949011 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7612aab5-c845-455a-8db9-f6442ec1f0a4 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:59:19.949011 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-7612aab5-c845-455a-8db9-f6442ec1f0a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:59:19.955064 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:59:19.957936 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7612aab5-c845-455a-8db9-f6442ec1f0a4 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:59:20.020792 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9687ec1b-e195-44eb-a939-6072a91c112d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:59:20.021460 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9687ec1b-e195-44eb-a939-6072a91c112d admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:59:20.021738 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9687ec1b-e195-44eb-a939-6072a91c112d admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:59:20.022010 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9687ec1b-e195-44eb-a939-6072a91c112d admin admin] PATH_INFO: `/v3/projects/82ee81528f7e42b590c3748a32bf4c2e` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:59:20.023144 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9687ec1b-e195-44eb-a939-6072a91c112d admin admin] RBAC: Authorizing `identity:delete_project(project_id=82ee81528f7e42b590c3748a32bf4c2e)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:59:20.025253 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9687ec1b-e195-44eb-a939-6072a91c112d admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:59:20.136134 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-9687ec1b-e195-44eb-a939-6072a91c112d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '82ee81528f7e42b590c3748a32bf4c2e', 'request_id': 'req-9687ec1b-e195-44eb-a939-6072a91c112d'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:59:20.218480 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-9687ec1b-e195-44eb-a939-6072a91c112d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '82ee81528f7e42b590c3748a32bf4c2e', 'request_id': 'req-9687ec1b-e195-44eb-a939-6072a91c112d'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:59:20.225092 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-9687ec1b-e195-44eb-a939-6072a91c112d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '82ee81528f7e42b590c3748a32bf4c2e', 'request_id': 'req-9687ec1b-e195-44eb-a939-6072a91c112d'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:59:20.245397 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-9687ec1b-e195-44eb-a939-6072a91c112d admin admin] The token cache is being invalidate because project 82ee81528f7e42b590c3748a32bf4c2e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 09:59:20.245721 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-9687ec1b-e195-44eb-a939-6072a91c112d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:59:20.246423 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-9687ec1b-e195-44eb-a939-6072a91c112d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:59:20.249007 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 996/1982] 10.222.0.65 () {58 vars in 1233 bytes} [Thu Oct 27 09:59:19 2022] DELETE /identity/v3/projects/82ee81528f7e42b590c3748a32bf4c2e => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 09:59:20.253722 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27dbb00-d6bb-4ef6-9efe-054550e64a45 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:59:20.254243 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27dbb00-d6bb-4ef6-9efe-054550e64a45 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:59:20.254243 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27dbb00-d6bb-4ef6-9efe-054550e64a45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:59:20.278806 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-e27dbb00-d6bb-4ef6-9efe-054550e64a45 None None] MFA Rules not processed for user `b5065084bf664b99bdeac46067cb0f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:59:20.280085 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-e27dbb00-d6bb-4ef6-9efe-054550e64a45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:59:20.359087 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 987/1983] 10.222.0.65 () {58 vars in 958 bytes} [Thu Oct 27 09:59:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 09:59:20.366843 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3614864-a5f3-4409-afa3-d0a25ba2ef4e None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:59:20.367408 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3614864-a5f3-4409-afa3-d0a25ba2ef4e None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:59:20.367954 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3614864-a5f3-4409-afa3-d0a25ba2ef4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:59:20.389591 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-c3614864-a5f3-4409-afa3-d0a25ba2ef4e None None] MFA Rules not processed for user `b5065084bf664b99bdeac46067cb0f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:59:20.390893 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-c3614864-a5f3-4409-afa3-d0a25ba2ef4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:59:20.401275 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 997/1984] 10.222.0.65 () {58 vars in 958 bytes} [Thu Oct 27 09:59:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 09:59:20.406545 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27dbb00-d6bb-4ef6-9efe-054550e64a45 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:59:20.416589 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27dbb00-d6bb-4ef6-9efe-054550e64a45 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:59:20.423893 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a43a37b-08dd-4f81-b199-cd3afe78ec00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:59:20.423893 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a43a37b-08dd-4f81-b199-cd3afe78ec00 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:59:20.423893 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a43a37b-08dd-4f81-b199-cd3afe78ec00 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:59:20.423893 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a43a37b-08dd-4f81-b199-cd3afe78ec00 admin admin] PATH_INFO: `/v3/domains` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:59:20.424363 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a43a37b-08dd-4f81-b199-cd3afe78ec00 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 09:59:20.424363 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a43a37b-08dd-4f81-b199-cd3afe78ec00 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:59:20.425635 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a43a37b-08dd-4f81-b199-cd3afe78ec00 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:59:20.438928 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 988/1985] 10.222.0.65 () {58 vars in 1153 bytes} [Thu Oct 27 09:59:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 09:59:20.443286 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3614864-a5f3-4409-afa3-d0a25ba2ef4e None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:59:20.454313 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3614864-a5f3-4409-afa3-d0a25ba2ef4e None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:59:20.459392 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8f3d8f-da50-4a0c-bd15-355f9be4e38c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:59:20.460014 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8f3d8f-da50-4a0c-bd15-355f9be4e38c admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:59:20.460288 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8f3d8f-da50-4a0c-bd15-355f9be4e38c admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:59:20.460588 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8f3d8f-da50-4a0c-bd15-355f9be4e38c admin admin] PATH_INFO: `/v3/projects` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:59:20.461223 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8f3d8f-da50-4a0c-bd15-355f9be4e38c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:59:20.463363 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8f3d8f-da50-4a0c-bd15-355f9be4e38c admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:59:20.580583 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 998/1986] 10.222.0.65 () {60 vars in 1153 bytes} [Thu Oct 27 09:59:20 2022] POST /identity/v3/projects => generated 375 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 09:59:20.584964 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a43a37b-08dd-4f81-b199-cd3afe78ec00 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:59:20.595909 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a43a37b-08dd-4f81-b199-cd3afe78ec00 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:59:20.657358 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbd2536-23cb-4aaf-917a-cd29bda3b4d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:59:20.657975 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbd2536-23cb-4aaf-917a-cd29bda3b4d5 admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:59:20.658286 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbd2536-23cb-4aaf-917a-cd29bda3b4d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:59:20.658618 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbd2536-23cb-4aaf-917a-cd29bda3b4d5 admin admin] PATH_INFO: `/v3/users` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:59:20.659310 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbd2536-23cb-4aaf-917a-cd29bda3b4d5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:59:20.661281 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbd2536-23cb-4aaf-917a-cd29bda3b4d5 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:59:20.777585 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 989/1987] 10.222.0.65 () {60 vars in 1144 bytes} [Thu Oct 27 09:59:20 2022] POST /identity/v3/users => generated 288 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 09:59:20.780026 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8f3d8f-da50-4a0c-bd15-355f9be4e38c admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:59:20.791018 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8f3d8f-da50-4a0c-bd15-355f9be4e38c admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:59:20.796048 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e851880-0d24-4920-994b-ca8f63865be9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:59:20.796645 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e851880-0d24-4920-994b-ca8f63865be9 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:59:20.796947 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e851880-0d24-4920-994b-ca8f63865be9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:59:20.797218 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e851880-0d24-4920-994b-ca8f63865be9 admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:59:20.797871 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e851880-0d24-4920-994b-ca8f63865be9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:59:20.799513 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e851880-0d24-4920-994b-ca8f63865be9 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:59:20.809872 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 999/1988] 10.222.0.65 () {58 vars in 1122 bytes} [Thu Oct 27 09:59:20 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 09:59:20.813938 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbd2536-23cb-4aaf-917a-cd29bda3b4d5 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:59:20.825615 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbd2536-23cb-4aaf-917a-cd29bda3b4d5 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:59:20.831155 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1300529-03a7-4aeb-babe-c84de5b34624 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:59:20.831765 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1300529-03a7-4aeb-babe-c84de5b34624 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:59:20.832050 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1300529-03a7-4aeb-babe-c84de5b34624 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:59:20.832382 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1300529-03a7-4aeb-babe-c84de5b34624 admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:59:20.833114 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1300529-03a7-4aeb-babe-c84de5b34624 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:59:20.834749 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1300529-03a7-4aeb-babe-c84de5b34624 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:59:20.847576 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 990/1989] 10.222.0.65 () {58 vars in 1122 bytes} [Thu Oct 27 09:59:20 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 09:59:20.852192 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e851880-0d24-4920-994b-ca8f63865be9 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:59:20.864085 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e851880-0d24-4920-994b-ca8f63865be9 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:59:20.869004 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7581b068-6b5e-4017-8878-6aa6f65c4ac7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:59:20.869724 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7581b068-6b5e-4017-8878-6aa6f65c4ac7 admin admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:59:20.870038 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7581b068-6b5e-4017-8878-6aa6f65c4ac7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:59:20.870314 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7581b068-6b5e-4017-8878-6aa6f65c4ac7 admin admin] PATH_INFO: `/v3/projects/43ba17911bf54b379dbb54285ead0a2b/users/13437500d93340c98dba100bcc18b8a1/roles/43543ce1450245af9661cb017bac17bd` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:59:20.887249 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7581b068-6b5e-4017-8878-6aa6f65c4ac7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=43ba17911bf54b379dbb54285ead0a2b, user_id=13437500d93340c98dba100bcc18b8a1, role_id=43543ce1450245af9661cb017bac17bd)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:59:20.890017 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7581b068-6b5e-4017-8878-6aa6f65c4ac7 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:59:20.985694 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1000/1990] 10.222.0.65 () {60 vars in 1483 bytes} [Thu Oct 27 09:59:20 2022] PUT /identity/v3/projects/43ba17911bf54b379dbb54285ead0a2b/users/13437500d93340c98dba100bcc18b8a1/roles/43543ce1450245af9661cb017bac17bd => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 09:59:20.999221 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf862f8-1943-47a8-b384-522a827e47ce None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:59:20.999496 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf862f8-1943-47a8-b384-522a827e47ce None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:59:20.999775 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf862f8-1943-47a8-b384-522a827e47ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:59:21.030848 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-adf862f8-1943-47a8-b384-522a827e47ce None None] MFA Rules not processed for user `13437500d93340c98dba100bcc18b8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:59:21.032006 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-adf862f8-1943-47a8-b384-522a827e47ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:59:21.080784 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:INSERT=4,keystone:DELETE=1,keystone:SELECT=95 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:59:21.101437 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 991/1991] 10.222.0.65 () {58 vars in 958 bytes} [Thu Oct 27 09:59:20 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 09:59:21.106166 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7581b068-6b5e-4017-8878-6aa6f65c4ac7 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:59:21.143846 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:59:21.173857 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7581b068-6b5e-4017-8878-6aa6f65c4ac7 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:59:21.178907 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80a5e79-db1e-49de-975c-223243c74a51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:59:21.179592 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80a5e79-db1e-49de-975c-223243c74a51 admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:59:21.179881 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80a5e79-db1e-49de-975c-223243c74a51 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:59:21.180154 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80a5e79-db1e-49de-975c-223243c74a51 admin admin] PATH_INFO: `/v3/projects` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:59:21.180785 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80a5e79-db1e-49de-975c-223243c74a51 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:59:21.182732 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80a5e79-db1e-49de-975c-223243c74a51 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:59:21.301354 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1001/1992] 10.222.0.65 () {60 vars in 1153 bytes} [Thu Oct 27 09:59:21 2022] POST /identity/v3/projects => generated 377 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 09:59:21.305578 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf862f8-1943-47a8-b384-522a827e47ce None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:59:21.316916 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf862f8-1943-47a8-b384-522a827e47ce None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:59:21.381642 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623e9356-3b3b-4dae-bc7d-3713a70e53ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:59:21.382258 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623e9356-3b3b-4dae-bc7d-3713a70e53ba admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:59:21.382582 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623e9356-3b3b-4dae-bc7d-3713a70e53ba admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:59:21.382877 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623e9356-3b3b-4dae-bc7d-3713a70e53ba admin admin] PATH_INFO: `/v3/users` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:59:21.383513 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623e9356-3b3b-4dae-bc7d-3713a70e53ba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:59:21.385462 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623e9356-3b3b-4dae-bc7d-3713a70e53ba admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:59:21.472040 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 992/1993] 10.222.0.65 () {60 vars in 1144 bytes} [Thu Oct 27 09:59:21 2022] POST /identity/v3/users => generated 295 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 09:59:21.476132 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80a5e79-db1e-49de-975c-223243c74a51 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:59:21.490862 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80a5e79-db1e-49de-975c-223243c74a51 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:59:21.493987 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43022ab6-0123-43a8-b17e-c79ee3089842 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:59:21.494643 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43022ab6-0123-43a8-b17e-c79ee3089842 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:59:21.494928 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43022ab6-0123-43a8-b17e-c79ee3089842 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:59:21.497905 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43022ab6-0123-43a8-b17e-c79ee3089842 admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:59:21.497905 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43022ab6-0123-43a8-b17e-c79ee3089842 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:59:21.498114 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43022ab6-0123-43a8-b17e-c79ee3089842 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:59:21.512299 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1002/1994] 10.222.0.65 () {58 vars in 1122 bytes} [Thu Oct 27 09:59:21 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 09:59:21.515994 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623e9356-3b3b-4dae-bc7d-3713a70e53ba admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:59:21.526894 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623e9356-3b3b-4dae-bc7d-3713a70e53ba admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:59:21.531802 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc53f31-7916-4aa7-b8f3-f4ef1ea1e86e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:59:21.532471 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc53f31-7916-4aa7-b8f3-f4ef1ea1e86e admin admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:59:21.532744 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc53f31-7916-4aa7-b8f3-f4ef1ea1e86e admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:59:21.533019 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc53f31-7916-4aa7-b8f3-f4ef1ea1e86e admin admin] PATH_INFO: `/v3/projects/853d819f564440628776130c3ea325f3/users/0525429c0b3c4a72a9c8be54af89ead5/roles/6ad17b9f9dea4b66ab2da3677d7e715d` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:59:21.548875 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc53f31-7916-4aa7-b8f3-f4ef1ea1e86e admin admin] RBAC: Authorizing `identity:create_grant(project_id=853d819f564440628776130c3ea325f3, user_id=0525429c0b3c4a72a9c8be54af89ead5, role_id=6ad17b9f9dea4b66ab2da3677d7e715d)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:59:21.551665 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc53f31-7916-4aa7-b8f3-f4ef1ea1e86e admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:59:21.655322 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 993/1995] 10.222.0.65 () {60 vars in 1483 bytes} [Thu Oct 27 09:59:21 2022] PUT /identity/v3/projects/853d819f564440628776130c3ea325f3/users/0525429c0b3c4a72a9c8be54af89ead5/roles/6ad17b9f9dea4b66ab2da3677d7e715d => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 09:59:21.669251 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43022ab6-0123-43a8-b17e-c79ee3089842 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:59:21.670255 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43022ab6-0123-43a8-b17e-c79ee3089842 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:59:21.729499 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa47a26-4d61-498e-a150-8373830590de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:59:21.730280 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa47a26-4d61-498e-a150-8373830590de admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:59:21.730601 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa47a26-4d61-498e-a150-8373830590de admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:59:21.730885 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa47a26-4d61-498e-a150-8373830590de admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:59:21.732127 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa47a26-4d61-498e-a150-8373830590de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:59:21.733747 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa47a26-4d61-498e-a150-8373830590de admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:59:21.744480 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1003/1996] 10.222.0.65 () {58 vars in 1122 bytes} [Thu Oct 27 09:59:21 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 09:59:21.749156 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc53f31-7916-4aa7-b8f3-f4ef1ea1e86e admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:59:21.759730 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc53f31-7916-4aa7-b8f3-f4ef1ea1e86e admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:59:21.764633 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59d413c-c51e-481d-a206-d565955114e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:59:21.765332 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59d413c-c51e-481d-a206-d565955114e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:59:21.765610 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59d413c-c51e-481d-a206-d565955114e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:59:21.765886 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59d413c-c51e-481d-a206-d565955114e3 admin admin] PATH_INFO: `/v3/projects/853d819f564440628776130c3ea325f3/users/0525429c0b3c4a72a9c8be54af89ead5/roles/6ad17b9f9dea4b66ab2da3677d7e715d` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:59:21.768171 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59d413c-c51e-481d-a206-d565955114e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=853d819f564440628776130c3ea325f3, user_id=0525429c0b3c4a72a9c8be54af89ead5, role_id=6ad17b9f9dea4b66ab2da3677d7e715d)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:59:21.770900 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59d413c-c51e-481d-a206-d565955114e3 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:59:21.782860 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 994/1997] 10.222.0.65 () {60 vars in 1483 bytes} [Thu Oct 27 09:59:21 2022] PUT /identity/v3/projects/853d819f564440628776130c3ea325f3/users/0525429c0b3c4a72a9c8be54af89ead5/roles/6ad17b9f9dea4b66ab2da3677d7e715d => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 09:59:21.797070 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0029161-2346-4388-af8c-13f528c260bb None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:59:21.797070 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0029161-2346-4388-af8c-13f528c260bb None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:59:21.797070 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0029161-2346-4388-af8c-13f528c260bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:59:21.825230 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-d0029161-2346-4388-af8c-13f528c260bb None None] MFA Rules not processed for user `0525429c0b3c4a72a9c8be54af89ead5`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:59:21.826640 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-d0029161-2346-4388-af8c-13f528c260bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:59:21.927126 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1004/1998] 10.222.0.65 () {58 vars in 958 bytes} [Thu Oct 27 09:59:21 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 09:59:21.938977 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59d413c-c51e-481d-a206-d565955114e3 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:59:21.941204 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-d59d413c-c51e-481d-a206-d565955114e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:59:22.008297 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59d413c-c51e-481d-a206-d565955114e3 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:59:22.012934 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e91a1b1-15c8-4a59-9a43-94f5bec245b5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8e5d5f04c4741bb86ca4a0f667d4ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc2e3a7a1bcc480891c0b433291c00b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:59:22.013351 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e91a1b1-15c8-4a59-9a43-94f5bec245b5 service cinder] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:59:22.013753 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e91a1b1-15c8-4a59-9a43-94f5bec245b5 service cinder] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:59:22.013997 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e91a1b1-15c8-4a59-9a43-94f5bec245b5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:59:22.078086 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:59:22.082276 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e91a1b1-15c8-4a59-9a43-94f5bec245b5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:59:22.083830 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e91a1b1-15c8-4a59-9a43-94f5bec245b5 service cinder] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:59:22.093409 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 995/1999] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Oct 27 09:59:21 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 09:59:25.445594 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0029161-2346-4388-af8c-13f528c260bb None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:59:25.456155 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0029161-2346-4388-af8c-13f528c260bb None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:59:25.460385 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991c45f6-5d38-4a0c-82cc-942373900758 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8e5d5f04c4741bb86ca4a0f667d4ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc2e3a7a1bcc480891c0b433291c00b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:59:25.460992 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991c45f6-5d38-4a0c-82cc-942373900758 service cinder] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:59:25.461274 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991c45f6-5d38-4a0c-82cc-942373900758 service cinder] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:59:25.461547 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991c45f6-5d38-4a0c-82cc-942373900758 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:59:25.471613 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991c45f6-5d38-4a0c-82cc-942373900758 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:59:25.473072 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991c45f6-5d38-4a0c-82cc-942373900758 service cinder] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:59:25.483017 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1005/2000] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Oct 27 09:59:25 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 09:59:32.183249 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=3 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:59:35.478462 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=93,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:59:40.572867 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e91a1b1-15c8-4a59-9a43-94f5bec245b5 service cinder] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:59:40.635847 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e91a1b1-15c8-4a59-9a43-94f5bec245b5 service cinder] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:59:40.640439 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c21b417-1736-4040-bea0-c98b22e836cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:59:40.641054 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c21b417-1736-4040-bea0-c98b22e836cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:59:40.641412 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c21b417-1736-4040-bea0-c98b22e836cd admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:59:40.641608 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c21b417-1736-4040-bea0-c98b22e836cd admin admin] PATH_INFO: `/v3/users/13437500d93340c98dba100bcc18b8a1` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:59:40.642744 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c21b417-1736-4040-bea0-c98b22e836cd admin admin] RBAC: Authorizing `identity:delete_user(user_id=13437500d93340c98dba100bcc18b8a1)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:59:40.644661 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c21b417-1736-4040-bea0-c98b22e836cd admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:59:40.860234 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-8c21b417-1736-4040-bea0-c98b22e836cd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '13437500d93340c98dba100bcc18b8a1'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:59:40.860881 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-8c21b417-1736-4040-bea0-c98b22e836cd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '13437500d93340c98dba100bcc18b8a1'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:59:40.868491 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-8c21b417-1736-4040-bea0-c98b22e836cd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '13437500d93340c98dba100bcc18b8a1'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:59:40.869215 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-8c21b417-1736-4040-bea0-c98b22e836cd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '13437500d93340c98dba100bcc18b8a1'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:59:40.881906 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-8c21b417-1736-4040-bea0-c98b22e836cd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '13437500d93340c98dba100bcc18b8a1'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:59:40.970612 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 996/2001] 10.222.0.65 () {58 vars in 1224 bytes} [Thu Oct 27 09:59:40 2022] DELETE /identity/v3/users/13437500d93340c98dba100bcc18b8a1 => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 09:59:40.975969 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a9504b-594b-4150-9a1b-7c23cca4a704 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:59:40.976637 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a9504b-594b-4150-9a1b-7c23cca4a704 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:59:40.976637 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a9504b-594b-4150-9a1b-7c23cca4a704 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:59:40.996239 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-77a9504b-594b-4150-9a1b-7c23cca4a704 None None] MFA Rules not processed for user `b5065084bf664b99bdeac46067cb0f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:59:40.997449 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-77a9504b-594b-4150-9a1b-7c23cca4a704 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:59:41.057596 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1006/2002] 10.222.0.65 () {58 vars in 958 bytes} [Thu Oct 27 09:59:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 09:59:41.067444 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c21b417-1736-4040-bea0-c98b22e836cd admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:59:41.069217 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-8c21b417-1736-4040-bea0-c98b22e836cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:59:41.129864 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c21b417-1736-4040-bea0-c98b22e836cd admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:59:41.133547 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33367d35-1ec3-475e-a7e9-c3c40bf59b65 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6191cc41efa74f46b49022cf387f7a4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc2e3a7a1bcc480891c0b433291c00b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:59:41.134119 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33367d35-1ec3-475e-a7e9-c3c40bf59b65 service neutron] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:59:41.134397 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33367d35-1ec3-475e-a7e9-c3c40bf59b65 service neutron] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:59:41.134698 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33367d35-1ec3-475e-a7e9-c3c40bf59b65 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:59:41.143955 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33367d35-1ec3-475e-a7e9-c3c40bf59b65 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:59:41.145384 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33367d35-1ec3-475e-a7e9-c3c40bf59b65 service neutron] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:59:41.156959 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 997/2003] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Oct 27 09:59:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 09:59:41.635268 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a9504b-594b-4150-9a1b-7c23cca4a704 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:59:41.636892 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-77a9504b-594b-4150-9a1b-7c23cca4a704 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:59:41.651296 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a9504b-594b-4150-9a1b-7c23cca4a704 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:59:41.656272 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b49ab6-6a38-4ffd-8e69-4a92d5fc673c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:59:41.656916 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b49ab6-6a38-4ffd-8e69-4a92d5fc673c admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:59:41.657200 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b49ab6-6a38-4ffd-8e69-4a92d5fc673c admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:59:41.657478 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b49ab6-6a38-4ffd-8e69-4a92d5fc673c admin admin] PATH_INFO: `/v3/projects/43ba17911bf54b379dbb54285ead0a2b` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:59:41.659236 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b49ab6-6a38-4ffd-8e69-4a92d5fc673c admin admin] RBAC: Authorizing `identity:delete_project(project_id=43ba17911bf54b379dbb54285ead0a2b)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:59:41.661423 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b49ab6-6a38-4ffd-8e69-4a92d5fc673c admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:59:41.779604 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-72b49ab6-6a38-4ffd-8e69-4a92d5fc673c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '43ba17911bf54b379dbb54285ead0a2b', 'request_id': 'req-72b49ab6-6a38-4ffd-8e69-4a92d5fc673c'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:59:41.873689 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-72b49ab6-6a38-4ffd-8e69-4a92d5fc673c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '43ba17911bf54b379dbb54285ead0a2b', 'request_id': 'req-72b49ab6-6a38-4ffd-8e69-4a92d5fc673c'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:59:41.891306 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-72b49ab6-6a38-4ffd-8e69-4a92d5fc673c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '43ba17911bf54b379dbb54285ead0a2b', 'request_id': 'req-72b49ab6-6a38-4ffd-8e69-4a92d5fc673c'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:59:41.894570 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-72b49ab6-6a38-4ffd-8e69-4a92d5fc673c admin admin] The token cache is being invalidate because project 43ba17911bf54b379dbb54285ead0a2b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 09:59:41.894941 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-72b49ab6-6a38-4ffd-8e69-4a92d5fc673c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:59:41.895656 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-72b49ab6-6a38-4ffd-8e69-4a92d5fc673c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:59:41.898134 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1007/2004] 10.222.0.65 () {58 vars in 1233 bytes} [Thu Oct 27 09:59:41 2022] DELETE /identity/v3/projects/43ba17911bf54b379dbb54285ead0a2b => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 09:59:41.901908 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33367d35-1ec3-475e-a7e9-c3c40bf59b65 service neutron] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:59:41.913888 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33367d35-1ec3-475e-a7e9-c3c40bf59b65 service neutron] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:59:41.936571 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:59:41.997714 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abce5cc-3bf7-42d3-b2cb-6d371667e2ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:59:41.998461 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abce5cc-3bf7-42d3-b2cb-6d371667e2ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:59:41.998965 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abce5cc-3bf7-42d3-b2cb-6d371667e2ce admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:59:41.999317 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abce5cc-3bf7-42d3-b2cb-6d371667e2ce admin admin] PATH_INFO: `/v3/users/0525429c0b3c4a72a9c8be54af89ead5` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:59:42.001113 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abce5cc-3bf7-42d3-b2cb-6d371667e2ce admin admin] RBAC: Authorizing `identity:delete_user(user_id=0525429c0b3c4a72a9c8be54af89ead5)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:59:42.003693 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abce5cc-3bf7-42d3-b2cb-6d371667e2ce admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:59:42.204354 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-4abce5cc-3bf7-42d3-b2cb-6d371667e2ce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0525429c0b3c4a72a9c8be54af89ead5'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:59:42.205112 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-4abce5cc-3bf7-42d3-b2cb-6d371667e2ce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0525429c0b3c4a72a9c8be54af89ead5'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:59:42.212967 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-4abce5cc-3bf7-42d3-b2cb-6d371667e2ce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0525429c0b3c4a72a9c8be54af89ead5'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:59:42.213634 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-4abce5cc-3bf7-42d3-b2cb-6d371667e2ce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0525429c0b3c4a72a9c8be54af89ead5'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:59:42.226844 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-4abce5cc-3bf7-42d3-b2cb-6d371667e2ce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0525429c0b3c4a72a9c8be54af89ead5'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:59:42.308105 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 998/2005] 10.222.0.65 () {58 vars in 1224 bytes} [Thu Oct 27 09:59:41 2022] DELETE /identity/v3/users/0525429c0b3c4a72a9c8be54af89ead5 => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 09:59:42.536619 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc505b35-3ce1-47cb-9d1d-7fea0fdefc52 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:59:42.537817 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc505b35-3ce1-47cb-9d1d-7fea0fdefc52 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:59:42.538055 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc505b35-3ce1-47cb-9d1d-7fea0fdefc52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:59:42.561621 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-bc505b35-3ce1-47cb-9d1d-7fea0fdefc52 None None] MFA Rules not processed for user `c18a92a796934277ad64a51ef3f7bb23`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:59:42.563045 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-bc505b35-3ce1-47cb-9d1d-7fea0fdefc52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:59:42.654062 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1008/2006] 10.222.0.65 () {58 vars in 967 bytes} [Thu Oct 27 09:59:42 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 09:59:42.816009 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abce5cc-3bf7-42d3-b2cb-6d371667e2ce admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:59:42.817505 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-4abce5cc-3bf7-42d3-b2cb-6d371667e2ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:59:42.932856 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abce5cc-3bf7-42d3-b2cb-6d371667e2ce admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:59:42.938171 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020c459b-1878-4354-8269-c9f472b74985 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e32fc35c8b467e9604b325cf1527aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc2e3a7a1bcc480891c0b433291c00b1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:59:42.938959 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020c459b-1878-4354-8269-c9f472b74985 service swift] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:59:42.939302 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020c459b-1878-4354-8269-c9f472b74985 service swift] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:59:42.939645 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020c459b-1878-4354-8269-c9f472b74985 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:59:42.949331 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020c459b-1878-4354-8269-c9f472b74985 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:59:42.951185 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020c459b-1878-4354-8269-c9f472b74985 service swift] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:59:42.961305 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 999/2007] 10.222.0.65 () {60 vars in 1384 bytes} [Thu Oct 27 09:59:42 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 27 09:59:43.255177 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc505b35-3ce1-47cb-9d1d-7fea0fdefc52 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:59:43.258912 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-bc505b35-3ce1-47cb-9d1d-7fea0fdefc52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:59:43.300029 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:59:43.340436 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc505b35-3ce1-47cb-9d1d-7fea0fdefc52 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:59:43.345464 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8a4271-1c81-457a-8bd3-7c0caf2c1629 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:59:43.346101 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8a4271-1c81-457a-8bd3-7c0caf2c1629 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:59:43.346387 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8a4271-1c81-457a-8bd3-7c0caf2c1629 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:59:43.346773 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8a4271-1c81-457a-8bd3-7c0caf2c1629 admin admin] PATH_INFO: `/v3/projects/853d819f564440628776130c3ea325f3` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:59:43.348084 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8a4271-1c81-457a-8bd3-7c0caf2c1629 admin admin] RBAC: Authorizing `identity:delete_project(project_id=853d819f564440628776130c3ea325f3)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:59:43.350939 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8a4271-1c81-457a-8bd3-7c0caf2c1629 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:59:43.512580 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-cc8a4271-1c81-457a-8bd3-7c0caf2c1629 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '853d819f564440628776130c3ea325f3', 'request_id': 'req-cc8a4271-1c81-457a-8bd3-7c0caf2c1629'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:59:43.614446 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-cc8a4271-1c81-457a-8bd3-7c0caf2c1629 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '853d819f564440628776130c3ea325f3', 'request_id': 'req-cc8a4271-1c81-457a-8bd3-7c0caf2c1629'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:59:43.621996 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-cc8a4271-1c81-457a-8bd3-7c0caf2c1629 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '853d819f564440628776130c3ea325f3', 'request_id': 'req-cc8a4271-1c81-457a-8bd3-7c0caf2c1629'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:59:43.634355 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-cc8a4271-1c81-457a-8bd3-7c0caf2c1629 admin admin] The token cache is being invalidate because project 853d819f564440628776130c3ea325f3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 09:59:43.634809 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-cc8a4271-1c81-457a-8bd3-7c0caf2c1629 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:59:43.635473 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-cc8a4271-1c81-457a-8bd3-7c0caf2c1629 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:59:43.636993 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1009/2008] 10.222.0.65 () {58 vars in 1233 bytes} [Thu Oct 27 09:59:43 2022] DELETE /identity/v3/projects/853d819f564440628776130c3ea325f3 => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 09:59:43.641992 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8119ea6-6e0e-4ac7-ae70-a10a72314b14 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:59:43.642285 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8119ea6-6e0e-4ac7-ae70-a10a72314b14 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:59:43.642586 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8119ea6-6e0e-4ac7-ae70-a10a72314b14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:59:43.663450 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-a8119ea6-6e0e-4ac7-ae70-a10a72314b14 None None] MFA Rules not processed for user `b5065084bf664b99bdeac46067cb0f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:59:43.664656 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-a8119ea6-6e0e-4ac7-ae70-a10a72314b14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:59:43.698364 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:59:43.736633 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1000/2009] 10.222.0.65 () {58 vars in 958 bytes} [Thu Oct 27 09:59:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 09:59:43.747104 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834e6af0-dbf7-4b4f-8841-de5d19648ccd None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:59:43.747393 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834e6af0-dbf7-4b4f-8841-de5d19648ccd None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:59:43.747669 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834e6af0-dbf7-4b4f-8841-de5d19648ccd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:59:43.768177 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-834e6af0-dbf7-4b4f-8841-de5d19648ccd None None] MFA Rules not processed for user `b5065084bf664b99bdeac46067cb0f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:59:43.769312 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-834e6af0-dbf7-4b4f-8841-de5d19648ccd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:59:43.778033 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1010/2010] 10.222.0.65 () {58 vars in 958 bytes} [Thu Oct 27 09:59:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 09:59:43.782574 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8119ea6-6e0e-4ac7-ae70-a10a72314b14 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:59:43.793015 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8119ea6-6e0e-4ac7-ae70-a10a72314b14 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:59:43.797756 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c5131c-3eda-49c1-943e-a3a7b548116b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:59:43.798346 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c5131c-3eda-49c1-943e-a3a7b548116b admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:59:43.798656 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c5131c-3eda-49c1-943e-a3a7b548116b admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:59:43.798931 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c5131c-3eda-49c1-943e-a3a7b548116b admin admin] PATH_INFO: `/v3/domains` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:59:43.799567 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c5131c-3eda-49c1-943e-a3a7b548116b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 09:59:43.799869 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c5131c-3eda-49c1-943e-a3a7b548116b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:59:43.801466 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c5131c-3eda-49c1-943e-a3a7b548116b admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:59:43.814123 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1001/2011] 10.222.0.65 () {58 vars in 1153 bytes} [Thu Oct 27 09:59:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 09:59:43.818883 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834e6af0-dbf7-4b4f-8841-de5d19648ccd None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:59:43.832038 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834e6af0-dbf7-4b4f-8841-de5d19648ccd None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:59:43.838461 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e590065-b88f-46db-9bef-d68d8d76be52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:59:43.839120 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e590065-b88f-46db-9bef-d68d8d76be52 admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:59:43.839404 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e590065-b88f-46db-9bef-d68d8d76be52 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:59:43.839674 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e590065-b88f-46db-9bef-d68d8d76be52 admin admin] PATH_INFO: `/v3/projects` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:59:43.840337 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e590065-b88f-46db-9bef-d68d8d76be52 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:59:43.842605 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e590065-b88f-46db-9bef-d68d8d76be52 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:59:43.944768 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1011/2012] 10.222.0.65 () {60 vars in 1153 bytes} [Thu Oct 27 09:59:43 2022] POST /identity/v3/projects => generated 359 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 09:59:43.949364 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c5131c-3eda-49c1-943e-a3a7b548116b admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:59:43.960070 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c5131c-3eda-49c1-943e-a3a7b548116b admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:59:44.019323 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bc27a3-e232-4848-abcc-f12bc417ebb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:59:44.019858 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bc27a3-e232-4848-abcc-f12bc417ebb8 admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:59:44.020141 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bc27a3-e232-4848-abcc-f12bc417ebb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:59:44.020459 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bc27a3-e232-4848-abcc-f12bc417ebb8 admin admin] PATH_INFO: `/v3/users` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:59:44.021137 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84bc27a3-e232-4848-abcc-f12bc417ebb8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:59:44.023888 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84bc27a3-e232-4848-abcc-f12bc417ebb8 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:59:44.175332 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1002/2013] 10.222.0.65 () {60 vars in 1144 bytes} [Thu Oct 27 09:59:43 2022] POST /identity/v3/users => generated 280 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 09:59:44.178613 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e590065-b88f-46db-9bef-d68d8d76be52 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:59:44.189278 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e590065-b88f-46db-9bef-d68d8d76be52 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:59:44.194756 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd647f7f-3a04-4cb4-847f-38d199d9627f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:59:44.195370 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd647f7f-3a04-4cb4-847f-38d199d9627f admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:59:44.195737 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd647f7f-3a04-4cb4-847f-38d199d9627f admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:59:44.196180 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd647f7f-3a04-4cb4-847f-38d199d9627f admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:59:44.196831 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd647f7f-3a04-4cb4-847f-38d199d9627f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:59:44.198833 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd647f7f-3a04-4cb4-847f-38d199d9627f admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:59:44.210073 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1012/2014] 10.222.0.65 () {58 vars in 1122 bytes} [Thu Oct 27 09:59:44 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 09:59:44.214755 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bc27a3-e232-4848-abcc-f12bc417ebb8 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:59:44.225071 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bc27a3-e232-4848-abcc-f12bc417ebb8 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:59:44.230125 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c10b9e7-d640-4dae-8cfa-14919e9376af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:59:44.230716 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c10b9e7-d640-4dae-8cfa-14919e9376af admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:59:44.231120 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c10b9e7-d640-4dae-8cfa-14919e9376af admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:59:44.231403 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c10b9e7-d640-4dae-8cfa-14919e9376af admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:59:44.232074 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c10b9e7-d640-4dae-8cfa-14919e9376af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:59:44.233674 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c10b9e7-d640-4dae-8cfa-14919e9376af admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:59:44.245264 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1003/2015] 10.222.0.65 () {58 vars in 1122 bytes} [Thu Oct 27 09:59:44 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 09:59:44.249638 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd647f7f-3a04-4cb4-847f-38d199d9627f admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:59:44.260653 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd647f7f-3a04-4cb4-847f-38d199d9627f admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:59:44.277135 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ebfbed-b5cc-4d3a-acb7-34c3f80a20a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:59:44.277135 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ebfbed-b5cc-4d3a-acb7-34c3f80a20a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:59:44.277135 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ebfbed-b5cc-4d3a-acb7-34c3f80a20a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:59:44.277135 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ebfbed-b5cc-4d3a-acb7-34c3f80a20a6 admin admin] PATH_INFO: `/v3/projects/0a894190f9d445e7b7d116b2e88550c5/users/6a0326df1b0b47eead51e928b087e792/roles/43543ce1450245af9661cb017bac17bd` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:59:44.304753 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ebfbed-b5cc-4d3a-acb7-34c3f80a20a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a894190f9d445e7b7d116b2e88550c5, user_id=6a0326df1b0b47eead51e928b087e792, role_id=43543ce1450245af9661cb017bac17bd)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:59:44.308582 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ebfbed-b5cc-4d3a-acb7-34c3f80a20a6 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:59:44.456961 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1013/2016] 10.222.0.65 () {60 vars in 1483 bytes} [Thu Oct 27 09:59:44 2022] PUT /identity/v3/projects/0a894190f9d445e7b7d116b2e88550c5/users/6a0326df1b0b47eead51e928b087e792/roles/43543ce1450245af9661cb017bac17bd => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 09:59:44.468483 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9599eb-9909-40b3-b961-0c5eac38e186 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:59:44.468774 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9599eb-9909-40b3-b961-0c5eac38e186 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:59:44.469060 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9599eb-9909-40b3-b961-0c5eac38e186 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:59:44.498179 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-3d9599eb-9909-40b3-b961-0c5eac38e186 None None] MFA Rules not processed for user `6a0326df1b0b47eead51e928b087e792`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:59:44.499444 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-3d9599eb-9909-40b3-b961-0c5eac38e186 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:59:44.574159 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1004/2017] 10.222.0.65 () {58 vars in 958 bytes} [Thu Oct 27 09:59:44 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 09:59:44.607751 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ebfbed-b5cc-4d3a-acb7-34c3f80a20a6 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:59:44.609549 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-d8ebfbed-b5cc-4d3a-acb7-34c3f80a20a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:59:44.671481 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ebfbed-b5cc-4d3a-acb7-34c3f80a20a6 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:59:44.675205 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90d44ce-6f19-43c9-a847-3919b8a6936c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8e5d5f04c4741bb86ca4a0f667d4ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc2e3a7a1bcc480891c0b433291c00b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:59:44.675789 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90d44ce-6f19-43c9-a847-3919b8a6936c service cinder] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:59:44.676065 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90d44ce-6f19-43c9-a847-3919b8a6936c service cinder] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:59:44.676339 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90d44ce-6f19-43c9-a847-3919b8a6936c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:59:44.685991 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90d44ce-6f19-43c9-a847-3919b8a6936c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:59:44.687522 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90d44ce-6f19-43c9-a847-3919b8a6936c service cinder] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:59:44.691267 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:59:44.698540 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1014/2018] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Oct 27 09:59:44 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 09:59:44.716678 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9599eb-9909-40b3-b961-0c5eac38e186 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:59:44.748160 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:59:44.781739 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9599eb-9909-40b3-b961-0c5eac38e186 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:59:44.786277 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c36de6-06ec-49e3-ac2c-039ccda464eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:59:44.786973 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c36de6-06ec-49e3-ac2c-039ccda464eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:59:44.787386 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c36de6-06ec-49e3-ac2c-039ccda464eb admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:59:44.787661 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c36de6-06ec-49e3-ac2c-039ccda464eb admin admin] PATH_INFO: `/v3/users/6a0326df1b0b47eead51e928b087e792` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:59:44.788804 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c36de6-06ec-49e3-ac2c-039ccda464eb admin admin] RBAC: Authorizing `identity:delete_user(user_id=6a0326df1b0b47eead51e928b087e792)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:59:44.790758 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c36de6-06ec-49e3-ac2c-039ccda464eb admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:59:45.077797 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-66c36de6-06ec-49e3-ac2c-039ccda464eb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6a0326df1b0b47eead51e928b087e792'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:59:45.078463 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-66c36de6-06ec-49e3-ac2c-039ccda464eb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6a0326df1b0b47eead51e928b087e792'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:59:45.086188 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-66c36de6-06ec-49e3-ac2c-039ccda464eb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6a0326df1b0b47eead51e928b087e792'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:59:45.086889 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-66c36de6-06ec-49e3-ac2c-039ccda464eb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6a0326df1b0b47eead51e928b087e792'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:59:45.099961 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-66c36de6-06ec-49e3-ac2c-039ccda464eb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6a0326df1b0b47eead51e928b087e792'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:59:45.194375 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1005/2019] 10.222.0.65 () {58 vars in 1224 bytes} [Thu Oct 27 09:59:44 2022] DELETE /identity/v3/users/6a0326df1b0b47eead51e928b087e792 => generated 0 bytes in 478 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 09:59:45.199213 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbff4dd2-5967-4856-9b68-1d5c392946b1 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:59:45.199691 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbff4dd2-5967-4856-9b68-1d5c392946b1 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:59:45.200143 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbff4dd2-5967-4856-9b68-1d5c392946b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:59:45.219700 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-dbff4dd2-5967-4856-9b68-1d5c392946b1 None None] MFA Rules not processed for user `b5065084bf664b99bdeac46067cb0f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:59:45.221000 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-dbff4dd2-5967-4856-9b68-1d5c392946b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:59:45.283059 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1015/2020] 10.222.0.65 () {58 vars in 958 bytes} [Thu Oct 27 09:59:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 09:59:45.293547 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c36de6-06ec-49e3-ac2c-039ccda464eb admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:59:45.295047 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-66c36de6-06ec-49e3-ac2c-039ccda464eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:59:45.369790 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c36de6-06ec-49e3-ac2c-039ccda464eb admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:59:45.373769 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c550061d-c39a-46b9-a5ac-5fae600cb9a2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6191cc41efa74f46b49022cf387f7a4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc2e3a7a1bcc480891c0b433291c00b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:59:45.374478 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c550061d-c39a-46b9-a5ac-5fae600cb9a2 service neutron] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:59:45.377450 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c550061d-c39a-46b9-a5ac-5fae600cb9a2 service neutron] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:59:45.377450 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c550061d-c39a-46b9-a5ac-5fae600cb9a2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:59:45.390946 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c550061d-c39a-46b9-a5ac-5fae600cb9a2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:59:45.398638 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c550061d-c39a-46b9-a5ac-5fae600cb9a2 service neutron] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:59:45.410172 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1006/2021] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Oct 27 09:59:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 09:59:46.385123 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbff4dd2-5967-4856-9b68-1d5c392946b1 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:59:46.387832 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-dbff4dd2-5967-4856-9b68-1d5c392946b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:59:46.406599 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbff4dd2-5967-4856-9b68-1d5c392946b1 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:59:46.412964 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bcb8e6-107f-4a15-b241-dfa41df746cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:59:46.417768 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bcb8e6-107f-4a15-b241-dfa41df746cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:59:46.417768 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bcb8e6-107f-4a15-b241-dfa41df746cb admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:59:46.417768 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bcb8e6-107f-4a15-b241-dfa41df746cb admin admin] PATH_INFO: `/v3/projects/0a894190f9d445e7b7d116b2e88550c5` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:59:46.417768 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79bcb8e6-107f-4a15-b241-dfa41df746cb admin admin] RBAC: Authorizing `identity:delete_project(project_id=0a894190f9d445e7b7d116b2e88550c5)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:59:46.418720 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79bcb8e6-107f-4a15-b241-dfa41df746cb admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:59:46.551387 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-79bcb8e6-107f-4a15-b241-dfa41df746cb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0a894190f9d445e7b7d116b2e88550c5', 'request_id': 'req-79bcb8e6-107f-4a15-b241-dfa41df746cb'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:59:46.668066 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-79bcb8e6-107f-4a15-b241-dfa41df746cb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0a894190f9d445e7b7d116b2e88550c5', 'request_id': 'req-79bcb8e6-107f-4a15-b241-dfa41df746cb'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:59:46.676365 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-79bcb8e6-107f-4a15-b241-dfa41df746cb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0a894190f9d445e7b7d116b2e88550c5', 'request_id': 'req-79bcb8e6-107f-4a15-b241-dfa41df746cb'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:59:46.691339 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-79bcb8e6-107f-4a15-b241-dfa41df746cb admin admin] The token cache is being invalidate because project 0a894190f9d445e7b7d116b2e88550c5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 09:59:46.691642 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-79bcb8e6-107f-4a15-b241-dfa41df746cb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:59:46.692334 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-79bcb8e6-107f-4a15-b241-dfa41df746cb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:59:46.694947 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1016/2022] 10.222.0.65 () {58 vars in 1233 bytes} [Thu Oct 27 09:59:46 2022] DELETE /identity/v3/projects/0a894190f9d445e7b7d116b2e88550c5 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 09:59:46.705201 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19eff006-1214-4fcd-a551-d1a4a8fa27b0 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:59:46.705201 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19eff006-1214-4fcd-a551-d1a4a8fa27b0 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:59:46.705201 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19eff006-1214-4fcd-a551-d1a4a8fa27b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:59:46.734758 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-19eff006-1214-4fcd-a551-d1a4a8fa27b0 None None] MFA Rules not processed for user `b5065084bf664b99bdeac46067cb0f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:59:46.736453 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-19eff006-1214-4fcd-a551-d1a4a8fa27b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:59:46.806452 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:59:46.825084 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1007/2023] 10.222.0.65 () {58 vars in 958 bytes} [Thu Oct 27 09:59:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 09:59:46.832964 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97d39d7-467b-45ec-8042-5b8bbae6d827 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:59:46.833256 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97d39d7-467b-45ec-8042-5b8bbae6d827 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:59:46.833535 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97d39d7-467b-45ec-8042-5b8bbae6d827 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:59:46.862448 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-f97d39d7-467b-45ec-8042-5b8bbae6d827 None None] MFA Rules not processed for user `b5065084bf664b99bdeac46067cb0f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:59:46.863717 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-f97d39d7-467b-45ec-8042-5b8bbae6d827 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:59:46.873786 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1017/2024] 10.222.0.65 () {58 vars in 958 bytes} [Thu Oct 27 09:59:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 09:59:46.879112 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19eff006-1214-4fcd-a551-d1a4a8fa27b0 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:59:46.890751 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19eff006-1214-4fcd-a551-d1a4a8fa27b0 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:59:46.898922 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a402344d-68b4-4bbc-b809-7ce1b28d9dae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:59:46.899690 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a402344d-68b4-4bbc-b809-7ce1b28d9dae admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:59:46.899915 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a402344d-68b4-4bbc-b809-7ce1b28d9dae admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:59:46.900194 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a402344d-68b4-4bbc-b809-7ce1b28d9dae admin admin] PATH_INFO: `/v3/domains` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:59:46.900860 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a402344d-68b4-4bbc-b809-7ce1b28d9dae admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 09:59:46.901169 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a402344d-68b4-4bbc-b809-7ce1b28d9dae admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:59:46.903372 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a402344d-68b4-4bbc-b809-7ce1b28d9dae admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:59:46.920062 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1008/2025] 10.222.0.65 () {58 vars in 1153 bytes} [Thu Oct 27 09:59:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 09:59:46.924390 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97d39d7-467b-45ec-8042-5b8bbae6d827 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:59:46.936381 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97d39d7-467b-45ec-8042-5b8bbae6d827 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:59:46.946429 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29605f8b-5117-4952-9142-7824b59e3378 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:59:46.947264 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29605f8b-5117-4952-9142-7824b59e3378 admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:59:46.947994 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29605f8b-5117-4952-9142-7824b59e3378 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:59:46.948325 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29605f8b-5117-4952-9142-7824b59e3378 admin admin] PATH_INFO: `/v3/projects` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:59:46.949132 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29605f8b-5117-4952-9142-7824b59e3378 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:59:46.951359 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29605f8b-5117-4952-9142-7824b59e3378 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:59:47.093432 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1018/2026] 10.222.0.65 () {60 vars in 1153 bytes} [Thu Oct 27 09:59:46 2022] POST /identity/v3/projects => generated 373 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 09:59:47.099151 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a402344d-68b4-4bbc-b809-7ce1b28d9dae admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:59:47.110602 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a402344d-68b4-4bbc-b809-7ce1b28d9dae admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:59:47.190187 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0689a3fc-ea97-4cdd-b06c-96da09076fd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:59:47.190966 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0689a3fc-ea97-4cdd-b06c-96da09076fd5 admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:59:47.191311 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0689a3fc-ea97-4cdd-b06c-96da09076fd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:59:47.191679 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0689a3fc-ea97-4cdd-b06c-96da09076fd5 admin admin] PATH_INFO: `/v3/users` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:59:47.192385 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0689a3fc-ea97-4cdd-b06c-96da09076fd5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:59:47.195324 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0689a3fc-ea97-4cdd-b06c-96da09076fd5 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:59:47.332366 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1009/2027] 10.222.0.65 () {60 vars in 1144 bytes} [Thu Oct 27 09:59:47 2022] POST /identity/v3/users => generated 287 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 09:59:47.337700 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29605f8b-5117-4952-9142-7824b59e3378 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:59:47.348652 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29605f8b-5117-4952-9142-7824b59e3378 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:59:47.353815 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc7c90b-64ec-4237-a0c7-5264f02ae267 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:59:47.354510 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc7c90b-64ec-4237-a0c7-5264f02ae267 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:59:47.355255 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc7c90b-64ec-4237-a0c7-5264f02ae267 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:59:47.355255 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc7c90b-64ec-4237-a0c7-5264f02ae267 admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:59:47.356043 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc7c90b-64ec-4237-a0c7-5264f02ae267 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:59:47.357722 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc7c90b-64ec-4237-a0c7-5264f02ae267 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:59:47.369122 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1019/2028] 10.222.0.65 () {58 vars in 1122 bytes} [Thu Oct 27 09:59:47 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 09:59:47.373190 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0689a3fc-ea97-4cdd-b06c-96da09076fd5 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:59:47.389899 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0689a3fc-ea97-4cdd-b06c-96da09076fd5 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:59:47.389899 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7502cc4-c05c-4bed-8247-1c0f7d5c17be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:59:47.390396 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7502cc4-c05c-4bed-8247-1c0f7d5c17be admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:59:47.390714 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7502cc4-c05c-4bed-8247-1c0f7d5c17be admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:59:47.390988 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7502cc4-c05c-4bed-8247-1c0f7d5c17be admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:59:47.391629 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7502cc4-c05c-4bed-8247-1c0f7d5c17be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:59:47.393259 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7502cc4-c05c-4bed-8247-1c0f7d5c17be admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:59:47.405587 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1010/2029] 10.222.0.65 () {58 vars in 1122 bytes} [Thu Oct 27 09:59:47 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 09:59:47.409829 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc7c90b-64ec-4237-a0c7-5264f02ae267 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:59:47.420465 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc7c90b-64ec-4237-a0c7-5264f02ae267 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:59:47.426234 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950ba842-36b1-4fe2-b290-f574ee5b120d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:59:47.426234 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950ba842-36b1-4fe2-b290-f574ee5b120d admin admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:59:47.426234 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950ba842-36b1-4fe2-b290-f574ee5b120d admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:59:47.426581 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950ba842-36b1-4fe2-b290-f574ee5b120d admin admin] PATH_INFO: `/v3/projects/f45aed87abba4e1abb44dcb2e6b9b990/users/f74853fa2a3b42ba85d045ed6c3a1e2f/roles/43543ce1450245af9661cb017bac17bd` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:59:47.449930 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950ba842-36b1-4fe2-b290-f574ee5b120d admin admin] RBAC: Authorizing `identity:create_grant(project_id=f45aed87abba4e1abb44dcb2e6b9b990, user_id=f74853fa2a3b42ba85d045ed6c3a1e2f, role_id=43543ce1450245af9661cb017bac17bd)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:59:47.453446 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950ba842-36b1-4fe2-b290-f574ee5b120d admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:59:47.542115 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1020/2030] 10.222.0.65 () {60 vars in 1483 bytes} [Thu Oct 27 09:59:47 2022] PUT /identity/v3/projects/f45aed87abba4e1abb44dcb2e6b9b990/users/f74853fa2a3b42ba85d045ed6c3a1e2f/roles/43543ce1450245af9661cb017bac17bd => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 09:59:47.554103 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b9387a-8149-486e-aea5-fe73144f5dd5 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:59:47.554381 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b9387a-8149-486e-aea5-fe73144f5dd5 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:59:47.554682 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b9387a-8149-486e-aea5-fe73144f5dd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:59:47.597838 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-34b9387a-8149-486e-aea5-fe73144f5dd5 None None] MFA Rules not processed for user `f74853fa2a3b42ba85d045ed6c3a1e2f`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:59:47.599439 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-34b9387a-8149-486e-aea5-fe73144f5dd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:59:47.671289 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1011/2031] 10.222.0.65 () {58 vars in 958 bytes} [Thu Oct 27 09:59:47 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 09:59:47.683505 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950ba842-36b1-4fe2-b290-f574ee5b120d admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:59:47.685414 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-950ba842-36b1-4fe2-b290-f574ee5b120d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:59:47.706962 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:59:47.746840 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950ba842-36b1-4fe2-b290-f574ee5b120d admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:59:47.751522 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6af0d17-ccfc-44c1-b773-b3e17864993c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8e5d5f04c4741bb86ca4a0f667d4ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc2e3a7a1bcc480891c0b433291c00b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:59:47.752144 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6af0d17-ccfc-44c1-b773-b3e17864993c service cinder] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:59:47.752427 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6af0d17-ccfc-44c1-b773-b3e17864993c service cinder] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:59:47.752708 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6af0d17-ccfc-44c1-b773-b3e17864993c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:59:47.762371 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6af0d17-ccfc-44c1-b773-b3e17864993c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:59:47.763812 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6af0d17-ccfc-44c1-b773-b3e17864993c service cinder] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:59:47.773592 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1021/2032] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Oct 27 09:59:47 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 09:59:49.858674 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c9920a-ad77-4f7b-b697-0ad58b2ec8b5 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:59:49.859205 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c9920a-ad77-4f7b-b697-0ad58b2ec8b5 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:59:49.859205 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c9920a-ad77-4f7b-b697-0ad58b2ec8b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:59:49.883190 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-e8c9920a-ad77-4f7b-b697-0ad58b2ec8b5 None None] MFA Rules not processed for user `2acf9b6c3a394be389cd17d7fade3cf4`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:59:49.884529 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-e8c9920a-ad77-4f7b-b697-0ad58b2ec8b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:59:49.929622 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:59:49.945900 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1012/2033] 10.222.0.65 () {58 vars in 958 bytes} [Thu Oct 27 09:59:49 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 09:59:52.316050 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6af0d17-ccfc-44c1-b773-b3e17864993c service cinder] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:59:52.386142 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6af0d17-ccfc-44c1-b773-b3e17864993c service cinder] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:59:52.391056 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba05c302-bac0-4215-9299-6bf8c0667bed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:59:52.391705 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba05c302-bac0-4215-9299-6bf8c0667bed admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:59:52.391987 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba05c302-bac0-4215-9299-6bf8c0667bed admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:59:52.392488 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba05c302-bac0-4215-9299-6bf8c0667bed admin admin] PATH_INFO: `/v3/users/f74853fa2a3b42ba85d045ed6c3a1e2f` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:59:52.394217 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba05c302-bac0-4215-9299-6bf8c0667bed admin admin] RBAC: Authorizing `identity:delete_user(user_id=f74853fa2a3b42ba85d045ed6c3a1e2f)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:59:52.396206 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba05c302-bac0-4215-9299-6bf8c0667bed admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:59:52.669260 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-ba05c302-bac0-4215-9299-6bf8c0667bed admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f74853fa2a3b42ba85d045ed6c3a1e2f'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:59:52.692944 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-ba05c302-bac0-4215-9299-6bf8c0667bed admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f74853fa2a3b42ba85d045ed6c3a1e2f'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:59:52.694163 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-ba05c302-bac0-4215-9299-6bf8c0667bed admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f74853fa2a3b42ba85d045ed6c3a1e2f'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:59:52.702702 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-ba05c302-bac0-4215-9299-6bf8c0667bed admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f74853fa2a3b42ba85d045ed6c3a1e2f'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:59:52.822632 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-ba05c302-bac0-4215-9299-6bf8c0667bed admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f74853fa2a3b42ba85d045ed6c3a1e2f'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:59:52.833849 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1022/2034] 10.222.0.65 () {58 vars in 1224 bytes} [Thu Oct 27 09:59:52 2022] DELETE /identity/v3/users/f74853fa2a3b42ba85d045ed6c3a1e2f => generated 0 bytes in 516 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 09:59:52.836545 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43209f5c-e134-4e9e-b5f3-577f43da476f None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:59:52.836960 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43209f5c-e134-4e9e-b5f3-577f43da476f None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:59:52.837271 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43209f5c-e134-4e9e-b5f3-577f43da476f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:59:52.891798 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-43209f5c-e134-4e9e-b5f3-577f43da476f None None] MFA Rules not processed for user `b5065084bf664b99bdeac46067cb0f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:59:52.895121 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-43209f5c-e134-4e9e-b5f3-577f43da476f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:59:52.980926 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1013/2035] 10.222.0.65 () {58 vars in 958 bytes} [Thu Oct 27 09:59:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 09:59:52.991563 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba05c302-bac0-4215-9299-6bf8c0667bed admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:59:52.991563 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-ba05c302-bac0-4215-9299-6bf8c0667bed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:59:53.043891 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:59:53.058060 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba05c302-bac0-4215-9299-6bf8c0667bed admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:59:53.068912 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9705d315-6227-4a12-a9ad-37a74a511d1d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6191cc41efa74f46b49022cf387f7a4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc2e3a7a1bcc480891c0b433291c00b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:59:53.068912 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9705d315-6227-4a12-a9ad-37a74a511d1d service neutron] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:59:53.068912 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9705d315-6227-4a12-a9ad-37a74a511d1d service neutron] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:59:53.068912 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9705d315-6227-4a12-a9ad-37a74a511d1d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:59:53.086024 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9705d315-6227-4a12-a9ad-37a74a511d1d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:59:53.087891 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9705d315-6227-4a12-a9ad-37a74a511d1d service neutron] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:59:53.102160 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1023/2036] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Oct 27 09:59:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 09:59:53.296555 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43209f5c-e134-4e9e-b5f3-577f43da476f None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:59:53.298015 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-43209f5c-e134-4e9e-b5f3-577f43da476f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:59:53.311943 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43209f5c-e134-4e9e-b5f3-577f43da476f None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:59:53.319462 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7a97dc-76cd-4280-83a9-7e85586b68a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:59:53.319462 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7a97dc-76cd-4280-83a9-7e85586b68a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:59:53.319805 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7a97dc-76cd-4280-83a9-7e85586b68a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:59:53.320087 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7a97dc-76cd-4280-83a9-7e85586b68a4 admin admin] PATH_INFO: `/v3/users/cd9d226e6d994e769c1954a9c5bd4fcf` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:59:53.321359 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7a97dc-76cd-4280-83a9-7e85586b68a4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cd9d226e6d994e769c1954a9c5bd4fcf)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:59:53.323697 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7a97dc-76cd-4280-83a9-7e85586b68a4 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:59:53.637961 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9705d315-6227-4a12-a9ad-37a74a511d1d service neutron] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:59:53.639544 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-9705d315-6227-4a12-a9ad-37a74a511d1d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:59:53.654839 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9705d315-6227-4a12-a9ad-37a74a511d1d service neutron] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:59:53.660602 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10a713f-2e25-4950-a2fa-602b64c6f6b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:59:53.661257 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10a713f-2e25-4950-a2fa-602b64c6f6b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:59:53.661538 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10a713f-2e25-4950-a2fa-602b64c6f6b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:59:53.661814 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10a713f-2e25-4950-a2fa-602b64c6f6b8 admin admin] PATH_INFO: `/v3/projects/f45aed87abba4e1abb44dcb2e6b9b990` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:59:53.663054 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10a713f-2e25-4950-a2fa-602b64c6f6b8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f45aed87abba4e1abb44dcb2e6b9b990)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:59:53.665089 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10a713f-2e25-4950-a2fa-602b64c6f6b8 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:59:53.691225 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-9c7a97dc-76cd-4280-83a9-7e85586b68a4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cd9d226e6d994e769c1954a9c5bd4fcf'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:59:53.692033 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-9c7a97dc-76cd-4280-83a9-7e85586b68a4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cd9d226e6d994e769c1954a9c5bd4fcf'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:59:53.705986 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-9c7a97dc-76cd-4280-83a9-7e85586b68a4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cd9d226e6d994e769c1954a9c5bd4fcf'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:59:53.705986 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-9c7a97dc-76cd-4280-83a9-7e85586b68a4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cd9d226e6d994e769c1954a9c5bd4fcf'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:59:53.719177 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-9c7a97dc-76cd-4280-83a9-7e85586b68a4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cd9d226e6d994e769c1954a9c5bd4fcf'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:59:53.819703 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1014/2037] 10.222.0.65 () {58 vars in 1224 bytes} [Thu Oct 27 09:59:53 2022] DELETE /identity/v3/users/cd9d226e6d994e769c1954a9c5bd4fcf => generated 0 bytes in 523 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 09:59:53.836762 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-f10a713f-2e25-4950-a2fa-602b64c6f6b8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f45aed87abba4e1abb44dcb2e6b9b990', 'request_id': 'req-f10a713f-2e25-4950-a2fa-602b64c6f6b8'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:59:53.954559 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-f10a713f-2e25-4950-a2fa-602b64c6f6b8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f45aed87abba4e1abb44dcb2e6b9b990', 'request_id': 'req-f10a713f-2e25-4950-a2fa-602b64c6f6b8'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:59:53.962554 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-f10a713f-2e25-4950-a2fa-602b64c6f6b8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f45aed87abba4e1abb44dcb2e6b9b990', 'request_id': 'req-f10a713f-2e25-4950-a2fa-602b64c6f6b8'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:59:53.976070 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-f10a713f-2e25-4950-a2fa-602b64c6f6b8 admin admin] The token cache is being invalidate because project f45aed87abba4e1abb44dcb2e6b9b990 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 09:59:53.976387 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-f10a713f-2e25-4950-a2fa-602b64c6f6b8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:59:53.977110 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-f10a713f-2e25-4950-a2fa-602b64c6f6b8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:59:53.978706 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1024/2038] 10.222.0.65 () {58 vars in 1233 bytes} [Thu Oct 27 09:59:53 2022] DELETE /identity/v3/projects/f45aed87abba4e1abb44dcb2e6b9b990 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 09:59:53.983723 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0e9672-f67b-4679-b404-6260614e80ae None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:59:53.984235 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0e9672-f67b-4679-b404-6260614e80ae None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:59:53.984334 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0e9672-f67b-4679-b404-6260614e80ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:59:54.005654 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-0c0e9672-f67b-4679-b404-6260614e80ae None None] MFA Rules not processed for user `b5065084bf664b99bdeac46067cb0f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:59:54.007109 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-0c0e9672-f67b-4679-b404-6260614e80ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:59:54.072305 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1015/2039] 10.222.0.65 () {58 vars in 958 bytes} [Thu Oct 27 09:59:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 09:59:54.077663 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10a713f-2e25-4950-a2fa-602b64c6f6b8 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:59:54.080519 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-f10a713f-2e25-4950-a2fa-602b64c6f6b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:59:54.087444 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67afd87e-825b-4390-bf6a-46352d2b8689 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:59:54.087812 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67afd87e-825b-4390-bf6a-46352d2b8689 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:59:54.087985 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67afd87e-825b-4390-bf6a-46352d2b8689 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:59:54.098098 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:59:54.110866 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-67afd87e-825b-4390-bf6a-46352d2b8689 None None] MFA Rules not processed for user `b5065084bf664b99bdeac46067cb0f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:59:54.112063 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-67afd87e-825b-4390-bf6a-46352d2b8689 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:59:54.127226 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1016/2040] 10.222.0.65 () {58 vars in 958 bytes} [Thu Oct 27 09:59:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 09:59:54.132829 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67afd87e-825b-4390-bf6a-46352d2b8689 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:59:54.140778 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67afd87e-825b-4390-bf6a-46352d2b8689 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:59:54.146082 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a1a0cf-3d43-4dbc-ba65-12e50a31f405 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:59:54.146839 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a1a0cf-3d43-4dbc-ba65-12e50a31f405 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:59:54.147244 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a1a0cf-3d43-4dbc-ba65-12e50a31f405 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:59:54.147904 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a1a0cf-3d43-4dbc-ba65-12e50a31f405 admin admin] PATH_INFO: `/v3/domains` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:59:54.148223 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a1a0cf-3d43-4dbc-ba65-12e50a31f405 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 09:59:54.148710 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a1a0cf-3d43-4dbc-ba65-12e50a31f405 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:59:54.150140 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a1a0cf-3d43-4dbc-ba65-12e50a31f405 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:59:54.166480 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1017/2041] 10.222.0.65 () {58 vars in 1153 bytes} [Thu Oct 27 09:59:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 09:59:54.167551 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a1a0cf-3d43-4dbc-ba65-12e50a31f405 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:59:54.177888 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a1a0cf-3d43-4dbc-ba65-12e50a31f405 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:59:54.184336 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eaf5560-746b-4403-af3a-93a1efcce0b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:59:54.184976 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eaf5560-746b-4403-af3a-93a1efcce0b6 admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:59:54.185262 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eaf5560-746b-4403-af3a-93a1efcce0b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:59:54.185538 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eaf5560-746b-4403-af3a-93a1efcce0b6 admin admin] PATH_INFO: `/v3/projects` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:59:54.187869 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eaf5560-746b-4403-af3a-93a1efcce0b6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:59:54.188085 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10a713f-2e25-4950-a2fa-602b64c6f6b8 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:59:54.188207 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eaf5560-746b-4403-af3a-93a1efcce0b6 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:59:54.192852 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfa8643-ff94-4252-915b-9f0e84076cae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:59:54.193481 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfa8643-ff94-4252-915b-9f0e84076cae admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:59:54.194005 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfa8643-ff94-4252-915b-9f0e84076cae admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:59:54.194749 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfa8643-ff94-4252-915b-9f0e84076cae admin admin] PATH_INFO: `/v3/projects/406aa3937b4346e8a0053d62ffaf0926` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:59:54.195587 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bfa8643-ff94-4252-915b-9f0e84076cae admin admin] RBAC: Authorizing `identity:delete_project(project_id=406aa3937b4346e8a0053d62ffaf0926)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:59:54.197794 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bfa8643-ff94-4252-915b-9f0e84076cae admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:59:54.298163 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1018/2042] 10.222.0.65 () {60 vars in 1153 bytes} [Thu Oct 27 09:59:54 2022] POST /identity/v3/projects => generated 367 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 09:59:54.302219 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eaf5560-746b-4403-af3a-93a1efcce0b6 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:59:54.361482 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-9bfa8643-ff94-4252-915b-9f0e84076cae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '406aa3937b4346e8a0053d62ffaf0926', 'request_id': 'req-9bfa8643-ff94-4252-915b-9f0e84076cae'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:59:54.394217 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eaf5560-746b-4403-af3a-93a1efcce0b6 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:59:54.440466 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-9bfa8643-ff94-4252-915b-9f0e84076cae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '406aa3937b4346e8a0053d62ffaf0926', 'request_id': 'req-9bfa8643-ff94-4252-915b-9f0e84076cae'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:59:54.450916 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-9bfa8643-ff94-4252-915b-9f0e84076cae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '406aa3937b4346e8a0053d62ffaf0926', 'request_id': 'req-9bfa8643-ff94-4252-915b-9f0e84076cae'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:59:54.453987 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:59:54.472040 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-9bfa8643-ff94-4252-915b-9f0e84076cae admin admin] The token cache is being invalidate because project 406aa3937b4346e8a0053d62ffaf0926 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 09:59:54.472299 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-9bfa8643-ff94-4252-915b-9f0e84076cae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:59:54.472495 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbb18c0-f012-4e65-9652-1ef68ed5d761 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:59:54.472953 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-9bfa8643-ff94-4252-915b-9f0e84076cae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:59:54.473287 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbb18c0-f012-4e65-9652-1ef68ed5d761 admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:59:54.473570 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbb18c0-f012-4e65-9652-1ef68ed5d761 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:59:54.473847 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbb18c0-f012-4e65-9652-1ef68ed5d761 admin admin] PATH_INFO: `/v3/users` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:59:54.474481 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbb18c0-f012-4e65-9652-1ef68ed5d761 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:59:54.477513 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbb18c0-f012-4e65-9652-1ef68ed5d761 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:59:54.478228 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1025/2043] 10.222.0.65 () {58 vars in 1233 bytes} [Thu Oct 27 09:59:54 2022] DELETE /identity/v3/projects/406aa3937b4346e8a0053d62ffaf0926 => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 09:59:54.479128 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfa8643-ff94-4252-915b-9f0e84076cae admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:59:54.480544 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-9bfa8643-ff94-4252-915b-9f0e84076cae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:59:54.505002 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfa8643-ff94-4252-915b-9f0e84076cae admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:59:54.510804 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bbb6d0-0868-41c5-bf22-b6997c32d09c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:59:54.511459 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bbb6d0-0868-41c5-bf22-b6997c32d09c admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:59:54.511744 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bbb6d0-0868-41c5-bf22-b6997c32d09c admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:59:54.512019 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bbb6d0-0868-41c5-bf22-b6997c32d09c admin admin] PATH_INFO: `/v3/users/9983066410de406a970048543b603e36` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:59:54.513439 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bbb6d0-0868-41c5-bf22-b6997c32d09c admin admin] RBAC: Authorizing `identity:delete_user(user_id=9983066410de406a970048543b603e36)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:59:54.515433 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bbb6d0-0868-41c5-bf22-b6997c32d09c admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:59:54.581784 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1019/2044] 10.222.0.65 () {60 vars in 1144 bytes} [Thu Oct 27 09:59:54 2022] POST /identity/v3/users => generated 284 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 09:59:54.583112 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbb18c0-f012-4e65-9652-1ef68ed5d761 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:59:54.585608 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-1fbb18c0-f012-4e65-9652-1ef68ed5d761 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:59:54.598753 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbb18c0-f012-4e65-9652-1ef68ed5d761 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:59:54.604064 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56daa531-b4e7-436f-8011-1227a3becc3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:59:54.608185 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56daa531-b4e7-436f-8011-1227a3becc3b admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:59:54.608185 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56daa531-b4e7-436f-8011-1227a3becc3b admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:59:54.608185 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56daa531-b4e7-436f-8011-1227a3becc3b admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:59:54.608185 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56daa531-b4e7-436f-8011-1227a3becc3b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:59:54.608185 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56daa531-b4e7-436f-8011-1227a3becc3b admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:59:54.618049 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1020/2045] 10.222.0.65 () {58 vars in 1122 bytes} [Thu Oct 27 09:59:54 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 09:59:54.622154 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56daa531-b4e7-436f-8011-1227a3becc3b admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:59:54.632661 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56daa531-b4e7-436f-8011-1227a3becc3b admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:59:54.637490 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff2f81e-7385-4b3d-8f31-9098bb5c149a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:59:54.638118 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff2f81e-7385-4b3d-8f31-9098bb5c149a admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:59:54.638387 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff2f81e-7385-4b3d-8f31-9098bb5c149a admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:59:54.638717 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff2f81e-7385-4b3d-8f31-9098bb5c149a admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:59:54.639349 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff2f81e-7385-4b3d-8f31-9098bb5c149a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:59:54.640964 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff2f81e-7385-4b3d-8f31-9098bb5c149a admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:59:54.657409 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1021/2046] 10.222.0.65 () {58 vars in 1122 bytes} [Thu Oct 27 09:59:54 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 09:59:54.658592 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff2f81e-7385-4b3d-8f31-9098bb5c149a admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:59:54.669579 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff2f81e-7385-4b3d-8f31-9098bb5c149a admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:59:54.674628 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa6c27a-72e8-429d-a6f4-e9e81691814c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:59:54.675479 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa6c27a-72e8-429d-a6f4-e9e81691814c admin admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:59:54.675766 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa6c27a-72e8-429d-a6f4-e9e81691814c admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:59:54.676047 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa6c27a-72e8-429d-a6f4-e9e81691814c admin admin] PATH_INFO: `/v3/projects/baaabbdd3b3a4cc7916ab0bd4049f5e8/users/26bbdad762094afbaa221f3974d71029/roles/43543ce1450245af9661cb017bac17bd` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:59:54.691826 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa6c27a-72e8-429d-a6f4-e9e81691814c admin admin] RBAC: Authorizing `identity:create_grant(project_id=baaabbdd3b3a4cc7916ab0bd4049f5e8, user_id=26bbdad762094afbaa221f3974d71029, role_id=43543ce1450245af9661cb017bac17bd)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:59:54.695825 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa6c27a-72e8-429d-a6f4-e9e81691814c admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:59:54.726957 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-31bbb6d0-0868-41c5-bf22-b6997c32d09c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9983066410de406a970048543b603e36'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:59:54.739320 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-31bbb6d0-0868-41c5-bf22-b6997c32d09c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9983066410de406a970048543b603e36'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:59:54.741160 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-31bbb6d0-0868-41c5-bf22-b6997c32d09c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9983066410de406a970048543b603e36'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:59:54.749198 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-31bbb6d0-0868-41c5-bf22-b6997c32d09c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9983066410de406a970048543b603e36'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:59:54.770746 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1022/2047] 10.222.0.65 () {60 vars in 1483 bytes} [Thu Oct 27 09:59:54 2022] PUT /identity/v3/projects/baaabbdd3b3a4cc7916ab0bd4049f5e8/users/26bbdad762094afbaa221f3974d71029/roles/43543ce1450245af9661cb017bac17bd => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 09:59:54.783595 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20919c51-9c69-4099-aa69-50766e32929b None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:59:54.783900 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20919c51-9c69-4099-aa69-50766e32929b None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:59:54.784170 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20919c51-9c69-4099-aa69-50766e32929b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:59:54.807522 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:59:54.818268 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-20919c51-9c69-4099-aa69-50766e32929b None None] MFA Rules not processed for user `26bbdad762094afbaa221f3974d71029`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 09:59:54.820583 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-20919c51-9c69-4099-aa69-50766e32929b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:59:54.834246 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-31bbb6d0-0868-41c5-bf22-b6997c32d09c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9983066410de406a970048543b603e36'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:59:54.841744 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1026/2048] 10.222.0.65 () {58 vars in 1224 bytes} [Thu Oct 27 09:59:54 2022] DELETE /identity/v3/users/9983066410de406a970048543b603e36 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 09:59:54.898925 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1023/2049] 10.222.0.65 () {58 vars in 958 bytes} [Thu Oct 27 09:59:54 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 09:59:54.910622 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bbb6d0-0868-41c5-bf22-b6997c32d09c admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:59:54.912170 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-31bbb6d0-0868-41c5-bf22-b6997c32d09c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:59:54.989055 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bbb6d0-0868-41c5-bf22-b6997c32d09c admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:59:54.994068 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ff4e59-fe78-4d53-97a0-37466759f409 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4b0886666584397be686ee02a505269', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc2e3a7a1bcc480891c0b433291c00b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:59:54.994835 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ff4e59-fe78-4d53-97a0-37466759f409 service glance] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:59:54.995159 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ff4e59-fe78-4d53-97a0-37466759f409 service glance] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:59:54.995511 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ff4e59-fe78-4d53-97a0-37466759f409 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:59:55.067648 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ff4e59-fe78-4d53-97a0-37466759f409 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:59:55.070261 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ff4e59-fe78-4d53-97a0-37466759f409 service glance] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:59:55.081689 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1027/2050] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Oct 27 09:59:54 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 09:59:55.150891 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20919c51-9c69-4099-aa69-50766e32929b None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 09:59:55.152244 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-20919c51-9c69-4099-aa69-50766e32929b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 09:59:55.238593 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20919c51-9c69-4099-aa69-50766e32929b None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 09:59:55.332257 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fc8fd9-bced-4027-ab75-ce4ce76723b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 09:59:55.333206 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fc8fd9-bced-4027-ab75-ce4ce76723b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 09:59:55.333490 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fc8fd9-bced-4027-ab75-ce4ce76723b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 09:59:55.333762 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fc8fd9-bced-4027-ab75-ce4ce76723b7 admin admin] PATH_INFO: `/v3/projects/41f81fce52884ead9edd23a4d2621f2e` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 09:59:55.335152 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9fc8fd9-bced-4027-ab75-ce4ce76723b7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=41f81fce52884ead9edd23a4d2621f2e)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 09:59:55.337094 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9fc8fd9-bced-4027-ab75-ce4ce76723b7 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 09:59:55.468554 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-a9fc8fd9-bced-4027-ab75-ce4ce76723b7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '41f81fce52884ead9edd23a4d2621f2e', 'request_id': 'req-a9fc8fd9-bced-4027-ab75-ce4ce76723b7'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:59:55.469861 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:59:55.477137 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-a9fc8fd9-bced-4027-ab75-ce4ce76723b7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '41f81fce52884ead9edd23a4d2621f2e', 'request_id': 'req-a9fc8fd9-bced-4027-ab75-ce4ce76723b7'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:59:55.575265 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-a9fc8fd9-bced-4027-ab75-ce4ce76723b7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '41f81fce52884ead9edd23a4d2621f2e', 'request_id': 'req-a9fc8fd9-bced-4027-ab75-ce4ce76723b7'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:59:55.587858 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-a9fc8fd9-bced-4027-ab75-ce4ce76723b7 admin admin] The token cache is being invalidate because project 41f81fce52884ead9edd23a4d2621f2e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 09:59:55.588147 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-a9fc8fd9-bced-4027-ab75-ce4ce76723b7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:59:55.588791 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-a9fc8fd9-bced-4027-ab75-ce4ce76723b7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 09:59:55.590306 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1024/2051] 10.222.0.65 () {58 vars in 1233 bytes} [Thu Oct 27 09:59:55 2022] DELETE /identity/v3/projects/41f81fce52884ead9edd23a4d2621f2e => generated 0 bytes in 440 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 10:00:05.075729 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=79,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:00:05.686051 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=6,keystone:INSERT=1,keystone:DELETE=3 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:00:22.840426 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ff4e59-fe78-4d53-97a0-37466759f409 service glance] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:00:22.841905 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-63ff4e59-fe78-4d53-97a0-37466759f409 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 10:00:22.856546 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ff4e59-fe78-4d53-97a0-37466759f409 service glance] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:00:22.914231 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf72740-e56c-475b-b507-bba8a1a31754 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:00:22.914901 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf72740-e56c-475b-b507-bba8a1a31754 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:00:22.915188 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf72740-e56c-475b-b507-bba8a1a31754 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:00:22.915470 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf72740-e56c-475b-b507-bba8a1a31754 admin admin] PATH_INFO: `/v3/users/26bbdad762094afbaa221f3974d71029` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:00:22.916640 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf72740-e56c-475b-b507-bba8a1a31754 admin admin] RBAC: Authorizing `identity:delete_user(user_id=26bbdad762094afbaa221f3974d71029)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:00:22.918632 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf72740-e56c-475b-b507-bba8a1a31754 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:00:23.084992 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-acf72740-e56c-475b-b507-bba8a1a31754 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '26bbdad762094afbaa221f3974d71029'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:00:23.097417 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-acf72740-e56c-475b-b507-bba8a1a31754 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '26bbdad762094afbaa221f3974d71029'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:00:23.098096 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-acf72740-e56c-475b-b507-bba8a1a31754 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '26bbdad762094afbaa221f3974d71029'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:00:23.105059 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-acf72740-e56c-475b-b507-bba8a1a31754 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '26bbdad762094afbaa221f3974d71029'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:00:23.176321 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-acf72740-e56c-475b-b507-bba8a1a31754 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '26bbdad762094afbaa221f3974d71029'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:00:23.183969 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1028/2052] 10.222.0.65 () {58 vars in 1224 bytes} [Thu Oct 27 10:00:22 2022] DELETE /identity/v3/users/26bbdad762094afbaa221f3974d71029 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 10:00:23.189392 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9135fe84-5372-42bd-ba6b-edc77269700d None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:00:23.189932 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9135fe84-5372-42bd-ba6b-edc77269700d None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:00:23.189932 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9135fe84-5372-42bd-ba6b-edc77269700d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:00:23.209341 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-9135fe84-5372-42bd-ba6b-edc77269700d None None] MFA Rules not processed for user `b5065084bf664b99bdeac46067cb0f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 10:00:23.210793 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-9135fe84-5372-42bd-ba6b-edc77269700d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 10:00:23.269758 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1025/2053] 10.222.0.65 () {58 vars in 958 bytes} [Thu Oct 27 10:00:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 10:00:23.279754 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf72740-e56c-475b-b507-bba8a1a31754 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:00:23.281665 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-acf72740-e56c-475b-b507-bba8a1a31754 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 10:00:23.340927 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf72740-e56c-475b-b507-bba8a1a31754 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:00:23.344901 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b01dd7-d885-4748-85e4-f391665a33c2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6191cc41efa74f46b49022cf387f7a4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc2e3a7a1bcc480891c0b433291c00b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:00:23.345540 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b01dd7-d885-4748-85e4-f391665a33c2 service neutron] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:00:23.345825 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b01dd7-d885-4748-85e4-f391665a33c2 service neutron] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:00:23.346111 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b01dd7-d885-4748-85e4-f391665a33c2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:00:23.355250 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b01dd7-d885-4748-85e4-f391665a33c2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:00:23.356685 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b01dd7-d885-4748-85e4-f391665a33c2 service neutron] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:00:23.367178 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1029/2054] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Oct 27 10:00:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 10:00:23.813261 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9135fe84-5372-42bd-ba6b-edc77269700d None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:00:23.814948 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-9135fe84-5372-42bd-ba6b-edc77269700d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 10:00:23.828936 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9135fe84-5372-42bd-ba6b-edc77269700d None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:00:23.833710 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00aa3ffa-8f7d-48c0-8cc1-7fc308b1097a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:00:23.834347 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00aa3ffa-8f7d-48c0-8cc1-7fc308b1097a admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:00:23.834661 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00aa3ffa-8f7d-48c0-8cc1-7fc308b1097a admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:00:23.834941 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00aa3ffa-8f7d-48c0-8cc1-7fc308b1097a admin admin] PATH_INFO: `/v3/projects/baaabbdd3b3a4cc7916ab0bd4049f5e8` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:00:23.836100 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00aa3ffa-8f7d-48c0-8cc1-7fc308b1097a admin admin] RBAC: Authorizing `identity:delete_project(project_id=baaabbdd3b3a4cc7916ab0bd4049f5e8)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:00:23.838149 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00aa3ffa-8f7d-48c0-8cc1-7fc308b1097a admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:00:23.980923 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-00aa3ffa-8f7d-48c0-8cc1-7fc308b1097a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'baaabbdd3b3a4cc7916ab0bd4049f5e8', 'request_id': 'req-00aa3ffa-8f7d-48c0-8cc1-7fc308b1097a'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:00:23.987697 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-00aa3ffa-8f7d-48c0-8cc1-7fc308b1097a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'baaabbdd3b3a4cc7916ab0bd4049f5e8', 'request_id': 'req-00aa3ffa-8f7d-48c0-8cc1-7fc308b1097a'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:00:24.062341 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-00aa3ffa-8f7d-48c0-8cc1-7fc308b1097a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'baaabbdd3b3a4cc7916ab0bd4049f5e8', 'request_id': 'req-00aa3ffa-8f7d-48c0-8cc1-7fc308b1097a'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:00:24.073678 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-00aa3ffa-8f7d-48c0-8cc1-7fc308b1097a admin admin] The token cache is being invalidate because project baaabbdd3b3a4cc7916ab0bd4049f5e8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 10:00:24.073971 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-00aa3ffa-8f7d-48c0-8cc1-7fc308b1097a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:00:24.074651 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-00aa3ffa-8f7d-48c0-8cc1-7fc308b1097a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:00:24.077890 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1026/2055] 10.222.0.65 () {58 vars in 1233 bytes} [Thu Oct 27 10:00:23 2022] DELETE /identity/v3/projects/baaabbdd3b3a4cc7916ab0bd4049f5e8 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 10:00:24.082501 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36022bf8-d916-44f7-a868-86417c6142a3 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:00:24.083047 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36022bf8-d916-44f7-a868-86417c6142a3 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:00:24.083185 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36022bf8-d916-44f7-a868-86417c6142a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:00:24.104023 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-36022bf8-d916-44f7-a868-86417c6142a3 None None] MFA Rules not processed for user `b5065084bf664b99bdeac46067cb0f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 10:00:24.105169 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-36022bf8-d916-44f7-a868-86417c6142a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 10:00:24.122256 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:00:24.166894 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1030/2056] 10.222.0.65 () {58 vars in 958 bytes} [Thu Oct 27 10:00:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 10:00:24.175155 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6572dead-79b5-408f-bdff-ec522ea17a05 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:00:24.175534 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6572dead-79b5-408f-bdff-ec522ea17a05 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:00:24.175721 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6572dead-79b5-408f-bdff-ec522ea17a05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:00:24.197023 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-6572dead-79b5-408f-bdff-ec522ea17a05 None None] MFA Rules not processed for user `b5065084bf664b99bdeac46067cb0f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 10:00:24.198362 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-6572dead-79b5-408f-bdff-ec522ea17a05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 10:00:24.207627 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1027/2057] 10.222.0.65 () {58 vars in 958 bytes} [Thu Oct 27 10:00:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 10:00:24.212179 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36022bf8-d916-44f7-a868-86417c6142a3 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:00:24.222318 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36022bf8-d916-44f7-a868-86417c6142a3 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:00:24.227650 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa52783-623c-4f1b-bb60-8e32de222463 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:00:24.228253 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa52783-623c-4f1b-bb60-8e32de222463 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:00:24.228569 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa52783-623c-4f1b-bb60-8e32de222463 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:00:24.228849 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa52783-623c-4f1b-bb60-8e32de222463 admin admin] PATH_INFO: `/v3/domains` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:00:24.229497 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa52783-623c-4f1b-bb60-8e32de222463 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 10:00:24.229806 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa52783-623c-4f1b-bb60-8e32de222463 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:00:24.231459 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa52783-623c-4f1b-bb60-8e32de222463 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:00:24.243437 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1031/2058] 10.222.0.65 () {58 vars in 1153 bytes} [Thu Oct 27 10:00:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 10:00:24.247724 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6572dead-79b5-408f-bdff-ec522ea17a05 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:00:24.257437 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6572dead-79b5-408f-bdff-ec522ea17a05 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:00:24.262038 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29136496-7dfb-4328-ba9c-397b64948bf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:00:24.262653 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29136496-7dfb-4328-ba9c-397b64948bf6 admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:00:24.262931 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29136496-7dfb-4328-ba9c-397b64948bf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:00:24.263199 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29136496-7dfb-4328-ba9c-397b64948bf6 admin admin] PATH_INFO: `/v3/projects` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:00:24.263835 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29136496-7dfb-4328-ba9c-397b64948bf6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:00:24.266318 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29136496-7dfb-4328-ba9c-397b64948bf6 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:00:24.355778 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1028/2059] 10.222.0.65 () {60 vars in 1153 bytes} [Thu Oct 27 10:00:24 2022] POST /identity/v3/projects => generated 375 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 10:00:24.360005 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa52783-623c-4f1b-bb60-8e32de222463 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:00:24.370205 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa52783-623c-4f1b-bb60-8e32de222463 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:00:24.430461 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa3826e-a80f-48db-b783-3f02d7fd4656 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:00:24.431094 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa3826e-a80f-48db-b783-3f02d7fd4656 admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:00:24.431380 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa3826e-a80f-48db-b783-3f02d7fd4656 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:00:24.431658 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa3826e-a80f-48db-b783-3f02d7fd4656 admin admin] PATH_INFO: `/v3/users` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:00:24.432287 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa3826e-a80f-48db-b783-3f02d7fd4656 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:00:24.434258 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa3826e-a80f-48db-b783-3f02d7fd4656 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:00:24.537776 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1032/2060] 10.222.0.65 () {60 vars in 1144 bytes} [Thu Oct 27 10:00:24 2022] POST /identity/v3/users => generated 288 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 10:00:24.541965 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29136496-7dfb-4328-ba9c-397b64948bf6 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:00:24.553061 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29136496-7dfb-4328-ba9c-397b64948bf6 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:00:24.557765 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297f6ab2-89bb-4eac-aaa3-298c32eeee4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:00:24.558356 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297f6ab2-89bb-4eac-aaa3-298c32eeee4f admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:00:24.558734 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297f6ab2-89bb-4eac-aaa3-298c32eeee4f admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:00:24.559008 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297f6ab2-89bb-4eac-aaa3-298c32eeee4f admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:00:24.559644 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297f6ab2-89bb-4eac-aaa3-298c32eeee4f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:00:24.561266 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297f6ab2-89bb-4eac-aaa3-298c32eeee4f admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:00:24.573930 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1029/2061] 10.222.0.65 () {58 vars in 1122 bytes} [Thu Oct 27 10:00:24 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 10:00:24.578795 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa3826e-a80f-48db-b783-3f02d7fd4656 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:00:24.589298 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa3826e-a80f-48db-b783-3f02d7fd4656 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:00:24.594474 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa24228-ebf7-47fb-8bec-06eef91f7315 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:00:24.595110 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa24228-ebf7-47fb-8bec-06eef91f7315 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:00:24.595392 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa24228-ebf7-47fb-8bec-06eef91f7315 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:00:24.595666 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa24228-ebf7-47fb-8bec-06eef91f7315 admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:00:24.596312 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa24228-ebf7-47fb-8bec-06eef91f7315 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:00:24.597909 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa24228-ebf7-47fb-8bec-06eef91f7315 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:00:24.609982 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1033/2062] 10.222.0.65 () {58 vars in 1122 bytes} [Thu Oct 27 10:00:24 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 10:00:24.613984 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297f6ab2-89bb-4eac-aaa3-298c32eeee4f admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:00:24.624845 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297f6ab2-89bb-4eac-aaa3-298c32eeee4f admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:00:24.629810 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294ad8a2-9dfc-491f-ab89-a46248cd33ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:00:24.630455 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294ad8a2-9dfc-491f-ab89-a46248cd33ad admin admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:00:24.630781 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294ad8a2-9dfc-491f-ab89-a46248cd33ad admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:00:24.631055 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294ad8a2-9dfc-491f-ab89-a46248cd33ad admin admin] PATH_INFO: `/v3/projects/7977c54c3c2f4a7cb2e46a948298ffac/users/6c5676d36f744e77afc34a4f7b7cae91/roles/43543ce1450245af9661cb017bac17bd` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:00:24.646338 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294ad8a2-9dfc-491f-ab89-a46248cd33ad admin admin] RBAC: Authorizing `identity:create_grant(project_id=7977c54c3c2f4a7cb2e46a948298ffac, user_id=6c5676d36f744e77afc34a4f7b7cae91, role_id=43543ce1450245af9661cb017bac17bd)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:00:24.649079 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294ad8a2-9dfc-491f-ab89-a46248cd33ad admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:00:24.719742 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1030/2063] 10.222.0.65 () {60 vars in 1483 bytes} [Thu Oct 27 10:00:24 2022] PUT /identity/v3/projects/7977c54c3c2f4a7cb2e46a948298ffac/users/6c5676d36f744e77afc34a4f7b7cae91/roles/43543ce1450245af9661cb017bac17bd => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 10:00:24.730278 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a49bde-b5ae-4e3d-8671-0bd5ec82b9d3 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:00:24.730606 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a49bde-b5ae-4e3d-8671-0bd5ec82b9d3 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:00:24.730894 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a49bde-b5ae-4e3d-8671-0bd5ec82b9d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:00:24.761034 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-57a49bde-b5ae-4e3d-8671-0bd5ec82b9d3 None None] MFA Rules not processed for user `6c5676d36f744e77afc34a4f7b7cae91`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 10:00:24.762200 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-57a49bde-b5ae-4e3d-8671-0bd5ec82b9d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 10:00:24.828993 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1034/2064] 10.222.0.65 () {58 vars in 958 bytes} [Thu Oct 27 10:00:24 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 10:00:24.839605 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294ad8a2-9dfc-491f-ab89-a46248cd33ad admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:00:24.841449 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-294ad8a2-9dfc-491f-ab89-a46248cd33ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 10:00:24.864339 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:00:24.903162 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294ad8a2-9dfc-491f-ab89-a46248cd33ad admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:00:24.907489 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa80e5b-3395-403a-bb11-7ed99f4c8cba service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8e5d5f04c4741bb86ca4a0f667d4ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc2e3a7a1bcc480891c0b433291c00b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:00:24.908342 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa80e5b-3395-403a-bb11-7ed99f4c8cba service cinder] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:00:24.909078 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa80e5b-3395-403a-bb11-7ed99f4c8cba service cinder] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:00:24.909078 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa80e5b-3395-403a-bb11-7ed99f4c8cba service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:00:24.918086 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa80e5b-3395-403a-bb11-7ed99f4c8cba service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:00:24.919549 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa80e5b-3395-403a-bb11-7ed99f4c8cba service cinder] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:00:24.929610 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1031/2065] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Oct 27 10:00:24 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 10:00:34.825270 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=89,keystone:INSERT=3 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:00:35.113767 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=17 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:00:36.368140 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a49bde-b5ae-4e3d-8671-0bd5ec82b9d3 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:00:36.477541 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a49bde-b5ae-4e3d-8671-0bd5ec82b9d3 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:00:36.482237 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f91487-2649-41ce-a66d-e9b9296cb124 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:00:36.482887 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f91487-2649-41ce-a66d-e9b9296cb124 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:00:36.483168 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f91487-2649-41ce-a66d-e9b9296cb124 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:00:36.483442 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f91487-2649-41ce-a66d-e9b9296cb124 admin admin] PATH_INFO: `/v3/users/6c5676d36f744e77afc34a4f7b7cae91` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:00:36.484640 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f91487-2649-41ce-a66d-e9b9296cb124 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6c5676d36f744e77afc34a4f7b7cae91)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:00:36.486526 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f91487-2649-41ce-a66d-e9b9296cb124 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:00:36.651794 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-25f91487-2649-41ce-a66d-e9b9296cb124 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6c5676d36f744e77afc34a4f7b7cae91'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:00:36.664323 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-25f91487-2649-41ce-a66d-e9b9296cb124 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6c5676d36f744e77afc34a4f7b7cae91'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:00:36.665061 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-25f91487-2649-41ce-a66d-e9b9296cb124 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6c5676d36f744e77afc34a4f7b7cae91'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:00:36.673242 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-25f91487-2649-41ce-a66d-e9b9296cb124 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6c5676d36f744e77afc34a4f7b7cae91'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:00:36.786090 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-25f91487-2649-41ce-a66d-e9b9296cb124 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6c5676d36f744e77afc34a4f7b7cae91'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:00:36.792812 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1035/2066] 10.222.0.65 () {58 vars in 1224 bytes} [Thu Oct 27 10:00:36 2022] DELETE /identity/v3/users/6c5676d36f744e77afc34a4f7b7cae91 => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 10:00:36.797870 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc5c864-86b5-4351-af04-fbaeadd6e1b4 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:00:36.798394 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc5c864-86b5-4351-af04-fbaeadd6e1b4 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:00:36.798494 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc5c864-86b5-4351-af04-fbaeadd6e1b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:00:36.851289 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-4bc5c864-86b5-4351-af04-fbaeadd6e1b4 None None] MFA Rules not processed for user `b5065084bf664b99bdeac46067cb0f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 10:00:36.852470 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-4bc5c864-86b5-4351-af04-fbaeadd6e1b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 10:00:36.913595 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1032/2067] 10.222.0.65 () {58 vars in 958 bytes} [Thu Oct 27 10:00:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 10:00:36.924438 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f91487-2649-41ce-a66d-e9b9296cb124 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:00:36.925856 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-25f91487-2649-41ce-a66d-e9b9296cb124 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 10:00:36.967900 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:00:37.001583 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f91487-2649-41ce-a66d-e9b9296cb124 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:00:37.005400 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5ddcb6-d037-42a7-bea9-d4474439d412 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6191cc41efa74f46b49022cf387f7a4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc2e3a7a1bcc480891c0b433291c00b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:00:37.006061 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5ddcb6-d037-42a7-bea9-d4474439d412 service neutron] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:00:37.006285 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5ddcb6-d037-42a7-bea9-d4474439d412 service neutron] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:00:37.006593 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5ddcb6-d037-42a7-bea9-d4474439d412 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:00:37.017328 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5ddcb6-d037-42a7-bea9-d4474439d412 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:00:37.018854 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5ddcb6-d037-42a7-bea9-d4474439d412 service neutron] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:00:37.030286 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1036/2068] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Oct 27 10:00:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 10:00:37.578999 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc5c864-86b5-4351-af04-fbaeadd6e1b4 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:00:37.589446 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-4bc5c864-86b5-4351-af04-fbaeadd6e1b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 10:00:37.601985 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc5c864-86b5-4351-af04-fbaeadd6e1b4 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:00:37.607366 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0533214b-3ac3-441f-b8db-99b2d28ffcb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:00:37.608502 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0533214b-3ac3-441f-b8db-99b2d28ffcb8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:00:37.608502 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0533214b-3ac3-441f-b8db-99b2d28ffcb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:00:37.608502 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0533214b-3ac3-441f-b8db-99b2d28ffcb8 admin admin] PATH_INFO: `/v3/projects/7977c54c3c2f4a7cb2e46a948298ffac` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:00:37.610205 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0533214b-3ac3-441f-b8db-99b2d28ffcb8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7977c54c3c2f4a7cb2e46a948298ffac)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:00:37.611816 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0533214b-3ac3-441f-b8db-99b2d28ffcb8 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:00:37.758193 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-0533214b-3ac3-441f-b8db-99b2d28ffcb8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7977c54c3c2f4a7cb2e46a948298ffac', 'request_id': 'req-0533214b-3ac3-441f-b8db-99b2d28ffcb8'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:00:37.764437 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-0533214b-3ac3-441f-b8db-99b2d28ffcb8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7977c54c3c2f4a7cb2e46a948298ffac', 'request_id': 'req-0533214b-3ac3-441f-b8db-99b2d28ffcb8'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:00:37.849158 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-0533214b-3ac3-441f-b8db-99b2d28ffcb8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7977c54c3c2f4a7cb2e46a948298ffac', 'request_id': 'req-0533214b-3ac3-441f-b8db-99b2d28ffcb8'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:00:37.866918 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-0533214b-3ac3-441f-b8db-99b2d28ffcb8 admin admin] The token cache is being invalidate because project 7977c54c3c2f4a7cb2e46a948298ffac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 10:00:37.867229 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-0533214b-3ac3-441f-b8db-99b2d28ffcb8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:00:37.867913 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-0533214b-3ac3-441f-b8db-99b2d28ffcb8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:00:37.869480 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1033/2069] 10.222.0.65 () {58 vars in 1233 bytes} [Thu Oct 27 10:00:37 2022] DELETE /identity/v3/projects/7977c54c3c2f4a7cb2e46a948298ffac => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 10:00:37.874325 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3ee0ec-9f78-4be7-b571-7cabf0d519ca None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:00:37.875213 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3ee0ec-9f78-4be7-b571-7cabf0d519ca None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:00:37.875599 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3ee0ec-9f78-4be7-b571-7cabf0d519ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:00:37.935561 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-3f3ee0ec-9f78-4be7-b571-7cabf0d519ca None None] MFA Rules not processed for user `b5065084bf664b99bdeac46067cb0f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 10:00:37.935561 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-3f3ee0ec-9f78-4be7-b571-7cabf0d519ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 10:00:37.997056 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1037/2070] 10.222.0.65 () {58 vars in 958 bytes} [Thu Oct 27 10:00:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 10:00:38.004924 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5510ef52-2b22-4ba0-86a2-428cc4f0b5ee None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:00:38.005210 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5510ef52-2b22-4ba0-86a2-428cc4f0b5ee None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:00:38.005531 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5510ef52-2b22-4ba0-86a2-428cc4f0b5ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:00:38.027075 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-5510ef52-2b22-4ba0-86a2-428cc4f0b5ee None None] MFA Rules not processed for user `b5065084bf664b99bdeac46067cb0f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 10:00:38.028290 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-5510ef52-2b22-4ba0-86a2-428cc4f0b5ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 10:00:38.037382 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1034/2071] 10.222.0.65 () {58 vars in 958 bytes} [Thu Oct 27 10:00:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 10:00:38.041854 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3ee0ec-9f78-4be7-b571-7cabf0d519ca None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:00:38.052209 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3ee0ec-9f78-4be7-b571-7cabf0d519ca None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:00:38.057530 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e653200b-ca4b-49dc-b59e-3025b4af0286 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:00:38.057530 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e653200b-ca4b-49dc-b59e-3025b4af0286 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:00:38.057796 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e653200b-ca4b-49dc-b59e-3025b4af0286 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:00:38.058030 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e653200b-ca4b-49dc-b59e-3025b4af0286 admin admin] PATH_INFO: `/v3/domains` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:00:38.058658 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e653200b-ca4b-49dc-b59e-3025b4af0286 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 10:00:38.058966 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e653200b-ca4b-49dc-b59e-3025b4af0286 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:00:38.060556 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e653200b-ca4b-49dc-b59e-3025b4af0286 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:00:38.072807 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1038/2072] 10.222.0.65 () {58 vars in 1153 bytes} [Thu Oct 27 10:00:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 10:00:38.077316 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5510ef52-2b22-4ba0-86a2-428cc4f0b5ee None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:00:38.087780 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5510ef52-2b22-4ba0-86a2-428cc4f0b5ee None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:00:38.092454 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f33f697-dee3-4ef1-96e7-b59ebbcebdd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:00:38.093072 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f33f697-dee3-4ef1-96e7-b59ebbcebdd9 admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:00:38.093345 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f33f697-dee3-4ef1-96e7-b59ebbcebdd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:00:38.094180 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f33f697-dee3-4ef1-96e7-b59ebbcebdd9 admin admin] PATH_INFO: `/v3/projects` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:00:38.094869 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f33f697-dee3-4ef1-96e7-b59ebbcebdd9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:00:38.096752 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f33f697-dee3-4ef1-96e7-b59ebbcebdd9 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:00:38.208772 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1035/2073] 10.222.0.65 () {60 vars in 1153 bytes} [Thu Oct 27 10:00:38 2022] POST /identity/v3/projects => generated 375 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 10:00:38.212812 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e653200b-ca4b-49dc-b59e-3025b4af0286 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:00:38.223552 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e653200b-ca4b-49dc-b59e-3025b4af0286 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:00:38.279565 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4f8f4b-0118-4c35-9ce6-96497985bc01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:00:38.280167 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4f8f4b-0118-4c35-9ce6-96497985bc01 admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:00:38.280450 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4f8f4b-0118-4c35-9ce6-96497985bc01 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:00:38.280727 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4f8f4b-0118-4c35-9ce6-96497985bc01 admin admin] PATH_INFO: `/v3/users` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:00:38.281975 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4f8f4b-0118-4c35-9ce6-96497985bc01 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:00:38.283926 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4f8f4b-0118-4c35-9ce6-96497985bc01 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:00:38.393405 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1039/2074] 10.222.0.65 () {60 vars in 1144 bytes} [Thu Oct 27 10:00:38 2022] POST /identity/v3/users => generated 288 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 10:00:38.394749 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f33f697-dee3-4ef1-96e7-b59ebbcebdd9 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:00:38.406724 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f33f697-dee3-4ef1-96e7-b59ebbcebdd9 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:00:38.411724 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63218f0-334a-480d-b384-40b1de7f642d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:00:38.412358 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63218f0-334a-480d-b384-40b1de7f642d admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:00:38.412619 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63218f0-334a-480d-b384-40b1de7f642d admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:00:38.412895 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63218f0-334a-480d-b384-40b1de7f642d admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:00:38.413545 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63218f0-334a-480d-b384-40b1de7f642d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:00:38.415199 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63218f0-334a-480d-b384-40b1de7f642d admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:00:38.427411 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1036/2075] 10.222.0.65 () {58 vars in 1122 bytes} [Thu Oct 27 10:00:38 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 10:00:38.431392 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4f8f4b-0118-4c35-9ce6-96497985bc01 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:00:38.442624 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4f8f4b-0118-4c35-9ce6-96497985bc01 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:00:38.447696 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e13ef0-63f5-48bd-a1be-2417acbb3e66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:00:38.448309 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e13ef0-63f5-48bd-a1be-2417acbb3e66 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:00:38.448585 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e13ef0-63f5-48bd-a1be-2417acbb3e66 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:00:38.448862 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e13ef0-63f5-48bd-a1be-2417acbb3e66 admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:00:38.449507 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e13ef0-63f5-48bd-a1be-2417acbb3e66 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:00:38.451409 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e13ef0-63f5-48bd-a1be-2417acbb3e66 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:00:38.463375 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1040/2076] 10.222.0.65 () {58 vars in 1122 bytes} [Thu Oct 27 10:00:38 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 10:00:38.467687 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63218f0-334a-480d-b384-40b1de7f642d admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:00:38.479184 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63218f0-334a-480d-b384-40b1de7f642d admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:00:38.486727 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2ef659-3c2e-4318-bb14-0cdeaa07b3d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:00:38.487437 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2ef659-3c2e-4318-bb14-0cdeaa07b3d1 admin admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:00:38.487717 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2ef659-3c2e-4318-bb14-0cdeaa07b3d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:00:38.488136 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2ef659-3c2e-4318-bb14-0cdeaa07b3d1 admin admin] PATH_INFO: `/v3/projects/442ed9074e764712a65404033d739f47/users/f0050007e14f4651bf5805d0cb36f58c/roles/43543ce1450245af9661cb017bac17bd` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:00:38.504969 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2ef659-3c2e-4318-bb14-0cdeaa07b3d1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=442ed9074e764712a65404033d739f47, user_id=f0050007e14f4651bf5805d0cb36f58c, role_id=43543ce1450245af9661cb017bac17bd)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:00:38.507865 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2ef659-3c2e-4318-bb14-0cdeaa07b3d1 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:00:38.509988 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:00:38.615717 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1037/2077] 10.222.0.65 () {60 vars in 1483 bytes} [Thu Oct 27 10:00:38 2022] PUT /identity/v3/projects/442ed9074e764712a65404033d739f47/users/f0050007e14f4651bf5805d0cb36f58c/roles/43543ce1450245af9661cb017bac17bd => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 10:00:38.627685 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23ef3db-d017-4966-836d-9243e4fa055e None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:00:38.628032 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23ef3db-d017-4966-836d-9243e4fa055e None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:00:38.628259 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23ef3db-d017-4966-836d-9243e4fa055e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:00:38.642428 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:00:38.658053 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-d23ef3db-d017-4966-836d-9243e4fa055e None None] MFA Rules not processed for user `f0050007e14f4651bf5805d0cb36f58c`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 10:00:38.659325 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-d23ef3db-d017-4966-836d-9243e4fa055e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 10:00:38.681974 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2ef659-3c2e-4318-bb14-0cdeaa07b3d1 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:00:38.683742 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-2c2ef659-3c2e-4318-bb14-0cdeaa07b3d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 10:00:38.739139 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1041/2078] 10.222.0.65 () {58 vars in 958 bytes} [Thu Oct 27 10:00:38 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 10:00:38.751920 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23ef3db-d017-4966-836d-9243e4fa055e None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:00:38.753261 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-d23ef3db-d017-4966-836d-9243e4fa055e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 10:00:38.789395 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2ef659-3c2e-4318-bb14-0cdeaa07b3d1 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:00:38.794539 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c234009d-bb1f-420d-bf65-9fee640a95c2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8c47ff5d72943f6bab09b5df6198d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc2e3a7a1bcc480891c0b433291c00b1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:00:38.795925 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c234009d-bb1f-420d-bf65-9fee640a95c2 service placement] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:00:38.795925 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c234009d-bb1f-420d-bf65-9fee640a95c2 service placement] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:00:38.795925 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c234009d-bb1f-420d-bf65-9fee640a95c2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:00:38.798439 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-c234009d-bb1f-420d-bf65-9fee640a95c2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 10:00:38.811372 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c234009d-bb1f-420d-bf65-9fee640a95c2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:00:38.814632 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c234009d-bb1f-420d-bf65-9fee640a95c2 service placement] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:00:38.831249 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23ef3db-d017-4966-836d-9243e4fa055e None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:00:38.831464 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1038/2079] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Oct 27 10:00:38 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 10:00:38.831547 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8d44c5-608f-4fe4-a976-4b6748e2dd08 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8e5d5f04c4741bb86ca4a0f667d4ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc2e3a7a1bcc480891c0b433291c00b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:00:38.831547 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8d44c5-608f-4fe4-a976-4b6748e2dd08 service cinder] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:00:38.831547 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8d44c5-608f-4fe4-a976-4b6748e2dd08 service cinder] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:00:38.831547 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8d44c5-608f-4fe4-a976-4b6748e2dd08 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:00:38.841189 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8d44c5-608f-4fe4-a976-4b6748e2dd08 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:00:38.842790 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8d44c5-608f-4fe4-a976-4b6748e2dd08 service cinder] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:00:38.854494 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1042/2080] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Oct 27 10:00:38 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 10:00:40.760717 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d994321d-d3ed-4e45-b3af-436e66b82420 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:00:40.761316 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d994321d-d3ed-4e45-b3af-436e66b82420 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:00:40.761316 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d994321d-d3ed-4e45-b3af-436e66b82420 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:00:40.781886 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-d994321d-d3ed-4e45-b3af-436e66b82420 None None] MFA Rules not processed for user `f0050007e14f4651bf5805d0cb36f58c`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 10:00:40.783316 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-d994321d-d3ed-4e45-b3af-436e66b82420 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 10:00:40.793873 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1039/2081] 10.222.0.65 () {58 vars in 958 bytes} [Thu Oct 27 10:00:40 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 10:00:48.849694 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=55 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:00:50.775569 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:INSERT=1,keystone:SELECT=46 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:00:51.705796 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e89b4d-6e97-4484-8f7e-c4ccfce5d377 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:00:51.706559 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e89b4d-6e97-4484-8f7e-c4ccfce5d377 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:00:51.706559 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e89b4d-6e97-4484-8f7e-c4ccfce5d377 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:00:51.748432 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-22e89b4d-6e97-4484-8f7e-c4ccfce5d377 None None] MFA Rules not processed for user `c18a92a796934277ad64a51ef3f7bb23`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 10:00:51.749869 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-22e89b4d-6e97-4484-8f7e-c4ccfce5d377 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 10:00:51.831303 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1043/2082] 10.222.0.65 () {58 vars in 1009 bytes} [Thu Oct 27 10:00:51 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 10:00:51.982777 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d994321d-d3ed-4e45-b3af-436e66b82420 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:00:51.984201 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-d994321d-d3ed-4e45-b3af-436e66b82420 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 10:00:52.071729 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d994321d-d3ed-4e45-b3af-436e66b82420 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:00:52.078187 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c7da40-e14a-4205-a583-124125f57137 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e32fc35c8b467e9604b325cf1527aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc2e3a7a1bcc480891c0b433291c00b1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:00:52.078853 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c7da40-e14a-4205-a583-124125f57137 service swift] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:00:52.079424 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c7da40-e14a-4205-a583-124125f57137 service swift] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:00:52.079715 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c7da40-e14a-4205-a583-124125f57137 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:00:52.091038 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c7da40-e14a-4205-a583-124125f57137 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:00:52.093035 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c7da40-e14a-4205-a583-124125f57137 service swift] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:00:52.112658 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1040/2083] 10.222.0.65 () {60 vars in 1384 bytes} [Thu Oct 27 10:00:51 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 27 10:01:01.818340 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=32 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:01:02.108380 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=32 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:01:02.942081 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab3fb43-4877-4ab4-b9dd-8f93b8d3433a None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:01:02.942701 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab3fb43-4877-4ab4-b9dd-8f93b8d3433a None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:01:02.942701 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab3fb43-4877-4ab4-b9dd-8f93b8d3433a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:01:02.968525 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-1ab3fb43-4877-4ab4-b9dd-8f93b8d3433a None None] MFA Rules not processed for user `c18a92a796934277ad64a51ef3f7bb23`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 10:01:02.970015 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-1ab3fb43-4877-4ab4-b9dd-8f93b8d3433a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 10:01:02.980504 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1044/2084] 10.222.0.65 () {58 vars in 1009 bytes} [Thu Oct 27 10:01:02 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 10:01:03.001061 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c7da40-e14a-4205-a583-124125f57137 service swift] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:01:03.015058 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c7da40-e14a-4205-a583-124125f57137 service swift] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:01:03.029097 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee9afb4-1dfb-4883-8a11-0717bec3be74 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e32fc35c8b467e9604b325cf1527aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc2e3a7a1bcc480891c0b433291c00b1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:01:03.030080 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee9afb4-1dfb-4883-8a11-0717bec3be74 service swift] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:01:03.030435 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee9afb4-1dfb-4883-8a11-0717bec3be74 service swift] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:01:03.030819 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee9afb4-1dfb-4883-8a11-0717bec3be74 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:01:03.043011 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee9afb4-1dfb-4883-8a11-0717bec3be74 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:01:03.044763 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee9afb4-1dfb-4883-8a11-0717bec3be74 service swift] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:01:03.057164 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1041/2085] 10.222.0.65 () {60 vars in 1384 bytes} [Thu Oct 27 10:01:02 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 27 10:01:04.664980 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe404f0f-f3e7-4161-b5a7-ca44b62d0056 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:01:04.665432 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe404f0f-f3e7-4161-b5a7-ca44b62d0056 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:01:04.665851 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe404f0f-f3e7-4161-b5a7-ca44b62d0056 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:01:04.687025 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-fe404f0f-f3e7-4161-b5a7-ca44b62d0056 None None] MFA Rules not processed for user `c18a92a796934277ad64a51ef3f7bb23`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 10:01:04.688228 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-fe404f0f-f3e7-4161-b5a7-ca44b62d0056 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 10:01:04.695525 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1045/2086] 10.222.0.65 () {58 vars in 967 bytes} [Thu Oct 27 10:01:04 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 10:01:04.711750 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee9afb4-1dfb-4883-8a11-0717bec3be74 service swift] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:01:04.723641 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee9afb4-1dfb-4883-8a11-0717bec3be74 service swift] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:01:04.729130 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c8f9e9-f5fa-4e27-9c3d-4c395637f71d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e32fc35c8b467e9604b325cf1527aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc2e3a7a1bcc480891c0b433291c00b1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:01:04.729757 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c8f9e9-f5fa-4e27-9c3d-4c395637f71d service swift] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:01:04.730039 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c8f9e9-f5fa-4e27-9c3d-4c395637f71d service swift] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:01:04.730313 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c8f9e9-f5fa-4e27-9c3d-4c395637f71d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:01:04.739465 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c8f9e9-f5fa-4e27-9c3d-4c395637f71d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:01:04.741148 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c8f9e9-f5fa-4e27-9c3d-4c395637f71d service swift] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:01:04.749572 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1042/2087] 10.222.0.65 () {60 vars in 1384 bytes} [Thu Oct 27 10:01:04 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 27 10:01:05.574097 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677fe2ea-f1a9-4aed-852a-17e0a799ee66 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:01:05.574389 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677fe2ea-f1a9-4aed-852a-17e0a799ee66 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:01:05.574705 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677fe2ea-f1a9-4aed-852a-17e0a799ee66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:01:05.595528 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-677fe2ea-f1a9-4aed-852a-17e0a799ee66 None None] MFA Rules not processed for user `c18a92a796934277ad64a51ef3f7bb23`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 10:01:05.597284 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-677fe2ea-f1a9-4aed-852a-17e0a799ee66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 10:01:05.604899 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1046/2088] 10.222.0.65 () {58 vars in 1009 bytes} [Thu Oct 27 10:01:05 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 10:01:05.616832 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c8f9e9-f5fa-4e27-9c3d-4c395637f71d service swift] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:01:05.629040 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c8f9e9-f5fa-4e27-9c3d-4c395637f71d service swift] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:01:05.634290 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90937118-1cac-4483-b128-889be7e4c9ec service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e32fc35c8b467e9604b325cf1527aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc2e3a7a1bcc480891c0b433291c00b1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:01:05.634931 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90937118-1cac-4483-b128-889be7e4c9ec service swift] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:01:05.635216 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90937118-1cac-4483-b128-889be7e4c9ec service swift] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:01:05.635494 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90937118-1cac-4483-b128-889be7e4c9ec service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:01:05.645350 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90937118-1cac-4483-b128-889be7e4c9ec service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:01:05.647014 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90937118-1cac-4483-b128-889be7e4c9ec service swift] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:01:05.655443 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1043/2089] 10.222.0.65 () {60 vars in 1384 bytes} [Thu Oct 27 10:01:05 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 27 10:01:06.299907 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa074820-3111-4b8a-b5dd-a6a950ce7bfa None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:01:06.300430 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa074820-3111-4b8a-b5dd-a6a950ce7bfa None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:01:06.301008 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa074820-3111-4b8a-b5dd-a6a950ce7bfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:01:06.324398 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-aa074820-3111-4b8a-b5dd-a6a950ce7bfa None None] MFA Rules not processed for user `c18a92a796934277ad64a51ef3f7bb23`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 10:01:06.325608 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-aa074820-3111-4b8a-b5dd-a6a950ce7bfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 10:01:06.335388 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1047/2090] 10.222.0.65 () {58 vars in 967 bytes} [Thu Oct 27 10:01:06 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 10:01:06.351646 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90937118-1cac-4483-b128-889be7e4c9ec service swift] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:01:06.363434 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90937118-1cac-4483-b128-889be7e4c9ec service swift] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:01:06.368709 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbab3d03-4443-4a8e-8d17-b0bb29708246 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e32fc35c8b467e9604b325cf1527aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc2e3a7a1bcc480891c0b433291c00b1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:01:06.369350 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbab3d03-4443-4a8e-8d17-b0bb29708246 service swift] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:01:06.369637 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbab3d03-4443-4a8e-8d17-b0bb29708246 service swift] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:01:06.369883 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbab3d03-4443-4a8e-8d17-b0bb29708246 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:01:06.378744 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbab3d03-4443-4a8e-8d17-b0bb29708246 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:01:06.380354 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbab3d03-4443-4a8e-8d17-b0bb29708246 service swift] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:01:06.389117 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1044/2091] 10.222.0.65 () {60 vars in 1384 bytes} [Thu Oct 27 10:01:06 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 27 10:01:07.772352 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa074820-3111-4b8a-b5dd-a6a950ce7bfa None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:01:07.776299 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-aa074820-3111-4b8a-b5dd-a6a950ce7bfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 10:01:07.881345 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa074820-3111-4b8a-b5dd-a6a950ce7bfa None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:01:07.887810 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5357ca5f-2950-47be-b438-c76686eb369e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6191cc41efa74f46b49022cf387f7a4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc2e3a7a1bcc480891c0b433291c00b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:01:07.888561 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5357ca5f-2950-47be-b438-c76686eb369e service neutron] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:01:07.888919 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5357ca5f-2950-47be-b438-c76686eb369e service neutron] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:01:07.889314 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5357ca5f-2950-47be-b438-c76686eb369e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:01:07.891502 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-5357ca5f-2950-47be-b438-c76686eb369e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 10:01:07.981016 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5357ca5f-2950-47be-b438-c76686eb369e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:01:07.982708 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5357ca5f-2950-47be-b438-c76686eb369e service neutron] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:01:07.996087 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1048/2092] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Oct 27 10:01:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 10:01:09.343538 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbab3d03-4443-4a8e-8d17-b0bb29708246 service swift] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:01:09.358730 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbab3d03-4443-4a8e-8d17-b0bb29708246 service swift] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:01:09.370016 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134f1f2e-38e7-48fb-91e6-737c41a233f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:01:09.370690 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134f1f2e-38e7-48fb-91e6-737c41a233f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:01:09.371227 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134f1f2e-38e7-48fb-91e6-737c41a233f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:01:09.372209 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134f1f2e-38e7-48fb-91e6-737c41a233f8 admin admin] PATH_INFO: `/v3/users/f0050007e14f4651bf5805d0cb36f58c` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:01:09.373811 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134f1f2e-38e7-48fb-91e6-737c41a233f8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f0050007e14f4651bf5805d0cb36f58c)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:01:09.375897 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134f1f2e-38e7-48fb-91e6-737c41a233f8 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:01:09.561447 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-134f1f2e-38e7-48fb-91e6-737c41a233f8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f0050007e14f4651bf5805d0cb36f58c'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:01:09.563223 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-134f1f2e-38e7-48fb-91e6-737c41a233f8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f0050007e14f4651bf5805d0cb36f58c'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:01:09.581284 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-134f1f2e-38e7-48fb-91e6-737c41a233f8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f0050007e14f4651bf5805d0cb36f58c'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:01:09.582234 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-134f1f2e-38e7-48fb-91e6-737c41a233f8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f0050007e14f4651bf5805d0cb36f58c'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:01:09.601223 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-134f1f2e-38e7-48fb-91e6-737c41a233f8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f0050007e14f4651bf5805d0cb36f58c'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:01:09.691502 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1045/2093] 10.222.0.65 () {58 vars in 1224 bytes} [Thu Oct 27 10:01:09 2022] DELETE /identity/v3/users/f0050007e14f4651bf5805d0cb36f58c => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 10:01:09.696249 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d107cd6a-65e6-469b-b5f1-1d58fc953805 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:01:09.696817 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d107cd6a-65e6-469b-b5f1-1d58fc953805 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:01:09.696817 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d107cd6a-65e6-469b-b5f1-1d58fc953805 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:01:09.718844 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-d107cd6a-65e6-469b-b5f1-1d58fc953805 None None] MFA Rules not processed for user `b5065084bf664b99bdeac46067cb0f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 10:01:09.721048 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-d107cd6a-65e6-469b-b5f1-1d58fc953805 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 10:01:09.803639 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1049/2094] 10.222.0.65 () {58 vars in 958 bytes} [Thu Oct 27 10:01:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 10:01:09.818544 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134f1f2e-38e7-48fb-91e6-737c41a233f8 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:01:09.820031 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-134f1f2e-38e7-48fb-91e6-737c41a233f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 10:01:09.908094 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134f1f2e-38e7-48fb-91e6-737c41a233f8 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:01:09.911771 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5ac57b-2c68-4082-a6a3-c06ab5915ab5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6191cc41efa74f46b49022cf387f7a4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc2e3a7a1bcc480891c0b433291c00b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:01:09.912590 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5ac57b-2c68-4082-a6a3-c06ab5915ab5 service neutron] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:01:09.912875 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5ac57b-2c68-4082-a6a3-c06ab5915ab5 service neutron] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:01:09.913227 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5ac57b-2c68-4082-a6a3-c06ab5915ab5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:01:09.924214 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5ac57b-2c68-4082-a6a3-c06ab5915ab5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:01:09.925805 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5ac57b-2c68-4082-a6a3-c06ab5915ab5 service neutron] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:01:09.936730 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1046/2095] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Oct 27 10:01:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 10:01:10.291956 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d107cd6a-65e6-469b-b5f1-1d58fc953805 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:01:10.294379 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-d107cd6a-65e6-469b-b5f1-1d58fc953805 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 10:01:10.315255 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:01:10.322837 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d107cd6a-65e6-469b-b5f1-1d58fc953805 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:01:10.328905 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882090b9-2da2-4955-8079-7883b32626b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:01:10.329314 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882090b9-2da2-4955-8079-7883b32626b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:01:10.329654 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882090b9-2da2-4955-8079-7883b32626b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:01:10.329873 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882090b9-2da2-4955-8079-7883b32626b4 admin admin] PATH_INFO: `/v3/projects/442ed9074e764712a65404033d739f47` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:01:10.331814 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882090b9-2da2-4955-8079-7883b32626b4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=442ed9074e764712a65404033d739f47)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:01:10.334313 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882090b9-2da2-4955-8079-7883b32626b4 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:01:10.523404 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-882090b9-2da2-4955-8079-7883b32626b4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '442ed9074e764712a65404033d739f47', 'request_id': 'req-882090b9-2da2-4955-8079-7883b32626b4'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:01:10.594476 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-882090b9-2da2-4955-8079-7883b32626b4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '442ed9074e764712a65404033d739f47', 'request_id': 'req-882090b9-2da2-4955-8079-7883b32626b4'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:01:10.603328 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-882090b9-2da2-4955-8079-7883b32626b4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '442ed9074e764712a65404033d739f47', 'request_id': 'req-882090b9-2da2-4955-8079-7883b32626b4'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:01:10.616008 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-882090b9-2da2-4955-8079-7883b32626b4 admin admin] The token cache is being invalidate because project 442ed9074e764712a65404033d739f47 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 10:01:10.616294 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-882090b9-2da2-4955-8079-7883b32626b4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:01:10.617017 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-882090b9-2da2-4955-8079-7883b32626b4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:01:10.618852 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1050/2096] 10.222.0.65 () {58 vars in 1233 bytes} [Thu Oct 27 10:01:10 2022] DELETE /identity/v3/projects/442ed9074e764712a65404033d739f47 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 10:01:10.623460 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00196570-0942-4e23-ba5c-cbb11e6f184f None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:01:10.624004 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00196570-0942-4e23-ba5c-cbb11e6f184f None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:01:10.624004 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00196570-0942-4e23-ba5c-cbb11e6f184f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:01:10.645672 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-00196570-0942-4e23-ba5c-cbb11e6f184f None None] MFA Rules not processed for user `b5065084bf664b99bdeac46067cb0f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 10:01:10.646973 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-00196570-0942-4e23-ba5c-cbb11e6f184f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 10:01:10.665328 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:01:10.789185 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1047/2097] 10.222.0.65 () {58 vars in 958 bytes} [Thu Oct 27 10:01:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 10:01:10.797399 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1beeea57-a6be-4850-9d40-765dfa560efe None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:01:10.798068 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1beeea57-a6be-4850-9d40-765dfa560efe None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:01:10.798068 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1beeea57-a6be-4850-9d40-765dfa560efe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:01:10.823248 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-1beeea57-a6be-4850-9d40-765dfa560efe None None] MFA Rules not processed for user `b5065084bf664b99bdeac46067cb0f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 10:01:10.824783 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-1beeea57-a6be-4850-9d40-765dfa560efe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 10:01:10.840612 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1051/2098] 10.222.0.65 () {58 vars in 958 bytes} [Thu Oct 27 10:01:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 10:01:10.844209 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00196570-0942-4e23-ba5c-cbb11e6f184f None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:01:10.866614 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00196570-0942-4e23-ba5c-cbb11e6f184f None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:01:10.872518 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c397eee-9e65-4fe1-bd1b-119676f46d7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:01:10.873259 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c397eee-9e65-4fe1-bd1b-119676f46d7a admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:01:10.873683 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c397eee-9e65-4fe1-bd1b-119676f46d7a admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:01:10.874058 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c397eee-9e65-4fe1-bd1b-119676f46d7a admin admin] PATH_INFO: `/v3/domains` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:01:10.874879 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c397eee-9e65-4fe1-bd1b-119676f46d7a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 10:01:10.875287 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c397eee-9e65-4fe1-bd1b-119676f46d7a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:01:10.877750 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c397eee-9e65-4fe1-bd1b-119676f46d7a admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:01:10.908987 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1048/2099] 10.222.0.65 () {58 vars in 1153 bytes} [Thu Oct 27 10:01:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 10:01:10.913766 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1beeea57-a6be-4850-9d40-765dfa560efe None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:01:10.923679 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1beeea57-a6be-4850-9d40-765dfa560efe None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:01:10.933275 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9093af3-e4b3-42eb-91d9-3f3018c8c7e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:01:10.933916 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9093af3-e4b3-42eb-91d9-3f3018c8c7e7 admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:01:10.934207 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9093af3-e4b3-42eb-91d9-3f3018c8c7e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:01:10.934486 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9093af3-e4b3-42eb-91d9-3f3018c8c7e7 admin admin] PATH_INFO: `/v3/projects` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:01:10.935190 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9093af3-e4b3-42eb-91d9-3f3018c8c7e7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:01:10.937135 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9093af3-e4b3-42eb-91d9-3f3018c8c7e7 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:01:11.042486 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1052/2100] 10.222.0.65 () {60 vars in 1153 bytes} [Thu Oct 27 10:01:10 2022] POST /identity/v3/projects => generated 373 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 10:01:11.047120 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c397eee-9e65-4fe1-bd1b-119676f46d7a admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:01:11.059369 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c397eee-9e65-4fe1-bd1b-119676f46d7a admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:01:11.124993 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe8a07b-f0d0-421e-919e-f71be0dd77f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:01:11.125536 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe8a07b-f0d0-421e-919e-f71be0dd77f6 admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:01:11.125823 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe8a07b-f0d0-421e-919e-f71be0dd77f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:01:11.126100 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe8a07b-f0d0-421e-919e-f71be0dd77f6 admin admin] PATH_INFO: `/v3/users` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:01:11.126774 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe8a07b-f0d0-421e-919e-f71be0dd77f6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:01:11.129724 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe8a07b-f0d0-421e-919e-f71be0dd77f6 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:01:11.239579 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1049/2101] 10.222.0.65 () {60 vars in 1144 bytes} [Thu Oct 27 10:01:11 2022] POST /identity/v3/users => generated 287 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 10:01:11.243019 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9093af3-e4b3-42eb-91d9-3f3018c8c7e7 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:01:11.256992 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9093af3-e4b3-42eb-91d9-3f3018c8c7e7 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:01:11.262055 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba7a0ba-84d2-4520-a09e-37bc29e4d307 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:01:11.262751 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba7a0ba-84d2-4520-a09e-37bc29e4d307 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:01:11.263236 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba7a0ba-84d2-4520-a09e-37bc29e4d307 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:01:11.263703 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba7a0ba-84d2-4520-a09e-37bc29e4d307 admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:01:11.264357 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba7a0ba-84d2-4520-a09e-37bc29e4d307 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:01:11.266172 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba7a0ba-84d2-4520-a09e-37bc29e4d307 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:01:11.279033 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1053/2102] 10.222.0.65 () {58 vars in 1122 bytes} [Thu Oct 27 10:01:11 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 10:01:11.283688 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe8a07b-f0d0-421e-919e-f71be0dd77f6 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:01:11.294106 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe8a07b-f0d0-421e-919e-f71be0dd77f6 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:01:11.303769 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1baf43-e102-47c0-85a3-752a507efb88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:01:11.304446 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1baf43-e102-47c0-85a3-752a507efb88 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:01:11.304776 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1baf43-e102-47c0-85a3-752a507efb88 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:01:11.305284 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1baf43-e102-47c0-85a3-752a507efb88 admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:01:11.305938 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1baf43-e102-47c0-85a3-752a507efb88 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:01:11.307628 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1baf43-e102-47c0-85a3-752a507efb88 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:01:11.324608 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1050/2103] 10.222.0.65 () {58 vars in 1122 bytes} [Thu Oct 27 10:01:11 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 10:01:11.325789 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba7a0ba-84d2-4520-a09e-37bc29e4d307 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:01:11.346619 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba7a0ba-84d2-4520-a09e-37bc29e4d307 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:01:11.356359 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa571f7-a570-49cc-a854-5b8b5e56b3e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:01:11.357034 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa571f7-a570-49cc-a854-5b8b5e56b3e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:01:11.357327 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa571f7-a570-49cc-a854-5b8b5e56b3e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:01:11.357610 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa571f7-a570-49cc-a854-5b8b5e56b3e0 admin admin] PATH_INFO: `/v3/projects/7e79cf723b5240c9b62896b39fa61ff0/users/121e9c66cd1143ce912d269e484bbd2c/roles/43543ce1450245af9661cb017bac17bd` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:01:11.376239 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa571f7-a570-49cc-a854-5b8b5e56b3e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e79cf723b5240c9b62896b39fa61ff0, user_id=121e9c66cd1143ce912d269e484bbd2c, role_id=43543ce1450245af9661cb017bac17bd)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:01:11.379500 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa571f7-a570-49cc-a854-5b8b5e56b3e0 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:01:11.493113 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1054/2104] 10.222.0.65 () {60 vars in 1483 bytes} [Thu Oct 27 10:01:11 2022] PUT /identity/v3/projects/7e79cf723b5240c9b62896b39fa61ff0/users/121e9c66cd1143ce912d269e484bbd2c/roles/43543ce1450245af9661cb017bac17bd => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 10:01:11.494890 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e519d4d0-d2ce-4db7-8135-8c16f4c50a71 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:01:11.495231 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e519d4d0-d2ce-4db7-8135-8c16f4c50a71 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:01:11.495530 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e519d4d0-d2ce-4db7-8135-8c16f4c50a71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:01:11.515798 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-e519d4d0-d2ce-4db7-8135-8c16f4c50a71 None None] MFA Rules not processed for user `b5065084bf664b99bdeac46067cb0f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 10:01:11.517013 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-e519d4d0-d2ce-4db7-8135-8c16f4c50a71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 10:01:11.578756 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1051/2105] 10.222.0.65 () {58 vars in 958 bytes} [Thu Oct 27 10:01:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 10:01:11.589306 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa571f7-a570-49cc-a854-5b8b5e56b3e0 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:01:11.591086 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-2fa571f7-a570-49cc-a854-5b8b5e56b3e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 10:01:11.667832 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa571f7-a570-49cc-a854-5b8b5e56b3e0 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:01:11.671666 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0c0aed-fa28-43c2-8ed1-64d4a0a44005 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6191cc41efa74f46b49022cf387f7a4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc2e3a7a1bcc480891c0b433291c00b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:01:11.678685 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0c0aed-fa28-43c2-8ed1-64d4a0a44005 service neutron] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:01:11.678685 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0c0aed-fa28-43c2-8ed1-64d4a0a44005 service neutron] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:01:11.678685 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0c0aed-fa28-43c2-8ed1-64d4a0a44005 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:01:11.683966 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0c0aed-fa28-43c2-8ed1-64d4a0a44005 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:01:11.685414 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0c0aed-fa28-43c2-8ed1-64d4a0a44005 service neutron] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:01:11.696167 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1055/2106] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Oct 27 10:01:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 10:01:12.457163 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e519d4d0-d2ce-4db7-8135-8c16f4c50a71 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:01:12.462209 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-e519d4d0-d2ce-4db7-8135-8c16f4c50a71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 10:01:12.496180 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:01:12.534630 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e519d4d0-d2ce-4db7-8135-8c16f4c50a71 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:01:12.540027 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57fab9b-4bcd-4bef-b1d6-bf50763dd6d6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8c47ff5d72943f6bab09b5df6198d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc2e3a7a1bcc480891c0b433291c00b1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:01:12.540640 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57fab9b-4bcd-4bef-b1d6-bf50763dd6d6 service placement] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:01:12.543149 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57fab9b-4bcd-4bef-b1d6-bf50763dd6d6 service placement] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:01:12.543149 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57fab9b-4bcd-4bef-b1d6-bf50763dd6d6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:01:12.543149 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-e57fab9b-4bcd-4bef-b1d6-bf50763dd6d6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 10:01:12.555169 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57fab9b-4bcd-4bef-b1d6-bf50763dd6d6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:01:12.556745 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57fab9b-4bcd-4bef-b1d6-bf50763dd6d6 service placement] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:01:12.567377 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1052/2107] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Oct 27 10:01:12 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 10:01:12.654369 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0c0aed-fa28-43c2-8ed1-64d4a0a44005 service neutron] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:01:12.657014 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-fb0c0aed-fa28-43c2-8ed1-64d4a0a44005 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 10:01:12.684442 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0c0aed-fa28-43c2-8ed1-64d4a0a44005 service neutron] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:01:12.691826 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8eba091-03a9-40ae-a19c-75d63d572edb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:01:12.692706 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8eba091-03a9-40ae-a19c-75d63d572edb admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:01:12.693016 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8eba091-03a9-40ae-a19c-75d63d572edb admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:01:12.693289 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8eba091-03a9-40ae-a19c-75d63d572edb admin admin] PATH_INFO: `/v3/users/15b5a9cc367d490cb4de4b6a2759144a` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:01:12.694425 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8eba091-03a9-40ae-a19c-75d63d572edb admin admin] RBAC: Authorizing `identity:delete_user(user_id=15b5a9cc367d490cb4de4b6a2759144a)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:01:12.696425 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8eba091-03a9-40ae-a19c-75d63d572edb admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:01:12.739662 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=87,keystone:DELETE=10,keystone:INSERT=3 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:01:12.878303 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-e8eba091-03a9-40ae-a19c-75d63d572edb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '15b5a9cc367d490cb4de4b6a2759144a'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:01:12.896064 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-e8eba091-03a9-40ae-a19c-75d63d572edb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '15b5a9cc367d490cb4de4b6a2759144a'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:01:12.897182 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-e8eba091-03a9-40ae-a19c-75d63d572edb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '15b5a9cc367d490cb4de4b6a2759144a'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:01:12.919978 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-e8eba091-03a9-40ae-a19c-75d63d572edb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '15b5a9cc367d490cb4de4b6a2759144a'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:01:13.019406 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-e8eba091-03a9-40ae-a19c-75d63d572edb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '15b5a9cc367d490cb4de4b6a2759144a'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:01:13.025863 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1056/2108] 10.222.0.65 () {58 vars in 1224 bytes} [Thu Oct 27 10:01:12 2022] DELETE /identity/v3/users/15b5a9cc367d490cb4de4b6a2759144a => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 10:01:13.306953 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57fab9b-4bcd-4bef-b1d6-bf50763dd6d6 service placement] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:01:13.319126 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57fab9b-4bcd-4bef-b1d6-bf50763dd6d6 service placement] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:01:13.391028 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea1078b-e32d-4c8f-a2c5-994509e947ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:01:13.391676 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea1078b-e32d-4c8f-a2c5-994509e947ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:01:13.391964 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea1078b-e32d-4c8f-a2c5-994509e947ad admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:01:13.392233 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea1078b-e32d-4c8f-a2c5-994509e947ad admin admin] PATH_INFO: `/v3/projects/262466090af24738b10a5a744ed5055c` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:01:13.394258 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea1078b-e32d-4c8f-a2c5-994509e947ad admin admin] RBAC: Authorizing `identity:delete_project(project_id=262466090af24738b10a5a744ed5055c)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:01:13.396320 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea1078b-e32d-4c8f-a2c5-994509e947ad admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:01:13.594727 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-5ea1078b-e32d-4c8f-a2c5-994509e947ad admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '262466090af24738b10a5a744ed5055c', 'request_id': 'req-5ea1078b-e32d-4c8f-a2c5-994509e947ad'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:01:13.599107 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-5ea1078b-e32d-4c8f-a2c5-994509e947ad admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '262466090af24738b10a5a744ed5055c', 'request_id': 'req-5ea1078b-e32d-4c8f-a2c5-994509e947ad'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:01:13.660422 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-5ea1078b-e32d-4c8f-a2c5-994509e947ad admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '262466090af24738b10a5a744ed5055c', 'request_id': 'req-5ea1078b-e32d-4c8f-a2c5-994509e947ad'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:01:13.673503 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-5ea1078b-e32d-4c8f-a2c5-994509e947ad admin admin] The token cache is being invalidate because project 262466090af24738b10a5a744ed5055c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 10:01:13.674428 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-5ea1078b-e32d-4c8f-a2c5-994509e947ad admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:01:13.675632 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-5ea1078b-e32d-4c8f-a2c5-994509e947ad admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:01:13.677183 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1053/2109] 10.222.0.65 () {58 vars in 1233 bytes} [Thu Oct 27 10:01:13 2022] DELETE /identity/v3/projects/262466090af24738b10a5a744ed5055c => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 10:01:13.683449 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fd5ec0-4af8-4c54-b432-7014236b610b None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:01:13.684050 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fd5ec0-4af8-4c54-b432-7014236b610b None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:01:13.684050 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fd5ec0-4af8-4c54-b432-7014236b610b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:01:13.708086 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-91fd5ec0-4af8-4c54-b432-7014236b610b None None] MFA Rules not processed for user `b5065084bf664b99bdeac46067cb0f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 10:01:13.709922 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-91fd5ec0-4af8-4c54-b432-7014236b610b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 10:01:13.783971 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1057/2110] 10.222.0.65 () {58 vars in 958 bytes} [Thu Oct 27 10:01:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 10:01:13.791827 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2066988-1f04-4699-a37a-5497e7409c7f None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:01:13.792114 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2066988-1f04-4699-a37a-5497e7409c7f None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:01:13.792391 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2066988-1f04-4699-a37a-5497e7409c7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:01:13.831049 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-c2066988-1f04-4699-a37a-5497e7409c7f None None] MFA Rules not processed for user `b5065084bf664b99bdeac46067cb0f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 10:01:13.832516 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-c2066988-1f04-4699-a37a-5497e7409c7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 10:01:13.842190 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1054/2111] 10.222.0.65 () {58 vars in 958 bytes} [Thu Oct 27 10:01:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 10:01:13.847638 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fd5ec0-4af8-4c54-b432-7014236b610b None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:01:13.860839 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fd5ec0-4af8-4c54-b432-7014236b610b None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:01:13.867164 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e297dc-22fd-478a-a132-96bca8a27ab9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:01:13.867799 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e297dc-22fd-478a-a132-96bca8a27ab9 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:01:13.868402 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e297dc-22fd-478a-a132-96bca8a27ab9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:01:13.868694 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e297dc-22fd-478a-a132-96bca8a27ab9 admin admin] PATH_INFO: `/v3/domains` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:01:13.869368 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e297dc-22fd-478a-a132-96bca8a27ab9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 10:01:13.869677 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e297dc-22fd-478a-a132-96bca8a27ab9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:01:13.871471 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e297dc-22fd-478a-a132-96bca8a27ab9 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:01:13.885438 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1058/2112] 10.222.0.65 () {58 vars in 1153 bytes} [Thu Oct 27 10:01:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 10:01:13.889962 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2066988-1f04-4699-a37a-5497e7409c7f None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:01:13.899685 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2066988-1f04-4699-a37a-5497e7409c7f None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:01:13.904725 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d2b1ce-61f5-4900-9707-f20643c0b646 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:01:13.905339 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d2b1ce-61f5-4900-9707-f20643c0b646 admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:01:13.905621 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d2b1ce-61f5-4900-9707-f20643c0b646 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:01:13.905894 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d2b1ce-61f5-4900-9707-f20643c0b646 admin admin] PATH_INFO: `/v3/projects` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:01:13.906682 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d2b1ce-61f5-4900-9707-f20643c0b646 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:01:13.909325 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d2b1ce-61f5-4900-9707-f20643c0b646 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:01:14.010856 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1055/2113] 10.222.0.65 () {60 vars in 1153 bytes} [Thu Oct 27 10:01:13 2022] POST /identity/v3/projects => generated 373 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 10:01:14.012348 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e297dc-22fd-478a-a132-96bca8a27ab9 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:01:14.023549 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e297dc-22fd-478a-a132-96bca8a27ab9 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:01:14.092509 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200f8a22-1594-4ee3-ac77-ef5f10d9db91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:01:14.093429 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200f8a22-1594-4ee3-ac77-ef5f10d9db91 admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:01:14.093429 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200f8a22-1594-4ee3-ac77-ef5f10d9db91 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:01:14.093648 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200f8a22-1594-4ee3-ac77-ef5f10d9db91 admin admin] PATH_INFO: `/v3/users` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:01:14.094335 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200f8a22-1594-4ee3-ac77-ef5f10d9db91 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:01:14.097364 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200f8a22-1594-4ee3-ac77-ef5f10d9db91 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:01:14.192622 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1059/2114] 10.222.0.65 () {60 vars in 1144 bytes} [Thu Oct 27 10:01:14 2022] POST /identity/v3/users => generated 287 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 10:01:14.193932 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d2b1ce-61f5-4900-9707-f20643c0b646 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:01:14.207937 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d2b1ce-61f5-4900-9707-f20643c0b646 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:01:14.214631 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb888be2-e327-4c22-a0b6-ef85fcfdcfb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:01:14.215452 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb888be2-e327-4c22-a0b6-ef85fcfdcfb3 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:01:14.215934 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb888be2-e327-4c22-a0b6-ef85fcfdcfb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:01:14.216343 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb888be2-e327-4c22-a0b6-ef85fcfdcfb3 admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:01:14.217083 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb888be2-e327-4c22-a0b6-ef85fcfdcfb3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:01:14.219121 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb888be2-e327-4c22-a0b6-ef85fcfdcfb3 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:01:14.236157 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1056/2115] 10.222.0.65 () {58 vars in 1122 bytes} [Thu Oct 27 10:01:14 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 10:01:14.237609 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200f8a22-1594-4ee3-ac77-ef5f10d9db91 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:01:14.247957 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200f8a22-1594-4ee3-ac77-ef5f10d9db91 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:01:14.253085 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a537b1-275e-479d-93da-245151d16c9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:01:14.253686 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a537b1-275e-479d-93da-245151d16c9b admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:01:14.253979 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a537b1-275e-479d-93da-245151d16c9b admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:01:14.254260 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a537b1-275e-479d-93da-245151d16c9b admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:01:14.254977 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a537b1-275e-479d-93da-245151d16c9b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:01:14.256795 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a537b1-275e-479d-93da-245151d16c9b admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:01:14.269027 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1060/2116] 10.222.0.65 () {58 vars in 1122 bytes} [Thu Oct 27 10:01:14 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 10:01:14.273264 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb888be2-e327-4c22-a0b6-ef85fcfdcfb3 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:01:14.284118 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb888be2-e327-4c22-a0b6-ef85fcfdcfb3 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:01:14.288908 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89bc916-c21c-49ce-94e7-4520bdd22d5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:01:14.289558 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89bc916-c21c-49ce-94e7-4520bdd22d5f admin admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:01:14.289871 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89bc916-c21c-49ce-94e7-4520bdd22d5f admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:01:14.290151 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89bc916-c21c-49ce-94e7-4520bdd22d5f admin admin] PATH_INFO: `/v3/projects/de8eb0fce1f84df9a45645a42a3b13fb/users/c4ba75f25bfa4bf69869d3c86be97ab6/roles/43543ce1450245af9661cb017bac17bd` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:01:14.294105 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:01:14.313372 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89bc916-c21c-49ce-94e7-4520bdd22d5f admin admin] RBAC: Authorizing `identity:create_grant(project_id=de8eb0fce1f84df9a45645a42a3b13fb, user_id=c4ba75f25bfa4bf69869d3c86be97ab6, role_id=43543ce1450245af9661cb017bac17bd)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:01:14.327959 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89bc916-c21c-49ce-94e7-4520bdd22d5f admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:01:14.471702 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1057/2117] 10.222.0.65 () {60 vars in 1483 bytes} [Thu Oct 27 10:01:14 2022] PUT /identity/v3/projects/de8eb0fce1f84df9a45645a42a3b13fb/users/c4ba75f25bfa4bf69869d3c86be97ab6/roles/43543ce1450245af9661cb017bac17bd => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 10:01:14.472715 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13daf16-ba28-4c01-903f-339142a5af49 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:01:14.473058 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13daf16-ba28-4c01-903f-339142a5af49 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:01:14.473363 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13daf16-ba28-4c01-903f-339142a5af49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:01:14.483152 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:01:14.544378 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-b13daf16-ba28-4c01-903f-339142a5af49 None None] MFA Rules not processed for user `c4ba75f25bfa4bf69869d3c86be97ab6`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 10:01:14.545636 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-b13daf16-ba28-4c01-903f-339142a5af49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 10:01:14.668655 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1061/2118] 10.222.0.65 () {58 vars in 958 bytes} [Thu Oct 27 10:01:14 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 10:01:14.673567 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89bc916-c21c-49ce-94e7-4520bdd22d5f admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:01:14.786555 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89bc916-c21c-49ce-94e7-4520bdd22d5f admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:01:14.793973 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88404d8-247b-4e57-85a9-4ef7ba2e32af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:01:14.794871 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88404d8-247b-4e57-85a9-4ef7ba2e32af admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:01:14.795342 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88404d8-247b-4e57-85a9-4ef7ba2e32af admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:01:14.795819 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88404d8-247b-4e57-85a9-4ef7ba2e32af admin admin] PATH_INFO: `/v3/projects` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:01:14.796697 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88404d8-247b-4e57-85a9-4ef7ba2e32af admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:01:14.799785 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88404d8-247b-4e57-85a9-4ef7ba2e32af admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:01:14.935283 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1058/2119] 10.222.0.65 () {60 vars in 1153 bytes} [Thu Oct 27 10:01:14 2022] POST /identity/v3/projects => generated 373 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 10:01:14.939185 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13daf16-ba28-4c01-903f-339142a5af49 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:01:14.960516 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13daf16-ba28-4c01-903f-339142a5af49 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:01:15.032654 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06af6b3-d028-40ec-8c3a-8d112c2b4f42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:01:15.034814 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06af6b3-d028-40ec-8c3a-8d112c2b4f42 admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:01:15.035172 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06af6b3-d028-40ec-8c3a-8d112c2b4f42 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:01:15.035515 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06af6b3-d028-40ec-8c3a-8d112c2b4f42 admin admin] PATH_INFO: `/v3/users` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:01:15.036266 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06af6b3-d028-40ec-8c3a-8d112c2b4f42 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:01:15.038754 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06af6b3-d028-40ec-8c3a-8d112c2b4f42 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:01:15.140008 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1062/2120] 10.222.0.65 () {60 vars in 1144 bytes} [Thu Oct 27 10:01:14 2022] POST /identity/v3/users => generated 293 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 10:01:15.143618 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88404d8-247b-4e57-85a9-4ef7ba2e32af admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:01:15.157361 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88404d8-247b-4e57-85a9-4ef7ba2e32af admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:01:15.163854 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bd9445-702e-41cc-98a3-1395425878d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:01:15.164519 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bd9445-702e-41cc-98a3-1395425878d4 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:01:15.167838 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bd9445-702e-41cc-98a3-1395425878d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:01:15.167838 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bd9445-702e-41cc-98a3-1395425878d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:01:15.167838 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6bd9445-702e-41cc-98a3-1395425878d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:01:15.167838 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6bd9445-702e-41cc-98a3-1395425878d4 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:01:15.186323 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1059/2121] 10.222.0.65 () {58 vars in 1122 bytes} [Thu Oct 27 10:01:15 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 10:01:15.187077 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06af6b3-d028-40ec-8c3a-8d112c2b4f42 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:01:15.200017 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06af6b3-d028-40ec-8c3a-8d112c2b4f42 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:01:15.206644 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30029b8f-1570-4ec1-a830-675f25c84b70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:01:15.207411 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30029b8f-1570-4ec1-a830-675f25c84b70 admin admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:01:15.207763 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30029b8f-1570-4ec1-a830-675f25c84b70 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:01:15.208107 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30029b8f-1570-4ec1-a830-675f25c84b70 admin admin] PATH_INFO: `/v3/projects/9b505b06aaa34689afe645095f8bdd2c/users/fb078c5214744791b9da53382c207278/roles/6ad17b9f9dea4b66ab2da3677d7e715d` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:01:15.226339 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30029b8f-1570-4ec1-a830-675f25c84b70 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9b505b06aaa34689afe645095f8bdd2c, user_id=fb078c5214744791b9da53382c207278, role_id=6ad17b9f9dea4b66ab2da3677d7e715d)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:01:15.229441 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30029b8f-1570-4ec1-a830-675f25c84b70 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:01:15.294856 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1063/2122] 10.222.0.65 () {60 vars in 1483 bytes} [Thu Oct 27 10:01:15 2022] PUT /identity/v3/projects/9b505b06aaa34689afe645095f8bdd2c/users/fb078c5214744791b9da53382c207278/roles/6ad17b9f9dea4b66ab2da3677d7e715d => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 10:01:15.298682 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bd9445-702e-41cc-98a3-1395425878d4 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:01:15.315535 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bd9445-702e-41cc-98a3-1395425878d4 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:01:15.389370 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3775307c-0473-4e35-8fde-8d1056383f69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:01:15.390507 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3775307c-0473-4e35-8fde-8d1056383f69 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:01:15.390986 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3775307c-0473-4e35-8fde-8d1056383f69 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:01:15.391419 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3775307c-0473-4e35-8fde-8d1056383f69 admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:01:15.392230 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3775307c-0473-4e35-8fde-8d1056383f69 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:01:15.396093 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3775307c-0473-4e35-8fde-8d1056383f69 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:01:15.412345 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1060/2123] 10.222.0.65 () {58 vars in 1122 bytes} [Thu Oct 27 10:01:15 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 10:01:15.416411 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30029b8f-1570-4ec1-a830-675f25c84b70 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:01:15.428054 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30029b8f-1570-4ec1-a830-675f25c84b70 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:01:15.437100 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964a6900-2215-4899-bc06-9a94e9aba9f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:01:15.437100 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964a6900-2215-4899-bc06-9a94e9aba9f3 admin admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:01:15.437100 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964a6900-2215-4899-bc06-9a94e9aba9f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:01:15.437100 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964a6900-2215-4899-bc06-9a94e9aba9f3 admin admin] PATH_INFO: `/v3/projects/9b505b06aaa34689afe645095f8bdd2c/users/fb078c5214744791b9da53382c207278/roles/6ad17b9f9dea4b66ab2da3677d7e715d` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:01:15.437643 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964a6900-2215-4899-bc06-9a94e9aba9f3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9b505b06aaa34689afe645095f8bdd2c, user_id=fb078c5214744791b9da53382c207278, role_id=6ad17b9f9dea4b66ab2da3677d7e715d)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:01:15.439435 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964a6900-2215-4899-bc06-9a94e9aba9f3 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:01:15.444098 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0664ad3-8f08-42bb-8552-2ed874a46ada None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:01:15.444098 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0664ad3-8f08-42bb-8552-2ed874a46ada None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:01:15.444683 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0664ad3-8f08-42bb-8552-2ed874a46ada None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:01:15.462803 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1064/2124] 10.222.0.65 () {60 vars in 1483 bytes} [Thu Oct 27 10:01:15 2022] PUT /identity/v3/projects/9b505b06aaa34689afe645095f8bdd2c/users/fb078c5214744791b9da53382c207278/roles/6ad17b9f9dea4b66ab2da3677d7e715d => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 10:01:15.464606 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562659d3-a407-45df-855c-d36d12343fad None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:01:15.464892 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562659d3-a407-45df-855c-d36d12343fad None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:01:15.465205 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562659d3-a407-45df-855c-d36d12343fad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:01:15.479826 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-d0664ad3-8f08-42bb-8552-2ed874a46ada None None] MFA Rules not processed for user `c18a92a796934277ad64a51ef3f7bb23`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 10:01:15.481130 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-d0664ad3-8f08-42bb-8552-2ed874a46ada None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 10:01:15.508286 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-562659d3-a407-45df-855c-d36d12343fad None None] MFA Rules not processed for user `fb078c5214744791b9da53382c207278`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 10:01:15.516334 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-562659d3-a407-45df-855c-d36d12343fad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 10:01:15.548355 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:01:15.555690 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1061/2125] 10.222.0.65 () {58 vars in 1009 bytes} [Thu Oct 27 10:01:15 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 10:01:15.561926 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:01:15.570432 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0664ad3-8f08-42bb-8552-2ed874a46ada None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:01:15.571998 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-d0664ad3-8f08-42bb-8552-2ed874a46ada None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 10:01:15.610160 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1065/2126] 10.222.0.65 () {58 vars in 958 bytes} [Thu Oct 27 10:01:15 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 10:01:15.625385 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562659d3-a407-45df-855c-d36d12343fad None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:01:15.626495 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-562659d3-a407-45df-855c-d36d12343fad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 10:01:15.670615 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0664ad3-8f08-42bb-8552-2ed874a46ada None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:01:15.682484 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7fc81e-a903-494e-8eb3-c99b2352c387 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e32fc35c8b467e9604b325cf1527aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc2e3a7a1bcc480891c0b433291c00b1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:01:15.684534 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7fc81e-a903-494e-8eb3-c99b2352c387 service swift] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:01:15.685536 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7fc81e-a903-494e-8eb3-c99b2352c387 service swift] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:01:15.685536 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7fc81e-a903-494e-8eb3-c99b2352c387 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:01:15.701664 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7fc81e-a903-494e-8eb3-c99b2352c387 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:01:15.703707 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7fc81e-a903-494e-8eb3-c99b2352c387 service swift] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:01:15.716782 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1062/2127] 10.222.0.65 () {60 vars in 1384 bytes} [Thu Oct 27 10:01:15 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 27 10:01:15.745713 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562659d3-a407-45df-855c-d36d12343fad None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:01:15.750009 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841fee3e-9830-48e8-91a0-6da27f25726d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8e5d5f04c4741bb86ca4a0f667d4ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc2e3a7a1bcc480891c0b433291c00b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:01:15.750666 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841fee3e-9830-48e8-91a0-6da27f25726d service cinder] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:01:15.751054 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841fee3e-9830-48e8-91a0-6da27f25726d service cinder] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:01:15.751296 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841fee3e-9830-48e8-91a0-6da27f25726d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:01:15.767413 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841fee3e-9830-48e8-91a0-6da27f25726d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:01:15.769065 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841fee3e-9830-48e8-91a0-6da27f25726d service cinder] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:01:15.780255 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1066/2128] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Oct 27 10:01:15 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 10:01:16.067670 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7fc81e-a903-494e-8eb3-c99b2352c387 service swift] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:01:16.082179 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7fc81e-a903-494e-8eb3-c99b2352c387 service swift] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:01:16.093143 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4da4fe-1fbb-4176-9d31-515f6347d48d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8e5d5f04c4741bb86ca4a0f667d4ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc2e3a7a1bcc480891c0b433291c00b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:01:16.093949 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4da4fe-1fbb-4176-9d31-515f6347d48d service cinder] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:01:16.094298 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4da4fe-1fbb-4176-9d31-515f6347d48d service cinder] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:01:16.094662 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4da4fe-1fbb-4176-9d31-515f6347d48d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:01:16.255914 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4da4fe-1fbb-4176-9d31-515f6347d48d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:01:16.261264 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4da4fe-1fbb-4176-9d31-515f6347d48d service cinder] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:01:16.286344 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1063/2129] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Oct 27 10:01:16 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 10:01:19.334359 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8456e3-050c-4c09-afc4-4f6cae4144ed None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:01:19.335072 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8456e3-050c-4c09-afc4-4f6cae4144ed None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:01:19.335379 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8456e3-050c-4c09-afc4-4f6cae4144ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:01:19.398133 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-cf8456e3-050c-4c09-afc4-4f6cae4144ed None None] MFA Rules not processed for user `121e9c66cd1143ce912d269e484bbd2c`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 10:01:19.399650 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-cf8456e3-050c-4c09-afc4-4f6cae4144ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 10:01:19.508720 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1067/2130] 10.222.0.65 () {58 vars in 958 bytes} [Thu Oct 27 10:01:19 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 10:01:19.513478 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4da4fe-1fbb-4176-9d31-515f6347d48d service cinder] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:01:19.516708 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-5b4da4fe-1fbb-4176-9d31-515f6347d48d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 10:01:19.677752 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4da4fe-1fbb-4176-9d31-515f6347d48d service cinder] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:01:19.685978 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39df1bc-aac7-4a56-95be-693b6228d1c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:01:19.687433 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39df1bc-aac7-4a56-95be-693b6228d1c4 admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:01:19.687433 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39df1bc-aac7-4a56-95be-693b6228d1c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:01:19.687433 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39df1bc-aac7-4a56-95be-693b6228d1c4 admin admin] PATH_INFO: `/v3/projects` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:01:19.691446 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39df1bc-aac7-4a56-95be-693b6228d1c4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:01:19.695496 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39df1bc-aac7-4a56-95be-693b6228d1c4 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:01:19.862734 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1064/2131] 10.222.0.65 () {60 vars in 1153 bytes} [Thu Oct 27 10:01:19 2022] POST /identity/v3/projects => generated 371 bytes in 350 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 10:01:19.866721 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8456e3-050c-4c09-afc4-4f6cae4144ed None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:01:19.888832 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8456e3-050c-4c09-afc4-4f6cae4144ed None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:01:19.979746 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:01:20.011160 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7631288-c06a-4bf4-a076-a36d8da46617 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:01:20.012361 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7631288-c06a-4bf4-a076-a36d8da46617 admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:01:20.012846 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7631288-c06a-4bf4-a076-a36d8da46617 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:01:20.013349 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7631288-c06a-4bf4-a076-a36d8da46617 admin admin] PATH_INFO: `/v3/users` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:01:20.014604 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7631288-c06a-4bf4-a076-a36d8da46617 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:01:20.017875 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7631288-c06a-4bf4-a076-a36d8da46617 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:01:20.145819 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1068/2132] 10.222.0.65 () {60 vars in 1144 bytes} [Thu Oct 27 10:01:19 2022] POST /identity/v3/users => generated 292 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 10:01:20.147343 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39df1bc-aac7-4a56-95be-693b6228d1c4 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:01:20.163055 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39df1bc-aac7-4a56-95be-693b6228d1c4 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:01:20.169045 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e264145a-9de7-4e38-aa1b-c818cdc1b445 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:01:20.169774 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e264145a-9de7-4e38-aa1b-c818cdc1b445 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:01:20.170127 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e264145a-9de7-4e38-aa1b-c818cdc1b445 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:01:20.170469 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e264145a-9de7-4e38-aa1b-c818cdc1b445 admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:01:20.171346 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e264145a-9de7-4e38-aa1b-c818cdc1b445 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:01:20.174734 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e264145a-9de7-4e38-aa1b-c818cdc1b445 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:01:20.195109 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7631288-c06a-4bf4-a076-a36d8da46617 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:01:20.196290 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1065/2133] 10.222.0.65 () {58 vars in 1122 bytes} [Thu Oct 27 10:01:20 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 10:01:20.208843 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7631288-c06a-4bf4-a076-a36d8da46617 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:01:20.213849 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd037404-0c1a-4ee1-b15c-4daaa5a40fa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:01:20.214558 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd037404-0c1a-4ee1-b15c-4daaa5a40fa2 admin admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:01:20.214837 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd037404-0c1a-4ee1-b15c-4daaa5a40fa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:01:20.215112 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd037404-0c1a-4ee1-b15c-4daaa5a40fa2 admin admin] PATH_INFO: `/v3/projects/60470932eb7543248d8312da94173cfb/users/9fb07b69706048a19b92998e95dad2f1/roles/6ad17b9f9dea4b66ab2da3677d7e715d` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:01:20.243901 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd037404-0c1a-4ee1-b15c-4daaa5a40fa2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=60470932eb7543248d8312da94173cfb, user_id=9fb07b69706048a19b92998e95dad2f1, role_id=6ad17b9f9dea4b66ab2da3677d7e715d)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:01:20.246817 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd037404-0c1a-4ee1-b15c-4daaa5a40fa2 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:01:20.376858 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1069/2134] 10.222.0.65 () {60 vars in 1483 bytes} [Thu Oct 27 10:01:20 2022] PUT /identity/v3/projects/60470932eb7543248d8312da94173cfb/users/9fb07b69706048a19b92998e95dad2f1/roles/6ad17b9f9dea4b66ab2da3677d7e715d => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 10:01:20.382152 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e264145a-9de7-4e38-aa1b-c818cdc1b445 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:01:20.388596 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:01:20.396857 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e264145a-9de7-4e38-aa1b-c818cdc1b445 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:01:20.502907 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043fb6bb-2e0a-4d6d-9c01-4a624d13263d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:01:20.503533 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043fb6bb-2e0a-4d6d-9c01-4a624d13263d admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:01:20.503810 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043fb6bb-2e0a-4d6d-9c01-4a624d13263d admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:01:20.504077 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043fb6bb-2e0a-4d6d-9c01-4a624d13263d admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:01:20.515290 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043fb6bb-2e0a-4d6d-9c01-4a624d13263d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:01:20.517028 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043fb6bb-2e0a-4d6d-9c01-4a624d13263d admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:01:20.540739 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1066/2135] 10.222.0.65 () {58 vars in 1122 bytes} [Thu Oct 27 10:01:20 2022] GET /identity/v3/roles => generated 1420 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 10:01:20.542204 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd037404-0c1a-4ee1-b15c-4daaa5a40fa2 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:01:20.561819 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd037404-0c1a-4ee1-b15c-4daaa5a40fa2 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:01:20.568807 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e353ec2f-bc74-455e-a72f-f03c4ab93ef9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:01:20.572512 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e353ec2f-bc74-455e-a72f-f03c4ab93ef9 admin admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:01:20.573204 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e353ec2f-bc74-455e-a72f-f03c4ab93ef9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:01:20.573801 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e353ec2f-bc74-455e-a72f-f03c4ab93ef9 admin admin] PATH_INFO: `/v3/projects/60470932eb7543248d8312da94173cfb/users/9fb07b69706048a19b92998e95dad2f1/roles/6ad17b9f9dea4b66ab2da3677d7e715d` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:01:20.577449 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e353ec2f-bc74-455e-a72f-f03c4ab93ef9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=60470932eb7543248d8312da94173cfb, user_id=9fb07b69706048a19b92998e95dad2f1, role_id=6ad17b9f9dea4b66ab2da3677d7e715d)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:01:20.580583 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e353ec2f-bc74-455e-a72f-f03c4ab93ef9 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:01:20.601176 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1070/2136] 10.222.0.65 () {60 vars in 1483 bytes} [Thu Oct 27 10:01:20 2022] PUT /identity/v3/projects/60470932eb7543248d8312da94173cfb/users/9fb07b69706048a19b92998e95dad2f1/roles/6ad17b9f9dea4b66ab2da3677d7e715d => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 10:01:28.552020 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2f43ee-adce-4d36-8dca-0bb2325f0bb4 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:01:28.552615 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2f43ee-adce-4d36-8dca-0bb2325f0bb4 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:01:28.552615 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2f43ee-adce-4d36-8dca-0bb2325f0bb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:01:28.584185 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-4a2f43ee-adce-4d36-8dca-0bb2325f0bb4 None None] MFA Rules not processed for user `9fb07b69706048a19b92998e95dad2f1`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 10:01:28.585415 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-4a2f43ee-adce-4d36-8dca-0bb2325f0bb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 10:01:28.678438 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1067/2137] 10.222.0.65 () {58 vars in 958 bytes} [Thu Oct 27 10:01:28 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 10:01:28.695255 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e353ec2f-bc74-455e-a72f-f03c4ab93ef9 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:01:28.697018 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-e353ec2f-bc74-455e-a72f-f03c4ab93ef9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 10:01:28.823574 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e353ec2f-bc74-455e-a72f-f03c4ab93ef9 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:01:28.830893 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f981d78-944c-4311-8ad2-e339e9c8e74e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd0d23ef039d4f1591a589d302ef165f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc2e3a7a1bcc480891c0b433291c00b1', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:01:28.832350 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f981d78-944c-4311-8ad2-e339e9c8e74e service nova] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:01:28.833069 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f981d78-944c-4311-8ad2-e339e9c8e74e service nova] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:01:28.833282 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f981d78-944c-4311-8ad2-e339e9c8e74e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:01:28.909915 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f981d78-944c-4311-8ad2-e339e9c8e74e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:01:28.911554 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f981d78-944c-4311-8ad2-e339e9c8e74e service nova] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:01:28.925664 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1071/2138] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Oct 27 10:01:28 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 10:01:32.998217 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ceb6785-390e-4c22-9eef-118a91c3333a None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:01:32.998774 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ceb6785-390e-4c22-9eef-118a91c3333a None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:01:33.001721 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ceb6785-390e-4c22-9eef-118a91c3333a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:01:33.020130 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-3ceb6785-390e-4c22-9eef-118a91c3333a None None] MFA Rules not processed for user `121e9c66cd1143ce912d269e484bbd2c`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 10:01:33.021504 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-3ceb6785-390e-4c22-9eef-118a91c3333a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 10:01:33.029411 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1068/2139] 10.222.0.65 () {58 vars in 958 bytes} [Thu Oct 27 10:01:32 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 10:01:36.172216 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77ad3b1-2151-468a-9231-9e5191bd4bc3 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:01:36.172731 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77ad3b1-2151-468a-9231-9e5191bd4bc3 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:01:36.172832 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77ad3b1-2151-468a-9231-9e5191bd4bc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:01:36.195536 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-f77ad3b1-2151-468a-9231-9e5191bd4bc3 None None] MFA Rules not processed for user `c18a92a796934277ad64a51ef3f7bb23`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 10:01:36.196782 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-f77ad3b1-2151-468a-9231-9e5191bd4bc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 10:01:36.206379 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:01:36.267549 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1072/2140] 10.222.0.65 () {58 vars in 967 bytes} [Thu Oct 27 10:01:36 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 10:01:36.281919 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ceb6785-390e-4c22-9eef-118a91c3333a None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:01:36.367384 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ceb6785-390e-4c22-9eef-118a91c3333a None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:01:36.372918 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b21889-7c4b-48e5-9501-094077ec08ad service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01e32fc35c8b467e9604b325cf1527aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc2e3a7a1bcc480891c0b433291c00b1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:01:36.373494 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b21889-7c4b-48e5-9501-094077ec08ad service swift] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:01:36.373772 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b21889-7c4b-48e5-9501-094077ec08ad service swift] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:01:36.374046 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b21889-7c4b-48e5-9501-094077ec08ad service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:01:36.382651 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b21889-7c4b-48e5-9501-094077ec08ad service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:01:36.384345 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b21889-7c4b-48e5-9501-094077ec08ad service swift] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:01:36.394701 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1069/2141] 10.222.0.65 () {60 vars in 1384 bytes} [Thu Oct 27 10:01:36 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 27 10:01:46.349906 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=19 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:01:46.390104 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=97 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:01:46.729326 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77ad3b1-2151-468a-9231-9e5191bd4bc3 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:01:46.730972 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-f77ad3b1-2151-468a-9231-9e5191bd4bc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 10:01:46.790102 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77ad3b1-2151-468a-9231-9e5191bd4bc3 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:01:46.793680 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e81d55-fb1b-47f9-81ad-3c801613acb9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6191cc41efa74f46b49022cf387f7a4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc2e3a7a1bcc480891c0b433291c00b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:01:46.794281 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e81d55-fb1b-47f9-81ad-3c801613acb9 service neutron] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:01:46.794589 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e81d55-fb1b-47f9-81ad-3c801613acb9 service neutron] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:01:46.794865 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e81d55-fb1b-47f9-81ad-3c801613acb9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:01:46.796587 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-66e81d55-fb1b-47f9-81ad-3c801613acb9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 10:01:46.866134 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e81d55-fb1b-47f9-81ad-3c801613acb9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:01:46.867870 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e81d55-fb1b-47f9-81ad-3c801613acb9 service neutron] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:01:46.878437 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1073/2142] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Oct 27 10:01:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 10:01:50.471979 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b21889-7c4b-48e5-9501-094077ec08ad service swift] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:01:50.474177 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-35b21889-7c4b-48e5-9501-094077ec08ad service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 10:01:50.490279 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b21889-7c4b-48e5-9501-094077ec08ad service swift] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:01:50.495004 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bec715-bfd9-4736-abf9-81e9f73f5aa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:01:50.495626 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bec715-bfd9-4736-abf9-81e9f73f5aa3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:01:50.495905 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bec715-bfd9-4736-abf9-81e9f73f5aa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:01:50.496209 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bec715-bfd9-4736-abf9-81e9f73f5aa3 admin admin] PATH_INFO: `/v3/users/2acf9b6c3a394be389cd17d7fade3cf4` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:01:50.497371 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99bec715-bfd9-4736-abf9-81e9f73f5aa3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2acf9b6c3a394be389cd17d7fade3cf4)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:01:50.499328 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99bec715-bfd9-4736-abf9-81e9f73f5aa3 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:01:50.710992 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-99bec715-bfd9-4736-abf9-81e9f73f5aa3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2acf9b6c3a394be389cd17d7fade3cf4'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:01:50.711722 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-99bec715-bfd9-4736-abf9-81e9f73f5aa3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2acf9b6c3a394be389cd17d7fade3cf4'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:01:50.719840 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-99bec715-bfd9-4736-abf9-81e9f73f5aa3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2acf9b6c3a394be389cd17d7fade3cf4'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:01:50.720718 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-99bec715-bfd9-4736-abf9-81e9f73f5aa3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2acf9b6c3a394be389cd17d7fade3cf4'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:01:50.735761 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-99bec715-bfd9-4736-abf9-81e9f73f5aa3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2acf9b6c3a394be389cd17d7fade3cf4'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:01:50.803628 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1070/2143] 10.222.0.65 () {58 vars in 1224 bytes} [Thu Oct 27 10:01:50 2022] DELETE /identity/v3/users/2acf9b6c3a394be389cd17d7fade3cf4 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 10:01:51.095686 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e81d55-fb1b-47f9-81ad-3c801613acb9 service neutron] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:01:51.109355 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e81d55-fb1b-47f9-81ad-3c801613acb9 service neutron] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:01:51.173541 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa9df2d-1ed4-48ee-b2e4-9f76a01c1a01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:01:51.174194 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa9df2d-1ed4-48ee-b2e4-9f76a01c1a01 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:01:51.174482 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa9df2d-1ed4-48ee-b2e4-9f76a01c1a01 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:01:51.174807 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa9df2d-1ed4-48ee-b2e4-9f76a01c1a01 admin admin] PATH_INFO: `/v3/projects/65915f6e7295487b80da1fa669235c3d` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:01:51.175985 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa9df2d-1ed4-48ee-b2e4-9f76a01c1a01 admin admin] RBAC: Authorizing `identity:delete_project(project_id=65915f6e7295487b80da1fa669235c3d)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:01:51.178439 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa9df2d-1ed4-48ee-b2e4-9f76a01c1a01 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:01:51.292496 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-2fa9df2d-1ed4-48ee-b2e4-9f76a01c1a01 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '65915f6e7295487b80da1fa669235c3d', 'request_id': 'req-2fa9df2d-1ed4-48ee-b2e4-9f76a01c1a01'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:01:51.295642 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:01:51.356639 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-2fa9df2d-1ed4-48ee-b2e4-9f76a01c1a01 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '65915f6e7295487b80da1fa669235c3d', 'request_id': 'req-2fa9df2d-1ed4-48ee-b2e4-9f76a01c1a01'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:01:51.362937 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-2fa9df2d-1ed4-48ee-b2e4-9f76a01c1a01 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '65915f6e7295487b80da1fa669235c3d', 'request_id': 'req-2fa9df2d-1ed4-48ee-b2e4-9f76a01c1a01'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:01:51.375698 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-2fa9df2d-1ed4-48ee-b2e4-9f76a01c1a01 admin admin] The token cache is being invalidate because project 65915f6e7295487b80da1fa669235c3d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 10:01:51.375995 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-2fa9df2d-1ed4-48ee-b2e4-9f76a01c1a01 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:01:51.376651 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-2fa9df2d-1ed4-48ee-b2e4-9f76a01c1a01 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:01:51.378358 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1074/2144] 10.222.0.65 () {58 vars in 1233 bytes} [Thu Oct 27 10:01:51 2022] DELETE /identity/v3/projects/65915f6e7295487b80da1fa669235c3d => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 10:01:51.383843 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cd3759-561d-43b3-bd54-aaa55dbd7855 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:01:51.384136 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cd3759-561d-43b3-bd54-aaa55dbd7855 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:01:51.384414 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cd3759-561d-43b3-bd54-aaa55dbd7855 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:01:51.409173 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-45cd3759-561d-43b3-bd54-aaa55dbd7855 None None] MFA Rules not processed for user `b5065084bf664b99bdeac46067cb0f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 10:01:51.410411 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-45cd3759-561d-43b3-bd54-aaa55dbd7855 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 10:01:51.477886 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1071/2145] 10.222.0.65 () {58 vars in 958 bytes} [Thu Oct 27 10:01:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 10:01:51.485703 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429def57-afd3-4960-98de-a97b171f5f98 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:01:51.485987 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429def57-afd3-4960-98de-a97b171f5f98 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:01:51.486255 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429def57-afd3-4960-98de-a97b171f5f98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:01:51.509908 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-429def57-afd3-4960-98de-a97b171f5f98 None None] MFA Rules not processed for user `b5065084bf664b99bdeac46067cb0f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 10:01:51.511246 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-429def57-afd3-4960-98de-a97b171f5f98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 10:01:51.519788 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1075/2146] 10.222.0.65 () {58 vars in 958 bytes} [Thu Oct 27 10:01:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 10:01:51.524816 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cd3759-561d-43b3-bd54-aaa55dbd7855 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:01:51.534978 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cd3759-561d-43b3-bd54-aaa55dbd7855 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:01:51.543445 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3c9854-1a39-40fe-8925-95b64f9869be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:01:51.544424 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3c9854-1a39-40fe-8925-95b64f9869be admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:01:51.544872 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3c9854-1a39-40fe-8925-95b64f9869be admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:01:51.545311 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3c9854-1a39-40fe-8925-95b64f9869be admin admin] PATH_INFO: `/v3/domains` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:01:51.546148 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3c9854-1a39-40fe-8925-95b64f9869be admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 10:01:51.546665 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3c9854-1a39-40fe-8925-95b64f9869be admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:01:51.549065 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3c9854-1a39-40fe-8925-95b64f9869be admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:01:51.563543 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1072/2147] 10.222.0.65 () {58 vars in 1153 bytes} [Thu Oct 27 10:01:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 10:01:51.569291 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429def57-afd3-4960-98de-a97b171f5f98 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:01:51.580611 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429def57-afd3-4960-98de-a97b171f5f98 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:01:51.585611 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33025fd-c839-4c74-a799-bc50fb44eb91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:01:51.586224 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33025fd-c839-4c74-a799-bc50fb44eb91 admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:01:51.586507 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33025fd-c839-4c74-a799-bc50fb44eb91 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:01:51.586871 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33025fd-c839-4c74-a799-bc50fb44eb91 admin admin] PATH_INFO: `/v3/projects` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:01:51.587509 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33025fd-c839-4c74-a799-bc50fb44eb91 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:01:51.589549 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33025fd-c839-4c74-a799-bc50fb44eb91 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:01:51.683351 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1076/2148] 10.222.0.65 () {60 vars in 1153 bytes} [Thu Oct 27 10:01:51 2022] POST /identity/v3/projects => generated 369 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 10:01:51.684670 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3c9854-1a39-40fe-8925-95b64f9869be admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:01:51.695870 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3c9854-1a39-40fe-8925-95b64f9869be admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:01:51.760644 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb75619-c9a3-4a47-acd5-f9178dc685a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:01:51.761245 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb75619-c9a3-4a47-acd5-f9178dc685a3 admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:01:51.761523 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb75619-c9a3-4a47-acd5-f9178dc685a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:01:51.761794 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb75619-c9a3-4a47-acd5-f9178dc685a3 admin admin] PATH_INFO: `/v3/users` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:01:51.762430 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb75619-c9a3-4a47-acd5-f9178dc685a3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:01:51.764364 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb75619-c9a3-4a47-acd5-f9178dc685a3 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:01:51.772631 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:01:51.877878 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1073/2149] 10.222.0.65 () {60 vars in 1144 bytes} [Thu Oct 27 10:01:51 2022] POST /identity/v3/users => generated 285 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 10:01:51.882047 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33025fd-c839-4c74-a799-bc50fb44eb91 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:01:51.892443 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33025fd-c839-4c74-a799-bc50fb44eb91 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:01:51.897781 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07170d66-c412-46a1-a85d-88321742d2e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:01:51.898675 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07170d66-c412-46a1-a85d-88321742d2e9 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:01:51.898992 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07170d66-c412-46a1-a85d-88321742d2e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:01:51.899279 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07170d66-c412-46a1-a85d-88321742d2e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:01:51.900041 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07170d66-c412-46a1-a85d-88321742d2e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:01:51.901778 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07170d66-c412-46a1-a85d-88321742d2e9 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:01:51.913806 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1077/2150] 10.222.0.65 () {58 vars in 1122 bytes} [Thu Oct 27 10:01:51 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 10:01:51.918778 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb75619-c9a3-4a47-acd5-f9178dc685a3 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:01:51.934178 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb75619-c9a3-4a47-acd5-f9178dc685a3 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:01:51.939570 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4430bb2-c9a5-468f-8696-b6ef0ac6bc2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:01:51.940199 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4430bb2-c9a5-468f-8696-b6ef0ac6bc2b admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:01:51.940476 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4430bb2-c9a5-468f-8696-b6ef0ac6bc2b admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:01:51.940745 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4430bb2-c9a5-468f-8696-b6ef0ac6bc2b admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:01:51.941381 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4430bb2-c9a5-468f-8696-b6ef0ac6bc2b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:01:51.943143 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4430bb2-c9a5-468f-8696-b6ef0ac6bc2b admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:01:51.954371 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1074/2151] 10.222.0.65 () {58 vars in 1122 bytes} [Thu Oct 27 10:01:51 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 10:01:51.959405 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07170d66-c412-46a1-a85d-88321742d2e9 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:01:51.969750 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07170d66-c412-46a1-a85d-88321742d2e9 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:01:51.975241 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59436e2-ece0-4b71-821a-cf48ca6aff39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:01:51.975897 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59436e2-ece0-4b71-821a-cf48ca6aff39 admin admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:01:51.976183 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59436e2-ece0-4b71-821a-cf48ca6aff39 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:01:51.976461 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59436e2-ece0-4b71-821a-cf48ca6aff39 admin admin] PATH_INFO: `/v3/projects/56c9e7c307bf44acac5825bf80976049/users/d49b2403de0146dc8bd857d680d08db0/roles/43543ce1450245af9661cb017bac17bd` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:01:51.992655 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59436e2-ece0-4b71-821a-cf48ca6aff39 admin admin] RBAC: Authorizing `identity:create_grant(project_id=56c9e7c307bf44acac5825bf80976049, user_id=d49b2403de0146dc8bd857d680d08db0, role_id=43543ce1450245af9661cb017bac17bd)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:01:51.995390 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59436e2-ece0-4b71-821a-cf48ca6aff39 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:01:52.249176 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1078/2152] 10.222.0.65 () {60 vars in 1483 bytes} [Thu Oct 27 10:01:51 2022] PUT /identity/v3/projects/56c9e7c307bf44acac5825bf80976049/users/d49b2403de0146dc8bd857d680d08db0/roles/43543ce1450245af9661cb017bac17bd => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 10:01:52.261927 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9822814-6f8a-4e08-a5a4-c7f90fe65b08 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:01:52.261927 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9822814-6f8a-4e08-a5a4-c7f90fe65b08 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:01:52.262908 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9822814-6f8a-4e08-a5a4-c7f90fe65b08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:01:52.296658 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-e9822814-6f8a-4e08-a5a4-c7f90fe65b08 None None] MFA Rules not processed for user `d49b2403de0146dc8bd857d680d08db0`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 10:01:52.297879 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-e9822814-6f8a-4e08-a5a4-c7f90fe65b08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 10:01:52.377252 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1075/2153] 10.222.0.65 () {58 vars in 958 bytes} [Thu Oct 27 10:01:52 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 10:01:52.392885 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59436e2-ece0-4b71-821a-cf48ca6aff39 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:01:52.395029 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-e59436e2-ece0-4b71-821a-cf48ca6aff39 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 10:01:52.477195 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59436e2-ece0-4b71-821a-cf48ca6aff39 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:01:52.482680 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d986af-7dc4-49f5-b1e7-15ae944c2aed service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd0d23ef039d4f1591a589d302ef165f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc2e3a7a1bcc480891c0b433291c00b1', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:01:52.483282 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d986af-7dc4-49f5-b1e7-15ae944c2aed service nova] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:01:52.483561 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d986af-7dc4-49f5-b1e7-15ae944c2aed service nova] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:01:52.483837 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d986af-7dc4-49f5-b1e7-15ae944c2aed service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:01:52.492189 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d986af-7dc4-49f5-b1e7-15ae944c2aed service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:01:52.493761 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d986af-7dc4-49f5-b1e7-15ae944c2aed service nova] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:01:52.502977 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1079/2154] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Oct 27 10:01:52 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 10:01:55.763605 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9822814-6f8a-4e08-a5a4-c7f90fe65b08 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:01:55.853955 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9822814-6f8a-4e08-a5a4-c7f90fe65b08 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:01:55.861374 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fc663c-72b7-4251-8c3d-fc6dbb050b04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:01:55.862038 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fc663c-72b7-4251-8c3d-fc6dbb050b04 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:01:55.867626 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fc663c-72b7-4251-8c3d-fc6dbb050b04 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:01:55.867626 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fc663c-72b7-4251-8c3d-fc6dbb050b04 admin admin] PATH_INFO: `/v3/users/d49b2403de0146dc8bd857d680d08db0` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:01:55.867626 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6fc663c-72b7-4251-8c3d-fc6dbb050b04 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d49b2403de0146dc8bd857d680d08db0)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:01:55.867626 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6fc663c-72b7-4251-8c3d-fc6dbb050b04 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:01:56.086442 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-a6fc663c-72b7-4251-8c3d-fc6dbb050b04 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd49b2403de0146dc8bd857d680d08db0'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:01:56.087179 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-a6fc663c-72b7-4251-8c3d-fc6dbb050b04 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd49b2403de0146dc8bd857d680d08db0'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:01:56.095046 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-a6fc663c-72b7-4251-8c3d-fc6dbb050b04 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd49b2403de0146dc8bd857d680d08db0'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:01:56.095865 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-a6fc663c-72b7-4251-8c3d-fc6dbb050b04 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd49b2403de0146dc8bd857d680d08db0'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:01:56.107735 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:INSERT=3,keystone:SELECT=89,keystone:DELETE=8 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:01:56.110168 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-a6fc663c-72b7-4251-8c3d-fc6dbb050b04 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd49b2403de0146dc8bd857d680d08db0'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:01:56.213872 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1076/2155] 10.222.0.65 () {58 vars in 1224 bytes} [Thu Oct 27 10:01:55 2022] DELETE /identity/v3/users/d49b2403de0146dc8bd857d680d08db0 => generated 0 bytes in 451 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 10:01:56.218554 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987aca61-5800-4c64-ad35-dc3cde5ec705 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:01:56.219755 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987aca61-5800-4c64-ad35-dc3cde5ec705 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:01:56.220104 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987aca61-5800-4c64-ad35-dc3cde5ec705 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:01:56.243619 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-987aca61-5800-4c64-ad35-dc3cde5ec705 None None] MFA Rules not processed for user `b5065084bf664b99bdeac46067cb0f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 10:01:56.244894 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-987aca61-5800-4c64-ad35-dc3cde5ec705 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 10:01:56.309067 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1080/2156] 10.222.0.65 () {58 vars in 958 bytes} [Thu Oct 27 10:01:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 10:01:56.320334 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fc663c-72b7-4251-8c3d-fc6dbb050b04 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:01:56.322291 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-a6fc663c-72b7-4251-8c3d-fc6dbb050b04 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 10:01:56.391607 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fc663c-72b7-4251-8c3d-fc6dbb050b04 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:01:56.395621 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e06186a-e389-4b32-b34c-c37913c0dc35 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6191cc41efa74f46b49022cf387f7a4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc2e3a7a1bcc480891c0b433291c00b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:01:56.396605 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e06186a-e389-4b32-b34c-c37913c0dc35 service neutron] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:01:56.396892 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e06186a-e389-4b32-b34c-c37913c0dc35 service neutron] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:01:56.397188 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e06186a-e389-4b32-b34c-c37913c0dc35 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:01:56.407130 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e06186a-e389-4b32-b34c-c37913c0dc35 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:01:56.408600 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e06186a-e389-4b32-b34c-c37913c0dc35 service neutron] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:01:56.420626 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1077/2157] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Oct 27 10:01:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 10:01:56.896076 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987aca61-5800-4c64-ad35-dc3cde5ec705 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:01:56.897690 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-987aca61-5800-4c64-ad35-dc3cde5ec705 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 10:01:56.906597 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:DELETE=3,keystone:SELECT=95,keystone:INSERT=2 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:01:56.924237 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987aca61-5800-4c64-ad35-dc3cde5ec705 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:01:56.933253 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1899ba-09bc-4928-b238-c57ccdac0ac3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:01:56.934362 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1899ba-09bc-4928-b238-c57ccdac0ac3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:01:56.935553 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1899ba-09bc-4928-b238-c57ccdac0ac3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:01:56.936661 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1899ba-09bc-4928-b238-c57ccdac0ac3 admin admin] PATH_INFO: `/v3/projects/56c9e7c307bf44acac5825bf80976049` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:01:56.938218 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1899ba-09bc-4928-b238-c57ccdac0ac3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=56c9e7c307bf44acac5825bf80976049)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:01:56.940568 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1899ba-09bc-4928-b238-c57ccdac0ac3 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:01:57.053416 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-ad1899ba-09bc-4928-b238-c57ccdac0ac3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '56c9e7c307bf44acac5825bf80976049', 'request_id': 'req-ad1899ba-09bc-4928-b238-c57ccdac0ac3'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:01:57.140658 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-ad1899ba-09bc-4928-b238-c57ccdac0ac3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '56c9e7c307bf44acac5825bf80976049', 'request_id': 'req-ad1899ba-09bc-4928-b238-c57ccdac0ac3'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:01:57.148495 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-ad1899ba-09bc-4928-b238-c57ccdac0ac3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '56c9e7c307bf44acac5825bf80976049', 'request_id': 'req-ad1899ba-09bc-4928-b238-c57ccdac0ac3'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:01:57.160729 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-ad1899ba-09bc-4928-b238-c57ccdac0ac3 admin admin] The token cache is being invalidate because project 56c9e7c307bf44acac5825bf80976049 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 10:01:57.161060 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-ad1899ba-09bc-4928-b238-c57ccdac0ac3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:01:57.161862 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-ad1899ba-09bc-4928-b238-c57ccdac0ac3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:01:57.163437 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1081/2158] 10.222.0.65 () {58 vars in 1233 bytes} [Thu Oct 27 10:01:56 2022] DELETE /identity/v3/projects/56c9e7c307bf44acac5825bf80976049 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 10:01:57.168329 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c4cd8e-a442-4404-b54f-b6ce7fb40e56 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:01:57.168861 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c4cd8e-a442-4404-b54f-b6ce7fb40e56 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:01:57.169060 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c4cd8e-a442-4404-b54f-b6ce7fb40e56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:01:57.190135 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-e0c4cd8e-a442-4404-b54f-b6ce7fb40e56 None None] MFA Rules not processed for user `b5065084bf664b99bdeac46067cb0f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 10:01:57.191542 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-e0c4cd8e-a442-4404-b54f-b6ce7fb40e56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 10:01:57.260844 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1078/2159] 10.222.0.65 () {58 vars in 958 bytes} [Thu Oct 27 10:01:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 10:01:57.269907 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6357ebf-4ee2-4710-8004-cbb17898efb0 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:01:57.270512 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6357ebf-4ee2-4710-8004-cbb17898efb0 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:01:57.270512 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6357ebf-4ee2-4710-8004-cbb17898efb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:01:57.291021 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-d6357ebf-4ee2-4710-8004-cbb17898efb0 None None] MFA Rules not processed for user `b5065084bf664b99bdeac46067cb0f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 10:01:57.292241 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-d6357ebf-4ee2-4710-8004-cbb17898efb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 10:01:57.302375 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1082/2160] 10.222.0.65 () {58 vars in 958 bytes} [Thu Oct 27 10:01:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 10:01:57.318144 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c4cd8e-a442-4404-b54f-b6ce7fb40e56 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:01:57.327929 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c4cd8e-a442-4404-b54f-b6ce7fb40e56 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:01:57.332823 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8af965e-67f1-4a68-b6f1-6e4f12f086bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:01:57.333444 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8af965e-67f1-4a68-b6f1-6e4f12f086bc admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:01:57.334039 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8af965e-67f1-4a68-b6f1-6e4f12f086bc admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:01:57.334039 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8af965e-67f1-4a68-b6f1-6e4f12f086bc admin admin] PATH_INFO: `/v3/domains` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:01:57.334654 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8af965e-67f1-4a68-b6f1-6e4f12f086bc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 10:01:57.334959 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8af965e-67f1-4a68-b6f1-6e4f12f086bc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:01:57.336571 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8af965e-67f1-4a68-b6f1-6e4f12f086bc admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:01:57.349783 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1079/2161] 10.222.0.65 () {58 vars in 1153 bytes} [Thu Oct 27 10:01:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 10:01:57.354594 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6357ebf-4ee2-4710-8004-cbb17898efb0 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:01:57.365514 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6357ebf-4ee2-4710-8004-cbb17898efb0 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:01:57.370932 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5451968-6977-4cec-9e94-75ec168ae938 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:01:57.371541 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5451968-6977-4cec-9e94-75ec168ae938 admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:01:57.373290 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5451968-6977-4cec-9e94-75ec168ae938 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:01:57.373290 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5451968-6977-4cec-9e94-75ec168ae938 admin admin] PATH_INFO: `/v3/projects` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:01:57.373290 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5451968-6977-4cec-9e94-75ec168ae938 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:01:57.374669 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5451968-6977-4cec-9e94-75ec168ae938 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:01:57.538457 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1083/2162] 10.222.0.65 () {60 vars in 1153 bytes} [Thu Oct 27 10:01:57 2022] POST /identity/v3/projects => generated 365 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 10:01:57.542374 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8af965e-67f1-4a68-b6f1-6e4f12f086bc admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:01:57.553607 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8af965e-67f1-4a68-b6f1-6e4f12f086bc admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:01:57.612132 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed987e5-949b-4961-b7d1-4448cafdec8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:01:57.612787 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed987e5-949b-4961-b7d1-4448cafdec8a admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:01:57.613075 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed987e5-949b-4961-b7d1-4448cafdec8a admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:01:57.613353 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed987e5-949b-4961-b7d1-4448cafdec8a admin admin] PATH_INFO: `/v3/users` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:01:57.613986 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed987e5-949b-4961-b7d1-4448cafdec8a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:01:57.616535 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed987e5-949b-4961-b7d1-4448cafdec8a admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:01:57.678435 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1080/2163] 10.222.0.65 () {60 vars in 1144 bytes} [Thu Oct 27 10:01:57 2022] POST /identity/v3/users => generated 283 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 10:01:57.682562 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5451968-6977-4cec-9e94-75ec168ae938 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:01:57.693844 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5451968-6977-4cec-9e94-75ec168ae938 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:01:57.698580 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6bc7ef-939a-41e5-a1b5-76d77b9f8c4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:01:57.699183 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6bc7ef-939a-41e5-a1b5-76d77b9f8c4f admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:01:57.699468 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6bc7ef-939a-41e5-a1b5-76d77b9f8c4f admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:01:57.701371 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6bc7ef-939a-41e5-a1b5-76d77b9f8c4f admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:01:57.701371 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6bc7ef-939a-41e5-a1b5-76d77b9f8c4f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:01:57.701950 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6bc7ef-939a-41e5-a1b5-76d77b9f8c4f admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:01:57.712615 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1084/2164] 10.222.0.65 () {58 vars in 1122 bytes} [Thu Oct 27 10:01:57 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 10:01:57.716935 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed987e5-949b-4961-b7d1-4448cafdec8a admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:01:57.727927 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed987e5-949b-4961-b7d1-4448cafdec8a admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:01:57.732759 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1966eb82-77d1-4eb3-a3f0-79026f0ec2f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:01:57.733385 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1966eb82-77d1-4eb3-a3f0-79026f0ec2f7 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:01:57.733668 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1966eb82-77d1-4eb3-a3f0-79026f0ec2f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:01:57.733946 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1966eb82-77d1-4eb3-a3f0-79026f0ec2f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:01:57.734659 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1966eb82-77d1-4eb3-a3f0-79026f0ec2f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:01:57.736318 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1966eb82-77d1-4eb3-a3f0-79026f0ec2f7 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:01:57.737679 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:DELETE=2,keystone:SELECT=94,keystone:INSERT=4 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:01:57.750124 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1081/2165] 10.222.0.65 () {58 vars in 1122 bytes} [Thu Oct 27 10:01:57 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 10:01:57.754598 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6bc7ef-939a-41e5-a1b5-76d77b9f8c4f admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:01:57.765394 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6bc7ef-939a-41e5-a1b5-76d77b9f8c4f admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:01:57.770070 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59da22dc-8e02-4ba3-87e4-0f9774999e29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:01:57.771348 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59da22dc-8e02-4ba3-87e4-0f9774999e29 admin admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:01:57.771806 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59da22dc-8e02-4ba3-87e4-0f9774999e29 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:01:57.772088 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59da22dc-8e02-4ba3-87e4-0f9774999e29 admin admin] PATH_INFO: `/v3/projects/972212d39442414192c1d1d989ea2ee3/users/44163ca1c6df4b4ea6c847c0a94bb08e/roles/43543ce1450245af9661cb017bac17bd` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:01:57.789500 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59da22dc-8e02-4ba3-87e4-0f9774999e29 admin admin] RBAC: Authorizing `identity:create_grant(project_id=972212d39442414192c1d1d989ea2ee3, user_id=44163ca1c6df4b4ea6c847c0a94bb08e, role_id=43543ce1450245af9661cb017bac17bd)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:01:57.792160 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59da22dc-8e02-4ba3-87e4-0f9774999e29 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:01:58.060879 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1085/2166] 10.222.0.65 () {60 vars in 1483 bytes} [Thu Oct 27 10:01:57 2022] PUT /identity/v3/projects/972212d39442414192c1d1d989ea2ee3/users/44163ca1c6df4b4ea6c847c0a94bb08e/roles/43543ce1450245af9661cb017bac17bd => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 10:01:58.072020 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2537fefb-7c52-4daa-986c-75f3d38f4954 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:01:58.072308 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2537fefb-7c52-4daa-986c-75f3d38f4954 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:01:58.072585 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2537fefb-7c52-4daa-986c-75f3d38f4954 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:01:58.103480 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-2537fefb-7c52-4daa-986c-75f3d38f4954 None None] MFA Rules not processed for user `44163ca1c6df4b4ea6c847c0a94bb08e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 10:01:58.104054 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-2537fefb-7c52-4daa-986c-75f3d38f4954 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 10:01:58.174741 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1082/2167] 10.222.0.65 () {58 vars in 958 bytes} [Thu Oct 27 10:01:58 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 10:01:58.186753 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59da22dc-8e02-4ba3-87e4-0f9774999e29 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:01:58.188468 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-59da22dc-8e02-4ba3-87e4-0f9774999e29 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 10:01:58.250279 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59da22dc-8e02-4ba3-87e4-0f9774999e29 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:01:58.254126 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8c2341-8724-4b9a-b626-c937560101d4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8e5d5f04c4741bb86ca4a0f667d4ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc2e3a7a1bcc480891c0b433291c00b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:01:58.255566 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8c2341-8724-4b9a-b626-c937560101d4 service cinder] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:01:58.255855 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8c2341-8724-4b9a-b626-c937560101d4 service cinder] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:01:58.256136 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8c2341-8724-4b9a-b626-c937560101d4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:01:58.265280 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8c2341-8724-4b9a-b626-c937560101d4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:01:58.266815 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8c2341-8724-4b9a-b626-c937560101d4 service cinder] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:01:58.275940 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1086/2168] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Oct 27 10:01:58 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 10:02:02.152417 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2537fefb-7c52-4daa-986c-75f3d38f4954 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:02:02.153988 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-2537fefb-7c52-4daa-986c-75f3d38f4954 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 10:02:02.222746 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2537fefb-7c52-4daa-986c-75f3d38f4954 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:02:02.227992 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849e3584-86af-489a-8615-6c86eadd2a71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:02:02.232251 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849e3584-86af-489a-8615-6c86eadd2a71 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:02:02.232251 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849e3584-86af-489a-8615-6c86eadd2a71 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:02:02.232251 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849e3584-86af-489a-8615-6c86eadd2a71 admin admin] PATH_INFO: `/v3/users/c4ba75f25bfa4bf69869d3c86be97ab6` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:02:02.232251 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849e3584-86af-489a-8615-6c86eadd2a71 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c4ba75f25bfa4bf69869d3c86be97ab6)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:02:02.232773 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849e3584-86af-489a-8615-6c86eadd2a71 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:02:02.476462 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-849e3584-86af-489a-8615-6c86eadd2a71 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c4ba75f25bfa4bf69869d3c86be97ab6'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:02:02.477123 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-849e3584-86af-489a-8615-6c86eadd2a71 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c4ba75f25bfa4bf69869d3c86be97ab6'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:02:02.484412 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-849e3584-86af-489a-8615-6c86eadd2a71 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c4ba75f25bfa4bf69869d3c86be97ab6'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:02:02.485052 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-849e3584-86af-489a-8615-6c86eadd2a71 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c4ba75f25bfa4bf69869d3c86be97ab6'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:02:02.498340 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-849e3584-86af-489a-8615-6c86eadd2a71 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c4ba75f25bfa4bf69869d3c86be97ab6'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:02:02.566494 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1083/2169] 10.222.0.65 () {58 vars in 1224 bytes} [Thu Oct 27 10:02:02 2022] DELETE /identity/v3/users/c4ba75f25bfa4bf69869d3c86be97ab6 => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 10:02:02.568238 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc354e80-0008-4aff-a3f7-09b7bcb78aa1 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:02:02.569945 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc354e80-0008-4aff-a3f7-09b7bcb78aa1 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:02:02.569945 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc354e80-0008-4aff-a3f7-09b7bcb78aa1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:02:02.592650 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-cc354e80-0008-4aff-a3f7-09b7bcb78aa1 None None] MFA Rules not processed for user `b5065084bf664b99bdeac46067cb0f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 10:02:02.593919 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-cc354e80-0008-4aff-a3f7-09b7bcb78aa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 10:02:02.615113 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:02:02.669401 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1087/2170] 10.222.0.65 () {58 vars in 958 bytes} [Thu Oct 27 10:02:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 10:02:02.681148 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849e3584-86af-489a-8615-6c86eadd2a71 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:02:02.682829 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-849e3584-86af-489a-8615-6c86eadd2a71 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 10:02:02.690158 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:02:02.744948 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849e3584-86af-489a-8615-6c86eadd2a71 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:02:02.748650 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5088a26a-3c5d-4f4a-a1c3-f11a8d9777fc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6191cc41efa74f46b49022cf387f7a4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc2e3a7a1bcc480891c0b433291c00b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:02:02.749255 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5088a26a-3c5d-4f4a-a1c3-f11a8d9777fc service neutron] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:02:02.749538 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5088a26a-3c5d-4f4a-a1c3-f11a8d9777fc service neutron] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:02:02.749813 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5088a26a-3c5d-4f4a-a1c3-f11a8d9777fc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:02:02.760357 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5088a26a-3c5d-4f4a-a1c3-f11a8d9777fc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:02:02.776689 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5088a26a-3c5d-4f4a-a1c3-f11a8d9777fc service neutron] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:02:02.776689 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1084/2171] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Oct 27 10:02:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 10:02:03.211325 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc354e80-0008-4aff-a3f7-09b7bcb78aa1 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:02:03.212832 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-cc354e80-0008-4aff-a3f7-09b7bcb78aa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 10:02:03.225371 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc354e80-0008-4aff-a3f7-09b7bcb78aa1 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:02:03.230030 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487333aa-72f5-485d-9338-5e8622b6b9df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:02:03.230702 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487333aa-72f5-485d-9338-5e8622b6b9df admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:02:03.230994 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487333aa-72f5-485d-9338-5e8622b6b9df admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:02:03.231271 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487333aa-72f5-485d-9338-5e8622b6b9df admin admin] PATH_INFO: `/v3/projects/de8eb0fce1f84df9a45645a42a3b13fb` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:02:03.232401 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487333aa-72f5-485d-9338-5e8622b6b9df admin admin] RBAC: Authorizing `identity:delete_project(project_id=de8eb0fce1f84df9a45645a42a3b13fb)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:02:03.234379 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487333aa-72f5-485d-9338-5e8622b6b9df admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:02:03.354606 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-487333aa-72f5-485d-9338-5e8622b6b9df admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'de8eb0fce1f84df9a45645a42a3b13fb', 'request_id': 'req-487333aa-72f5-485d-9338-5e8622b6b9df'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:02:03.449480 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-487333aa-72f5-485d-9338-5e8622b6b9df admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'de8eb0fce1f84df9a45645a42a3b13fb', 'request_id': 'req-487333aa-72f5-485d-9338-5e8622b6b9df'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:02:03.456907 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-487333aa-72f5-485d-9338-5e8622b6b9df admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'de8eb0fce1f84df9a45645a42a3b13fb', 'request_id': 'req-487333aa-72f5-485d-9338-5e8622b6b9df'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:02:03.468960 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-487333aa-72f5-485d-9338-5e8622b6b9df admin admin] The token cache is being invalidate because project de8eb0fce1f84df9a45645a42a3b13fb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 10:02:03.474461 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-487333aa-72f5-485d-9338-5e8622b6b9df admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:02:03.474461 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-487333aa-72f5-485d-9338-5e8622b6b9df admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:02:03.474461 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1088/2172] 10.222.0.65 () {58 vars in 1233 bytes} [Thu Oct 27 10:02:03 2022] DELETE /identity/v3/projects/de8eb0fce1f84df9a45645a42a3b13fb => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 10:02:03.476093 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5088a26a-3c5d-4f4a-a1c3-f11a8d9777fc service neutron] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:02:03.485679 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5088a26a-3c5d-4f4a-a1c3-f11a8d9777fc service neutron] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:02:03.544714 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6181b69-617d-4be5-98cd-22ecb3cc3d39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:02:03.545394 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6181b69-617d-4be5-98cd-22ecb3cc3d39 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:02:03.545673 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6181b69-617d-4be5-98cd-22ecb3cc3d39 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:02:03.545950 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6181b69-617d-4be5-98cd-22ecb3cc3d39 admin admin] PATH_INFO: `/v3/users/fb078c5214744791b9da53382c207278` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:02:03.547141 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6181b69-617d-4be5-98cd-22ecb3cc3d39 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fb078c5214744791b9da53382c207278)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:02:03.549084 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6181b69-617d-4be5-98cd-22ecb3cc3d39 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:02:03.732522 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-a6181b69-617d-4be5-98cd-22ecb3cc3d39 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fb078c5214744791b9da53382c207278'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:02:03.733209 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-a6181b69-617d-4be5-98cd-22ecb3cc3d39 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fb078c5214744791b9da53382c207278'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:02:03.741814 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-a6181b69-617d-4be5-98cd-22ecb3cc3d39 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fb078c5214744791b9da53382c207278'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:02:03.742506 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-a6181b69-617d-4be5-98cd-22ecb3cc3d39 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fb078c5214744791b9da53382c207278'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:02:03.755401 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-a6181b69-617d-4be5-98cd-22ecb3cc3d39 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fb078c5214744791b9da53382c207278'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:02:03.816991 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1085/2173] 10.222.0.65 () {58 vars in 1224 bytes} [Thu Oct 27 10:02:03 2022] DELETE /identity/v3/users/fb078c5214744791b9da53382c207278 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 10:02:04.618787 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487333aa-72f5-485d-9338-5e8622b6b9df admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:02:04.621869 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-487333aa-72f5-485d-9338-5e8622b6b9df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 10:02:04.636962 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487333aa-72f5-485d-9338-5e8622b6b9df admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:02:04.698942 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c290ca3-0689-4972-ad34-c5b720caf40e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:02:04.699585 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c290ca3-0689-4972-ad34-c5b720caf40e admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:02:04.699878 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c290ca3-0689-4972-ad34-c5b720caf40e admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:02:04.700138 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c290ca3-0689-4972-ad34-c5b720caf40e admin admin] PATH_INFO: `/v3/projects/9b505b06aaa34689afe645095f8bdd2c` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:02:04.701277 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c290ca3-0689-4972-ad34-c5b720caf40e admin admin] RBAC: Authorizing `identity:delete_project(project_id=9b505b06aaa34689afe645095f8bdd2c)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:02:04.703283 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c290ca3-0689-4972-ad34-c5b720caf40e admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:02:04.833877 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-5c290ca3-0689-4972-ad34-c5b720caf40e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9b505b06aaa34689afe645095f8bdd2c', 'request_id': 'req-5c290ca3-0689-4972-ad34-c5b720caf40e'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:02:04.836774 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:02:04.917235 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-5c290ca3-0689-4972-ad34-c5b720caf40e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9b505b06aaa34689afe645095f8bdd2c', 'request_id': 'req-5c290ca3-0689-4972-ad34-c5b720caf40e'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:02:04.926185 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-5c290ca3-0689-4972-ad34-c5b720caf40e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9b505b06aaa34689afe645095f8bdd2c', 'request_id': 'req-5c290ca3-0689-4972-ad34-c5b720caf40e'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:02:04.939653 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-5c290ca3-0689-4972-ad34-c5b720caf40e admin admin] The token cache is being invalidate because project 9b505b06aaa34689afe645095f8bdd2c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 10:02:04.939937 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-5c290ca3-0689-4972-ad34-c5b720caf40e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:02:04.944067 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-5c290ca3-0689-4972-ad34-c5b720caf40e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:02:04.944067 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1089/2174] 10.222.0.65 () {58 vars in 1233 bytes} [Thu Oct 27 10:02:04 2022] DELETE /identity/v3/projects/9b505b06aaa34689afe645095f8bdd2c => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 10:02:04.947952 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1df39d6-d79a-461e-a7a4-d89fad39ba77 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:02:04.948443 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1df39d6-d79a-461e-a7a4-d89fad39ba77 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:02:04.948443 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1df39d6-d79a-461e-a7a4-d89fad39ba77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:02:04.968483 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-e1df39d6-d79a-461e-a7a4-d89fad39ba77 None None] MFA Rules not processed for user `b5065084bf664b99bdeac46067cb0f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 10:02:04.969699 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-e1df39d6-d79a-461e-a7a4-d89fad39ba77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 10:02:04.992074 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:02:05.031397 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1086/2175] 10.222.0.65 () {58 vars in 958 bytes} [Thu Oct 27 10:02:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 10:02:05.040900 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36c2f8b-3ff8-4404-87e2-10e92f1189cd None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:02:05.041185 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36c2f8b-3ff8-4404-87e2-10e92f1189cd None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:02:05.041487 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36c2f8b-3ff8-4404-87e2-10e92f1189cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:02:05.062419 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-a36c2f8b-3ff8-4404-87e2-10e92f1189cd None None] MFA Rules not processed for user `b5065084bf664b99bdeac46067cb0f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 10:02:05.063678 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-a36c2f8b-3ff8-4404-87e2-10e92f1189cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 10:02:05.071964 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1090/2176] 10.222.0.65 () {58 vars in 958 bytes} [Thu Oct 27 10:02:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 10:02:05.076323 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1df39d6-d79a-461e-a7a4-d89fad39ba77 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:02:05.087398 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1df39d6-d79a-461e-a7a4-d89fad39ba77 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:02:05.092308 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fed76e-3aee-42f0-b875-f7d7ce2a4156 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:02:05.092922 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fed76e-3aee-42f0-b875-f7d7ce2a4156 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:02:05.093203 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fed76e-3aee-42f0-b875-f7d7ce2a4156 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:02:05.093480 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fed76e-3aee-42f0-b875-f7d7ce2a4156 admin admin] PATH_INFO: `/v3/domains` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:02:05.094128 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3fed76e-3aee-42f0-b875-f7d7ce2a4156 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 10:02:05.094435 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3fed76e-3aee-42f0-b875-f7d7ce2a4156 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:02:05.096138 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3fed76e-3aee-42f0-b875-f7d7ce2a4156 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:02:05.108859 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1087/2177] 10.222.0.65 () {58 vars in 1153 bytes} [Thu Oct 27 10:02:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 10:02:05.113445 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36c2f8b-3ff8-4404-87e2-10e92f1189cd None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:02:05.123506 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36c2f8b-3ff8-4404-87e2-10e92f1189cd None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:02:05.128483 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9b2dff-b846-4bed-9006-dfa4bb21431e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:02:05.129086 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9b2dff-b846-4bed-9006-dfa4bb21431e admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:02:05.129367 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9b2dff-b846-4bed-9006-dfa4bb21431e admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:02:05.129637 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9b2dff-b846-4bed-9006-dfa4bb21431e admin admin] PATH_INFO: `/v3/projects` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:02:05.130321 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9b2dff-b846-4bed-9006-dfa4bb21431e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:02:05.132853 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9b2dff-b846-4bed-9006-dfa4bb21431e admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:02:05.258759 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1091/2178] 10.222.0.65 () {60 vars in 1153 bytes} [Thu Oct 27 10:02:05 2022] POST /identity/v3/projects => generated 357 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 10:02:05.262926 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fed76e-3aee-42f0-b875-f7d7ce2a4156 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:02:05.275171 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fed76e-3aee-42f0-b875-f7d7ce2a4156 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:02:05.335456 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8693032a-2ac7-4b2d-ac25-41a78ac0398d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:02:05.336106 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8693032a-2ac7-4b2d-ac25-41a78ac0398d admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:02:05.336393 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8693032a-2ac7-4b2d-ac25-41a78ac0398d admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:02:05.336692 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8693032a-2ac7-4b2d-ac25-41a78ac0398d admin admin] PATH_INFO: `/v3/users` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:02:05.338105 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8693032a-2ac7-4b2d-ac25-41a78ac0398d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:02:05.340082 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8693032a-2ac7-4b2d-ac25-41a78ac0398d admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:02:05.432997 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1088/2179] 10.222.0.65 () {60 vars in 1144 bytes} [Thu Oct 27 10:02:05 2022] POST /identity/v3/users => generated 279 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 10:02:05.437028 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9b2dff-b846-4bed-9006-dfa4bb21431e admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:02:05.448063 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9b2dff-b846-4bed-9006-dfa4bb21431e admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:02:05.452679 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740c9849-2647-453e-9943-d3f41ce0197b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:02:05.453310 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740c9849-2647-453e-9943-d3f41ce0197b admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:02:05.453586 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740c9849-2647-453e-9943-d3f41ce0197b admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:02:05.453860 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740c9849-2647-453e-9943-d3f41ce0197b admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:02:05.454613 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740c9849-2647-453e-9943-d3f41ce0197b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:02:05.456401 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740c9849-2647-453e-9943-d3f41ce0197b admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:02:05.467234 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1092/2180] 10.222.0.65 () {58 vars in 1122 bytes} [Thu Oct 27 10:02:05 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 10:02:05.479189 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8693032a-2ac7-4b2d-ac25-41a78ac0398d admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:02:05.489311 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8693032a-2ac7-4b2d-ac25-41a78ac0398d admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:02:05.494150 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bc4990-2cc7-45c0-a98c-a78eb270dc28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:02:05.494790 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bc4990-2cc7-45c0-a98c-a78eb270dc28 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:02:05.495069 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bc4990-2cc7-45c0-a98c-a78eb270dc28 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:02:05.495366 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bc4990-2cc7-45c0-a98c-a78eb270dc28 admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:02:05.495994 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08bc4990-2cc7-45c0-a98c-a78eb270dc28 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:02:05.497588 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08bc4990-2cc7-45c0-a98c-a78eb270dc28 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:02:05.509651 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1089/2181] 10.222.0.65 () {58 vars in 1122 bytes} [Thu Oct 27 10:02:05 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 10:02:05.513897 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740c9849-2647-453e-9943-d3f41ce0197b admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:02:05.524760 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740c9849-2647-453e-9943-d3f41ce0197b admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:02:05.529548 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1223bcb0-7f03-4628-ac25-3d12f7cd8e11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:02:05.530197 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1223bcb0-7f03-4628-ac25-3d12f7cd8e11 admin admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:02:05.530482 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1223bcb0-7f03-4628-ac25-3d12f7cd8e11 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:02:05.530820 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1223bcb0-7f03-4628-ac25-3d12f7cd8e11 admin admin] PATH_INFO: `/v3/projects/15b1beeea6cd4f60ae67a96605597915/users/575b72087a5940888c26545d90b8249c/roles/43543ce1450245af9661cb017bac17bd` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:02:05.547270 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1223bcb0-7f03-4628-ac25-3d12f7cd8e11 admin admin] RBAC: Authorizing `identity:create_grant(project_id=15b1beeea6cd4f60ae67a96605597915, user_id=575b72087a5940888c26545d90b8249c, role_id=43543ce1450245af9661cb017bac17bd)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:02:05.550070 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1223bcb0-7f03-4628-ac25-3d12f7cd8e11 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:02:05.650263 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1093/2182] 10.222.0.65 () {60 vars in 1483 bytes} [Thu Oct 27 10:02:05 2022] PUT /identity/v3/projects/15b1beeea6cd4f60ae67a96605597915/users/575b72087a5940888c26545d90b8249c/roles/43543ce1450245af9661cb017bac17bd => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 10:02:05.660767 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d5efe2-f308-46c6-ad7f-a6f0fa2a7b00 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:02:05.661046 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d5efe2-f308-46c6-ad7f-a6f0fa2a7b00 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:02:05.661333 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d5efe2-f308-46c6-ad7f-a6f0fa2a7b00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:02:05.694003 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-81d5efe2-f308-46c6-ad7f-a6f0fa2a7b00 None None] MFA Rules not processed for user `575b72087a5940888c26545d90b8249c`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 10:02:05.695259 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-81d5efe2-f308-46c6-ad7f-a6f0fa2a7b00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 10:02:05.768463 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1090/2183] 10.222.0.65 () {58 vars in 958 bytes} [Thu Oct 27 10:02:05 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 10:02:05.772405 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1223bcb0-7f03-4628-ac25-3d12f7cd8e11 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:02:05.839733 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1223bcb0-7f03-4628-ac25-3d12f7cd8e11 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:02:05.845320 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdea797-576e-401a-90f3-4427b6b78463 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:02:05.845945 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdea797-576e-401a-90f3-4427b6b78463 admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:02:05.846240 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdea797-576e-401a-90f3-4427b6b78463 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:02:05.846506 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdea797-576e-401a-90f3-4427b6b78463 admin admin] PATH_INFO: `/v3/projects` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:02:05.847183 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fdea797-576e-401a-90f3-4427b6b78463 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:02:05.849109 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fdea797-576e-401a-90f3-4427b6b78463 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:02:05.870446 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d5efe2-f308-46c6-ad7f-a6f0fa2a7b00 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:02:05.871853 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-81d5efe2-f308-46c6-ad7f-a6f0fa2a7b00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 10:02:05.900508 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:02:05.930750 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1094/2184] 10.222.0.65 () {60 vars in 1153 bytes} [Thu Oct 27 10:02:05 2022] POST /identity/v3/projects => generated 357 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 10:02:05.932535 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdea797-576e-401a-90f3-4427b6b78463 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:02:05.935501 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d5efe2-f308-46c6-ad7f-a6f0fa2a7b00 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:02:05.989865 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b13441f-6a29-4733-92b1-08df4baa9a92 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6191cc41efa74f46b49022cf387f7a4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc2e3a7a1bcc480891c0b433291c00b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:02:05.991124 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b13441f-6a29-4733-92b1-08df4baa9a92 service neutron] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:02:05.991365 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b13441f-6a29-4733-92b1-08df4baa9a92 service neutron] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:02:05.991705 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b13441f-6a29-4733-92b1-08df4baa9a92 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:02:05.993449 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-1b13441f-6a29-4733-92b1-08df4baa9a92 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 10:02:06.003050 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdea797-576e-401a-90f3-4427b6b78463 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:02:06.009324 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11dbe0c6-3cbc-41cb-8102-cfa029d6cc66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:02:06.009939 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dbe0c6-3cbc-41cb-8102-cfa029d6cc66 admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:02:06.010229 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dbe0c6-3cbc-41cb-8102-cfa029d6cc66 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:02:06.010506 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dbe0c6-3cbc-41cb-8102-cfa029d6cc66 admin admin] PATH_INFO: `/v3/users` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:02:06.011187 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11dbe0c6-3cbc-41cb-8102-cfa029d6cc66 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:02:06.013132 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11dbe0c6-3cbc-41cb-8102-cfa029d6cc66 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:02:06.023396 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:INSERT=4,keystone:DELETE=3,keystone:SELECT=93 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:02:06.063959 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b13441f-6a29-4733-92b1-08df4baa9a92 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:02:06.065416 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b13441f-6a29-4733-92b1-08df4baa9a92 service neutron] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:02:06.082731 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1091/2185] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Oct 27 10:02:05 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 10:02:06.086561 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1095/2186] 10.222.0.65 () {60 vars in 1144 bytes} [Thu Oct 27 10:02:05 2022] POST /identity/v3/users => generated 285 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 10:02:06.096433 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b13441f-6a29-4733-92b1-08df4baa9a92 service neutron] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:02:06.108960 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b13441f-6a29-4733-92b1-08df4baa9a92 service neutron] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:02:06.113900 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a3a46b-9a43-40ff-967a-2d501c4d8afd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:02:06.114507 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a3a46b-9a43-40ff-967a-2d501c4d8afd admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:02:06.114818 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a3a46b-9a43-40ff-967a-2d501c4d8afd admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:02:06.115092 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a3a46b-9a43-40ff-967a-2d501c4d8afd admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:02:06.116734 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a3a46b-9a43-40ff-967a-2d501c4d8afd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:02:06.118768 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a3a46b-9a43-40ff-967a-2d501c4d8afd admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:02:06.129702 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1092/2187] 10.222.0.65 () {58 vars in 1122 bytes} [Thu Oct 27 10:02:06 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 10:02:06.134331 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11dbe0c6-3cbc-41cb-8102-cfa029d6cc66 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:02:06.145031 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11dbe0c6-3cbc-41cb-8102-cfa029d6cc66 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:02:06.153969 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db2bf67-6e4a-4b77-bff7-f9a2667ba34b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:02:06.153969 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db2bf67-6e4a-4b77-bff7-f9a2667ba34b admin admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:02:06.153969 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db2bf67-6e4a-4b77-bff7-f9a2667ba34b admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:02:06.153969 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db2bf67-6e4a-4b77-bff7-f9a2667ba34b admin admin] PATH_INFO: `/v3/projects/5aaaa1657b8f45fe8876edc3a56ad3e6/users/67c7db81e8b64aa19462bec11efaf533/roles/6ad17b9f9dea4b66ab2da3677d7e715d` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:02:06.167887 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db2bf67-6e4a-4b77-bff7-f9a2667ba34b admin admin] RBAC: Authorizing `identity:create_grant(project_id=5aaaa1657b8f45fe8876edc3a56ad3e6, user_id=67c7db81e8b64aa19462bec11efaf533, role_id=6ad17b9f9dea4b66ab2da3677d7e715d)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:02:06.170603 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db2bf67-6e4a-4b77-bff7-f9a2667ba34b admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:02:06.313355 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1096/2188] 10.222.0.65 () {60 vars in 1483 bytes} [Thu Oct 27 10:02:06 2022] PUT /identity/v3/projects/5aaaa1657b8f45fe8876edc3a56ad3e6/users/67c7db81e8b64aa19462bec11efaf533/roles/6ad17b9f9dea4b66ab2da3677d7e715d => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 10:02:06.317844 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a3a46b-9a43-40ff-967a-2d501c4d8afd admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:02:06.329080 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a3a46b-9a43-40ff-967a-2d501c4d8afd admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:02:06.393189 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804f49e1-bda4-474e-9aee-f8e80252d982 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:02:06.393977 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804f49e1-bda4-474e-9aee-f8e80252d982 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:02:06.394330 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804f49e1-bda4-474e-9aee-f8e80252d982 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:02:06.394887 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804f49e1-bda4-474e-9aee-f8e80252d982 admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:02:06.395669 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804f49e1-bda4-474e-9aee-f8e80252d982 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:02:06.406454 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804f49e1-bda4-474e-9aee-f8e80252d982 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:02:06.412664 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1093/2189] 10.222.0.65 () {58 vars in 1122 bytes} [Thu Oct 27 10:02:06 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 10:02:06.414163 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db2bf67-6e4a-4b77-bff7-f9a2667ba34b admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:02:06.425258 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db2bf67-6e4a-4b77-bff7-f9a2667ba34b admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:02:06.432026 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45b5f93-a4cc-4768-9acb-6dd10e367fb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:02:06.432691 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45b5f93-a4cc-4768-9acb-6dd10e367fb4 admin admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:02:06.432976 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45b5f93-a4cc-4768-9acb-6dd10e367fb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:02:06.433256 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45b5f93-a4cc-4768-9acb-6dd10e367fb4 admin admin] PATH_INFO: `/v3/projects/5aaaa1657b8f45fe8876edc3a56ad3e6/users/67c7db81e8b64aa19462bec11efaf533/roles/6ad17b9f9dea4b66ab2da3677d7e715d` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:02:06.435388 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45b5f93-a4cc-4768-9acb-6dd10e367fb4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5aaaa1657b8f45fe8876edc3a56ad3e6, user_id=67c7db81e8b64aa19462bec11efaf533, role_id=6ad17b9f9dea4b66ab2da3677d7e715d)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:02:06.438635 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45b5f93-a4cc-4768-9acb-6dd10e367fb4 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:02:06.451271 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1097/2190] 10.222.0.65 () {60 vars in 1483 bytes} [Thu Oct 27 10:02:06 2022] PUT /identity/v3/projects/5aaaa1657b8f45fe8876edc3a56ad3e6/users/67c7db81e8b64aa19462bec11efaf533/roles/6ad17b9f9dea4b66ab2da3677d7e715d => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 10:02:06.463897 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61efc16f-fc1d-4b2e-9522-8ba743ccd011 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:02:06.464187 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61efc16f-fc1d-4b2e-9522-8ba743ccd011 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:02:06.464461 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61efc16f-fc1d-4b2e-9522-8ba743ccd011 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:02:06.491730 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:02:06.496030 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-61efc16f-fc1d-4b2e-9522-8ba743ccd011 None None] MFA Rules not processed for user `67c7db81e8b64aa19462bec11efaf533`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 10:02:06.497345 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-61efc16f-fc1d-4b2e-9522-8ba743ccd011 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 10:02:06.571171 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1094/2191] 10.222.0.65 () {58 vars in 958 bytes} [Thu Oct 27 10:02:06 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 10:02:06.582859 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45b5f93-a4cc-4768-9acb-6dd10e367fb4 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:02:06.585326 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-a45b5f93-a4cc-4768-9acb-6dd10e367fb4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 10:02:06.655889 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45b5f93-a4cc-4768-9acb-6dd10e367fb4 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:02:06.659795 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8157b1db-c369-4379-830e-6bdc59e303f8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8e5d5f04c4741bb86ca4a0f667d4ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc2e3a7a1bcc480891c0b433291c00b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:02:06.660493 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8157b1db-c369-4379-830e-6bdc59e303f8 service cinder] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:02:06.660840 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8157b1db-c369-4379-830e-6bdc59e303f8 service cinder] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:02:06.661192 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8157b1db-c369-4379-830e-6bdc59e303f8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:02:06.671893 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8157b1db-c369-4379-830e-6bdc59e303f8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:02:06.673348 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8157b1db-c369-4379-830e-6bdc59e303f8 service cinder] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:02:06.683511 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1098/2192] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Oct 27 10:02:06 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 10:02:06.945031 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61efc16f-fc1d-4b2e-9522-8ba743ccd011 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:02:06.958816 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61efc16f-fc1d-4b2e-9522-8ba743ccd011 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:02:06.962957 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826a0d80-669a-465b-a938-d5cadf3fb567 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8e5d5f04c4741bb86ca4a0f667d4ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc2e3a7a1bcc480891c0b433291c00b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:02:06.970884 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826a0d80-669a-465b-a938-d5cadf3fb567 service cinder] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:02:06.970884 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826a0d80-669a-465b-a938-d5cadf3fb567 service cinder] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:02:06.970884 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826a0d80-669a-465b-a938-d5cadf3fb567 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:02:07.026368 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826a0d80-669a-465b-a938-d5cadf3fb567 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:02:07.027872 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826a0d80-669a-465b-a938-d5cadf3fb567 service cinder] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:02:07.038400 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1095/2193] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Oct 27 10:02:06 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 10:02:08.500395 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8157b1db-c369-4379-830e-6bdc59e303f8 service cinder] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:02:08.504858 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-8157b1db-c369-4379-830e-6bdc59e303f8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 10:02:08.579421 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8157b1db-c369-4379-830e-6bdc59e303f8 service cinder] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:02:08.587046 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06f5315-542a-48be-9352-5a8fb303145a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:02:08.587815 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06f5315-542a-48be-9352-5a8fb303145a admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:02:08.588165 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06f5315-542a-48be-9352-5a8fb303145a admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:02:08.588515 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06f5315-542a-48be-9352-5a8fb303145a admin admin] PATH_INFO: `/v3/users/44163ca1c6df4b4ea6c847c0a94bb08e` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:02:08.589770 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06f5315-542a-48be-9352-5a8fb303145a admin admin] RBAC: Authorizing `identity:delete_user(user_id=44163ca1c6df4b4ea6c847c0a94bb08e)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:02:08.591890 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06f5315-542a-48be-9352-5a8fb303145a admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:02:08.818271 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-d06f5315-542a-48be-9352-5a8fb303145a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '44163ca1c6df4b4ea6c847c0a94bb08e'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:02:08.828349 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:INSERT=5,keystone:SELECT=87,keystone:DELETE=8 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:02:08.835602 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-d06f5315-542a-48be-9352-5a8fb303145a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '44163ca1c6df4b4ea6c847c0a94bb08e'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:02:08.836569 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-d06f5315-542a-48be-9352-5a8fb303145a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '44163ca1c6df4b4ea6c847c0a94bb08e'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:02:08.844770 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-d06f5315-542a-48be-9352-5a8fb303145a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '44163ca1c6df4b4ea6c847c0a94bb08e'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:02:08.930798 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-d06f5315-542a-48be-9352-5a8fb303145a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '44163ca1c6df4b4ea6c847c0a94bb08e'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:02:08.937117 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1099/2194] 10.222.0.65 () {58 vars in 1224 bytes} [Thu Oct 27 10:02:08 2022] DELETE /identity/v3/users/44163ca1c6df4b4ea6c847c0a94bb08e => generated 0 bytes in 437 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 10:02:08.941651 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f4ae19-3fac-40dd-9d64-853ab0e757d7 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:02:08.942151 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f4ae19-3fac-40dd-9d64-853ab0e757d7 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:02:08.942265 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f4ae19-3fac-40dd-9d64-853ab0e757d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:02:08.963725 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-d2f4ae19-3fac-40dd-9d64-853ab0e757d7 None None] MFA Rules not processed for user `b5065084bf664b99bdeac46067cb0f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 10:02:08.965182 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-d2f4ae19-3fac-40dd-9d64-853ab0e757d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 10:02:09.042718 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1096/2195] 10.222.0.65 () {58 vars in 958 bytes} [Thu Oct 27 10:02:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 10:02:09.047058 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06f5315-542a-48be-9352-5a8fb303145a admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:02:09.049167 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-d06f5315-542a-48be-9352-5a8fb303145a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 10:02:09.117136 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06f5315-542a-48be-9352-5a8fb303145a admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:02:09.121083 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fec585d-52f4-4946-bb8e-1eef7bd474af service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6191cc41efa74f46b49022cf387f7a4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc2e3a7a1bcc480891c0b433291c00b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:02:09.121696 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fec585d-52f4-4946-bb8e-1eef7bd474af service neutron] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:02:09.121978 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fec585d-52f4-4946-bb8e-1eef7bd474af service neutron] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:02:09.122256 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fec585d-52f4-4946-bb8e-1eef7bd474af service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:02:09.132493 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fec585d-52f4-4946-bb8e-1eef7bd474af service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:02:09.134004 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fec585d-52f4-4946-bb8e-1eef7bd474af service neutron] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:02:09.145070 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1100/2196] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Oct 27 10:02:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 10:02:09.583697 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f4ae19-3fac-40dd-9d64-853ab0e757d7 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:02:09.586041 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-d2f4ae19-3fac-40dd-9d64-853ab0e757d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 10:02:09.603246 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f4ae19-3fac-40dd-9d64-853ab0e757d7 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:02:09.607901 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6593e772-7344-405a-ad62-fa08359f4df0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:02:09.608653 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6593e772-7344-405a-ad62-fa08359f4df0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:02:09.609002 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6593e772-7344-405a-ad62-fa08359f4df0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:02:09.609350 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6593e772-7344-405a-ad62-fa08359f4df0 admin admin] PATH_INFO: `/v3/projects/972212d39442414192c1d1d989ea2ee3` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:02:09.610778 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6593e772-7344-405a-ad62-fa08359f4df0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=972212d39442414192c1d1d989ea2ee3)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:02:09.612824 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6593e772-7344-405a-ad62-fa08359f4df0 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:02:09.717533 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:02:09.729817 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-6593e772-7344-405a-ad62-fa08359f4df0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '972212d39442414192c1d1d989ea2ee3', 'request_id': 'req-6593e772-7344-405a-ad62-fa08359f4df0'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:02:09.736219 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-6593e772-7344-405a-ad62-fa08359f4df0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '972212d39442414192c1d1d989ea2ee3', 'request_id': 'req-6593e772-7344-405a-ad62-fa08359f4df0'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:02:09.855484 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-6593e772-7344-405a-ad62-fa08359f4df0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '972212d39442414192c1d1d989ea2ee3', 'request_id': 'req-6593e772-7344-405a-ad62-fa08359f4df0'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:02:09.868114 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-6593e772-7344-405a-ad62-fa08359f4df0 admin admin] The token cache is being invalidate because project 972212d39442414192c1d1d989ea2ee3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 10:02:09.868405 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-6593e772-7344-405a-ad62-fa08359f4df0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:02:09.869048 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-6593e772-7344-405a-ad62-fa08359f4df0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:02:09.870590 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1097/2197] 10.222.0.65 () {58 vars in 1233 bytes} [Thu Oct 27 10:02:09 2022] DELETE /identity/v3/projects/972212d39442414192c1d1d989ea2ee3 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 10:02:09.875425 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ba23ff-7b66-41e5-a01e-ea229cc94083 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:02:09.875900 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ba23ff-7b66-41e5-a01e-ea229cc94083 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:02:09.876035 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ba23ff-7b66-41e5-a01e-ea229cc94083 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:02:09.895944 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-93ba23ff-7b66-41e5-a01e-ea229cc94083 None None] MFA Rules not processed for user `b5065084bf664b99bdeac46067cb0f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 10:02:09.897286 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-93ba23ff-7b66-41e5-a01e-ea229cc94083 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 10:02:09.958426 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1101/2198] 10.222.0.65 () {58 vars in 958 bytes} [Thu Oct 27 10:02:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 10:02:09.966642 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213d13a9-0104-4161-9759-6035a73c7e32 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:02:09.967147 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213d13a9-0104-4161-9759-6035a73c7e32 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:02:09.967263 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213d13a9-0104-4161-9759-6035a73c7e32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:02:09.988867 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-213d13a9-0104-4161-9759-6035a73c7e32 None None] MFA Rules not processed for user `b5065084bf664b99bdeac46067cb0f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 10:02:09.990098 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-213d13a9-0104-4161-9759-6035a73c7e32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 10:02:10.000716 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1098/2199] 10.222.0.65 () {58 vars in 958 bytes} [Thu Oct 27 10:02:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 10:02:10.005063 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ba23ff-7b66-41e5-a01e-ea229cc94083 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:02:10.014884 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ba23ff-7b66-41e5-a01e-ea229cc94083 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:02:10.019404 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf2ea67-3b91-420d-8596-c5bf53e0ad3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:02:10.019998 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf2ea67-3b91-420d-8596-c5bf53e0ad3f admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:02:10.020277 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf2ea67-3b91-420d-8596-c5bf53e0ad3f admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:02:10.020552 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf2ea67-3b91-420d-8596-c5bf53e0ad3f admin admin] PATH_INFO: `/v3/domains` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:02:10.021192 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf2ea67-3b91-420d-8596-c5bf53e0ad3f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 10:02:10.021492 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf2ea67-3b91-420d-8596-c5bf53e0ad3f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:02:10.023172 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf2ea67-3b91-420d-8596-c5bf53e0ad3f admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:02:10.034813 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1102/2200] 10.222.0.65 () {58 vars in 1153 bytes} [Thu Oct 27 10:02:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 10:02:10.039929 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213d13a9-0104-4161-9759-6035a73c7e32 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:02:10.049532 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213d13a9-0104-4161-9759-6035a73c7e32 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:02:10.055467 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922fd077-5f31-4eb8-a315-ebf64a73ae2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:02:10.056064 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922fd077-5f31-4eb8-a315-ebf64a73ae2a admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:02:10.056461 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922fd077-5f31-4eb8-a315-ebf64a73ae2a admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:02:10.056744 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922fd077-5f31-4eb8-a315-ebf64a73ae2a admin admin] PATH_INFO: `/v3/projects` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:02:10.057375 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922fd077-5f31-4eb8-a315-ebf64a73ae2a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:02:10.059444 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922fd077-5f31-4eb8-a315-ebf64a73ae2a admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:02:10.132439 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1099/2201] 10.222.0.65 () {60 vars in 1153 bytes} [Thu Oct 27 10:02:10 2022] POST /identity/v3/projects => generated 361 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 10:02:10.139619 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf2ea67-3b91-420d-8596-c5bf53e0ad3f admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:02:10.147379 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf2ea67-3b91-420d-8596-c5bf53e0ad3f admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:02:10.206361 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba654c2d-705f-4418-a396-22b6080fcfd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:02:10.206999 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba654c2d-705f-4418-a396-22b6080fcfd3 admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:02:10.207276 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba654c2d-705f-4418-a396-22b6080fcfd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:02:10.207562 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba654c2d-705f-4418-a396-22b6080fcfd3 admin admin] PATH_INFO: `/v3/users` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:02:10.208205 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba654c2d-705f-4418-a396-22b6080fcfd3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:02:10.211060 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba654c2d-705f-4418-a396-22b6080fcfd3 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:02:10.221021 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:02:10.318225 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1103/2202] 10.222.0.65 () {60 vars in 1144 bytes} [Thu Oct 27 10:02:10 2022] POST /identity/v3/users => generated 281 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 10:02:10.325056 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922fd077-5f31-4eb8-a315-ebf64a73ae2a admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:02:10.336768 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922fd077-5f31-4eb8-a315-ebf64a73ae2a admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:02:10.345095 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3101ff-e0be-433e-baaa-62a22041f90b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:02:10.345763 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3101ff-e0be-433e-baaa-62a22041f90b admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:02:10.346040 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3101ff-e0be-433e-baaa-62a22041f90b admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:02:10.355458 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3101ff-e0be-433e-baaa-62a22041f90b admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:02:10.355458 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3101ff-e0be-433e-baaa-62a22041f90b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:02:10.355458 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3101ff-e0be-433e-baaa-62a22041f90b admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:02:10.362900 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1100/2203] 10.222.0.65 () {58 vars in 1122 bytes} [Thu Oct 27 10:02:10 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 10:02:10.364019 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba654c2d-705f-4418-a396-22b6080fcfd3 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:02:10.375081 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba654c2d-705f-4418-a396-22b6080fcfd3 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:02:10.379772 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4ec777-f09a-4363-9f46-c836355eb579 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:02:10.384314 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4ec777-f09a-4363-9f46-c836355eb579 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:02:10.384314 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4ec777-f09a-4363-9f46-c836355eb579 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:02:10.384314 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4ec777-f09a-4363-9f46-c836355eb579 admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:02:10.384314 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4ec777-f09a-4363-9f46-c836355eb579 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:02:10.384314 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4ec777-f09a-4363-9f46-c836355eb579 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:02:10.398933 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1104/2204] 10.222.0.65 () {58 vars in 1122 bytes} [Thu Oct 27 10:02:10 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 10:02:10.400109 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3101ff-e0be-433e-baaa-62a22041f90b admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:02:10.410437 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3101ff-e0be-433e-baaa-62a22041f90b admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:02:10.416312 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe344fe-b5f9-4f26-86b5-2c2cec9cffe4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:02:10.416962 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe344fe-b5f9-4f26-86b5-2c2cec9cffe4 admin admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:02:10.417242 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe344fe-b5f9-4f26-86b5-2c2cec9cffe4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:02:10.417517 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe344fe-b5f9-4f26-86b5-2c2cec9cffe4 admin admin] PATH_INFO: `/v3/projects/c4dcfff5c7d646c0ae0ce0a5d7e20702/users/b323a71c41694a75bfa9baa92aecea94/roles/43543ce1450245af9661cb017bac17bd` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:02:10.432957 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe344fe-b5f9-4f26-86b5-2c2cec9cffe4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c4dcfff5c7d646c0ae0ce0a5d7e20702, user_id=b323a71c41694a75bfa9baa92aecea94, role_id=43543ce1450245af9661cb017bac17bd)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:02:10.441848 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe344fe-b5f9-4f26-86b5-2c2cec9cffe4 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:02:10.548145 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1101/2205] 10.222.0.65 () {60 vars in 1483 bytes} [Thu Oct 27 10:02:10 2022] PUT /identity/v3/projects/c4dcfff5c7d646c0ae0ce0a5d7e20702/users/b323a71c41694a75bfa9baa92aecea94/roles/43543ce1450245af9661cb017bac17bd => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 10:02:10.558874 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44722bca-6f88-4b98-ad0b-3a74c6a86eb2 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:02:10.559146 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44722bca-6f88-4b98-ad0b-3a74c6a86eb2 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:02:10.559444 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44722bca-6f88-4b98-ad0b-3a74c6a86eb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:02:10.590579 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-44722bca-6f88-4b98-ad0b-3a74c6a86eb2 None None] MFA Rules not processed for user `b323a71c41694a75bfa9baa92aecea94`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 10:02:10.591909 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-44722bca-6f88-4b98-ad0b-3a74c6a86eb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 10:02:10.659442 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1105/2206] 10.222.0.65 () {58 vars in 958 bytes} [Thu Oct 27 10:02:10 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 10:02:10.664222 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe344fe-b5f9-4f26-86b5-2c2cec9cffe4 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:02:10.732923 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe344fe-b5f9-4f26-86b5-2c2cec9cffe4 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:02:10.737937 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7f0058-0f92-46c8-9169-488ff927f83f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:02:10.738562 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7f0058-0f92-46c8-9169-488ff927f83f admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:02:10.738851 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7f0058-0f92-46c8-9169-488ff927f83f admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:02:10.739154 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7f0058-0f92-46c8-9169-488ff927f83f admin admin] PATH_INFO: `/v3/projects` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:02:10.739841 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7f0058-0f92-46c8-9169-488ff927f83f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:02:10.742440 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7f0058-0f92-46c8-9169-488ff927f83f admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:02:10.878495 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1102/2207] 10.222.0.65 () {60 vars in 1153 bytes} [Thu Oct 27 10:02:10 2022] POST /identity/v3/projects => generated 363 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 10:02:10.879783 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44722bca-6f88-4b98-ad0b-3a74c6a86eb2 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:02:10.891340 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44722bca-6f88-4b98-ad0b-3a74c6a86eb2 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:02:10.952064 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8039a4-b46c-4409-85d5-753519c3d293 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:02:10.952683 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8039a4-b46c-4409-85d5-753519c3d293 admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:02:10.952965 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8039a4-b46c-4409-85d5-753519c3d293 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:02:10.953248 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8039a4-b46c-4409-85d5-753519c3d293 admin admin] PATH_INFO: `/v3/users` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:02:10.953884 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8039a4-b46c-4409-85d5-753519c3d293 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:02:10.956182 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8039a4-b46c-4409-85d5-753519c3d293 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:02:11.052731 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1106/2208] 10.222.0.65 () {60 vars in 1144 bytes} [Thu Oct 27 10:02:10 2022] POST /identity/v3/users => generated 288 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 10:02:11.054419 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7f0058-0f92-46c8-9169-488ff927f83f admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:02:11.065107 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7f0058-0f92-46c8-9169-488ff927f83f admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:02:11.070398 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f3dc23-cfe0-49b6-95fd-e221e8b05fad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:02:11.071160 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f3dc23-cfe0-49b6-95fd-e221e8b05fad admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:02:11.071387 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f3dc23-cfe0-49b6-95fd-e221e8b05fad admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:02:11.071665 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f3dc23-cfe0-49b6-95fd-e221e8b05fad admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:02:11.072304 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f3dc23-cfe0-49b6-95fd-e221e8b05fad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:02:11.074092 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f3dc23-cfe0-49b6-95fd-e221e8b05fad admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:02:11.085872 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1103/2209] 10.222.0.65 () {58 vars in 1122 bytes} [Thu Oct 27 10:02:11 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 10:02:11.090139 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8039a4-b46c-4409-85d5-753519c3d293 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:02:11.101796 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8039a4-b46c-4409-85d5-753519c3d293 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:02:11.106608 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d15ca9b-7ced-4edc-90ce-fa761165bbf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:02:11.108045 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d15ca9b-7ced-4edc-90ce-fa761165bbf0 admin admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:02:11.108045 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d15ca9b-7ced-4edc-90ce-fa761165bbf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:02:11.108045 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d15ca9b-7ced-4edc-90ce-fa761165bbf0 admin admin] PATH_INFO: `/v3/projects/8701251a6a154488a436faa9b12e3af5/users/38c9c2e88c384335aba8a99a041c664a/roles/6ad17b9f9dea4b66ab2da3677d7e715d` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:02:11.123912 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d15ca9b-7ced-4edc-90ce-fa761165bbf0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8701251a6a154488a436faa9b12e3af5, user_id=38c9c2e88c384335aba8a99a041c664a, role_id=6ad17b9f9dea4b66ab2da3677d7e715d)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:02:11.126696 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d15ca9b-7ced-4edc-90ce-fa761165bbf0 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:02:11.198821 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1107/2210] 10.222.0.65 () {60 vars in 1483 bytes} [Thu Oct 27 10:02:11 2022] PUT /identity/v3/projects/8701251a6a154488a436faa9b12e3af5/users/38c9c2e88c384335aba8a99a041c664a/roles/6ad17b9f9dea4b66ab2da3677d7e715d => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 10:02:11.202861 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f3dc23-cfe0-49b6-95fd-e221e8b05fad admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:02:11.214842 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f3dc23-cfe0-49b6-95fd-e221e8b05fad admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:02:11.243943 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:02:11.270924 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa1a251-96e9-4a25-afda-f1f17d70c050 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:02:11.271527 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa1a251-96e9-4a25-afda-f1f17d70c050 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:02:11.272300 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa1a251-96e9-4a25-afda-f1f17d70c050 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:02:11.272570 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa1a251-96e9-4a25-afda-f1f17d70c050 admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:02:11.273203 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa1a251-96e9-4a25-afda-f1f17d70c050 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:02:11.274810 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa1a251-96e9-4a25-afda-f1f17d70c050 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:02:11.284812 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1104/2211] 10.222.0.65 () {58 vars in 1122 bytes} [Thu Oct 27 10:02:11 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 10:02:11.289635 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d15ca9b-7ced-4edc-90ce-fa761165bbf0 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:02:11.301136 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d15ca9b-7ced-4edc-90ce-fa761165bbf0 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:02:11.306111 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee473686-9579-4983-a07e-ea809861b6ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:02:11.306808 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee473686-9579-4983-a07e-ea809861b6ee admin admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:02:11.307090 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee473686-9579-4983-a07e-ea809861b6ee admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:02:11.307368 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee473686-9579-4983-a07e-ea809861b6ee admin admin] PATH_INFO: `/v3/projects/8701251a6a154488a436faa9b12e3af5/users/38c9c2e88c384335aba8a99a041c664a/roles/6ad17b9f9dea4b66ab2da3677d7e715d` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:02:11.309306 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee473686-9579-4983-a07e-ea809861b6ee admin admin] RBAC: Authorizing `identity:create_grant(project_id=8701251a6a154488a436faa9b12e3af5, user_id=38c9c2e88c384335aba8a99a041c664a, role_id=6ad17b9f9dea4b66ab2da3677d7e715d)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:02:11.312032 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee473686-9579-4983-a07e-ea809861b6ee admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:02:11.323258 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1108/2212] 10.222.0.65 () {60 vars in 1483 bytes} [Thu Oct 27 10:02:11 2022] PUT /identity/v3/projects/8701251a6a154488a436faa9b12e3af5/users/38c9c2e88c384335aba8a99a041c664a/roles/6ad17b9f9dea4b66ab2da3677d7e715d => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 10:02:11.333960 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badc5dfc-48b3-47e1-84cd-38e68a4faf70 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:02:11.335132 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badc5dfc-48b3-47e1-84cd-38e68a4faf70 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:02:11.335409 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badc5dfc-48b3-47e1-84cd-38e68a4faf70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:02:11.364946 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-badc5dfc-48b3-47e1-84cd-38e68a4faf70 None None] MFA Rules not processed for user `38c9c2e88c384335aba8a99a041c664a`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 10:02:11.366930 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-badc5dfc-48b3-47e1-84cd-38e68a4faf70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 10:02:11.440273 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1105/2213] 10.222.0.65 () {58 vars in 958 bytes} [Thu Oct 27 10:02:11 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 10:02:11.452947 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee473686-9579-4983-a07e-ea809861b6ee admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:02:11.454787 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-ee473686-9579-4983-a07e-ea809861b6ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 10:02:11.484371 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:INSERT=6,keystone:SELECT=94 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:02:11.515431 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee473686-9579-4983-a07e-ea809861b6ee admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:02:11.519170 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed0bfcf-0e9e-4633-8e5a-fc38e8715990 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8e5d5f04c4741bb86ca4a0f667d4ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc2e3a7a1bcc480891c0b433291c00b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:02:11.519779 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed0bfcf-0e9e-4633-8e5a-fc38e8715990 service cinder] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:02:11.520065 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed0bfcf-0e9e-4633-8e5a-fc38e8715990 service cinder] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:02:11.520344 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed0bfcf-0e9e-4633-8e5a-fc38e8715990 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:02:11.530470 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed0bfcf-0e9e-4633-8e5a-fc38e8715990 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:02:11.531953 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed0bfcf-0e9e-4633-8e5a-fc38e8715990 service cinder] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:02:11.541671 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1109/2214] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Oct 27 10:02:11 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 10:02:11.766313 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badc5dfc-48b3-47e1-84cd-38e68a4faf70 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:02:11.776571 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badc5dfc-48b3-47e1-84cd-38e68a4faf70 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:02:11.780185 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68d4624-ef66-4e1a-8cf0-c066777bdf04 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8e5d5f04c4741bb86ca4a0f667d4ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc2e3a7a1bcc480891c0b433291c00b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:02:11.780801 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68d4624-ef66-4e1a-8cf0-c066777bdf04 service cinder] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:02:11.781084 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68d4624-ef66-4e1a-8cf0-c066777bdf04 service cinder] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:02:11.781361 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68d4624-ef66-4e1a-8cf0-c066777bdf04 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:02:11.838257 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68d4624-ef66-4e1a-8cf0-c066777bdf04 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:02:11.839729 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68d4624-ef66-4e1a-8cf0-c066777bdf04 service cinder] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:02:11.849126 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1106/2215] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Oct 27 10:02:11 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 10:02:20.720225 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed0bfcf-0e9e-4633-8e5a-fc38e8715990 service cinder] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:02:20.790403 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed0bfcf-0e9e-4633-8e5a-fc38e8715990 service cinder] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:02:20.795014 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2301606e-0dc6-4830-8099-a91541b00823 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:02:20.795623 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2301606e-0dc6-4830-8099-a91541b00823 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:02:20.795903 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2301606e-0dc6-4830-8099-a91541b00823 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:02:20.796195 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2301606e-0dc6-4830-8099-a91541b00823 admin admin] PATH_INFO: `/v3/users/b323a71c41694a75bfa9baa92aecea94` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:02:20.797430 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2301606e-0dc6-4830-8099-a91541b00823 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b323a71c41694a75bfa9baa92aecea94)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:02:20.799424 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2301606e-0dc6-4830-8099-a91541b00823 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:02:21.006287 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-2301606e-0dc6-4830-8099-a91541b00823 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b323a71c41694a75bfa9baa92aecea94'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:02:21.019156 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-2301606e-0dc6-4830-8099-a91541b00823 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b323a71c41694a75bfa9baa92aecea94'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:02:21.019876 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-2301606e-0dc6-4830-8099-a91541b00823 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b323a71c41694a75bfa9baa92aecea94'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:02:21.026856 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-2301606e-0dc6-4830-8099-a91541b00823 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b323a71c41694a75bfa9baa92aecea94'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:02:21.089481 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-2301606e-0dc6-4830-8099-a91541b00823 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b323a71c41694a75bfa9baa92aecea94'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:02:21.095776 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1110/2216] 10.222.0.65 () {58 vars in 1224 bytes} [Thu Oct 27 10:02:20 2022] DELETE /identity/v3/users/b323a71c41694a75bfa9baa92aecea94 => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 10:02:21.100384 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f0e865-13f8-4530-89d5-ad5ba7997458 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:02:21.100956 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f0e865-13f8-4530-89d5-ad5ba7997458 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:02:21.100956 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f0e865-13f8-4530-89d5-ad5ba7997458 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:02:21.124116 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-f7f0e865-13f8-4530-89d5-ad5ba7997458 None None] MFA Rules not processed for user `b5065084bf664b99bdeac46067cb0f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 10:02:21.130967 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-f7f0e865-13f8-4530-89d5-ad5ba7997458 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 10:02:21.172414 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:02:21.188640 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1107/2217] 10.222.0.65 () {58 vars in 958 bytes} [Thu Oct 27 10:02:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 10:02:21.198766 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2301606e-0dc6-4830-8099-a91541b00823 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:02:21.200443 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-2301606e-0dc6-4830-8099-a91541b00823 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 10:02:21.257244 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:02:21.263264 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2301606e-0dc6-4830-8099-a91541b00823 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:02:21.267055 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736d727b-7369-4eb9-8a76-cc1a4567ff8d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6191cc41efa74f46b49022cf387f7a4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc2e3a7a1bcc480891c0b433291c00b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:02:21.267693 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736d727b-7369-4eb9-8a76-cc1a4567ff8d service neutron] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:02:21.267976 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736d727b-7369-4eb9-8a76-cc1a4567ff8d service neutron] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:02:21.268253 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736d727b-7369-4eb9-8a76-cc1a4567ff8d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:02:21.277545 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736d727b-7369-4eb9-8a76-cc1a4567ff8d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:02:21.279004 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736d727b-7369-4eb9-8a76-cc1a4567ff8d service neutron] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:02:21.288792 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1111/2218] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Oct 27 10:02:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 10:02:21.742576 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f0e865-13f8-4530-89d5-ad5ba7997458 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:02:21.744083 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-f7f0e865-13f8-4530-89d5-ad5ba7997458 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 10:02:21.760668 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f0e865-13f8-4530-89d5-ad5ba7997458 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:02:21.762563 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d234fc-7945-4caa-acff-95fd6634b62a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:02:21.763256 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d234fc-7945-4caa-acff-95fd6634b62a admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:02:21.763540 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d234fc-7945-4caa-acff-95fd6634b62a admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:02:21.763819 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d234fc-7945-4caa-acff-95fd6634b62a admin admin] PATH_INFO: `/v3/projects/c4dcfff5c7d646c0ae0ce0a5d7e20702` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:02:21.764978 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d234fc-7945-4caa-acff-95fd6634b62a admin admin] RBAC: Authorizing `identity:delete_project(project_id=c4dcfff5c7d646c0ae0ce0a5d7e20702)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:02:21.766986 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d234fc-7945-4caa-acff-95fd6634b62a admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:02:21.875763 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-35d234fc-7945-4caa-acff-95fd6634b62a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c4dcfff5c7d646c0ae0ce0a5d7e20702', 'request_id': 'req-35d234fc-7945-4caa-acff-95fd6634b62a'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:02:21.882691 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-35d234fc-7945-4caa-acff-95fd6634b62a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c4dcfff5c7d646c0ae0ce0a5d7e20702', 'request_id': 'req-35d234fc-7945-4caa-acff-95fd6634b62a'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:02:21.981321 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-35d234fc-7945-4caa-acff-95fd6634b62a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c4dcfff5c7d646c0ae0ce0a5d7e20702', 'request_id': 'req-35d234fc-7945-4caa-acff-95fd6634b62a'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:02:21.992765 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-35d234fc-7945-4caa-acff-95fd6634b62a admin admin] The token cache is being invalidate because project c4dcfff5c7d646c0ae0ce0a5d7e20702 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 10:02:21.993052 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-35d234fc-7945-4caa-acff-95fd6634b62a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:02:21.993695 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-35d234fc-7945-4caa-acff-95fd6634b62a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:02:21.996053 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1108/2219] 10.222.0.65 () {58 vars in 1233 bytes} [Thu Oct 27 10:02:21 2022] DELETE /identity/v3/projects/c4dcfff5c7d646c0ae0ce0a5d7e20702 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 10:02:22.000215 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736d727b-7369-4eb9-8a76-cc1a4567ff8d service neutron] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:02:22.010254 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736d727b-7369-4eb9-8a76-cc1a4567ff8d service neutron] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:02:22.074902 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cccc1fd-c7a7-492c-8d7d-cf075dfce8cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:02:22.075581 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cccc1fd-c7a7-492c-8d7d-cf075dfce8cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:02:22.076038 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cccc1fd-c7a7-492c-8d7d-cf075dfce8cd admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:02:22.076332 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cccc1fd-c7a7-492c-8d7d-cf075dfce8cd admin admin] PATH_INFO: `/v3/users/38c9c2e88c384335aba8a99a041c664a` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:02:22.077601 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cccc1fd-c7a7-492c-8d7d-cf075dfce8cd admin admin] RBAC: Authorizing `identity:delete_user(user_id=38c9c2e88c384335aba8a99a041c664a)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:02:22.079593 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cccc1fd-c7a7-492c-8d7d-cf075dfce8cd admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:02:22.285674 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-1cccc1fd-c7a7-492c-8d7d-cf075dfce8cd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '38c9c2e88c384335aba8a99a041c664a'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:02:22.298688 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-1cccc1fd-c7a7-492c-8d7d-cf075dfce8cd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '38c9c2e88c384335aba8a99a041c664a'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:02:22.299471 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-1cccc1fd-c7a7-492c-8d7d-cf075dfce8cd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '38c9c2e88c384335aba8a99a041c664a'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:02:22.306771 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-1cccc1fd-c7a7-492c-8d7d-cf075dfce8cd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '38c9c2e88c384335aba8a99a041c664a'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:02:22.391988 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-1cccc1fd-c7a7-492c-8d7d-cf075dfce8cd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '38c9c2e88c384335aba8a99a041c664a'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:02:22.398545 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1112/2220] 10.222.0.65 () {58 vars in 1224 bytes} [Thu Oct 27 10:02:21 2022] DELETE /identity/v3/users/38c9c2e88c384335aba8a99a041c664a => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 10:02:22.833424 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d234fc-7945-4caa-acff-95fd6634b62a admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:02:22.835186 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-35d234fc-7945-4caa-acff-95fd6634b62a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 10:02:22.851393 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d234fc-7945-4caa-acff-95fd6634b62a admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:02:22.918216 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bb83c3-48c2-4df3-a14b-6ecd597cad7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:02:22.918877 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bb83c3-48c2-4df3-a14b-6ecd597cad7a admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:02:22.919165 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bb83c3-48c2-4df3-a14b-6ecd597cad7a admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:02:22.919441 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bb83c3-48c2-4df3-a14b-6ecd597cad7a admin admin] PATH_INFO: `/v3/projects/8701251a6a154488a436faa9b12e3af5` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:02:22.920572 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4bb83c3-48c2-4df3-a14b-6ecd597cad7a admin admin] RBAC: Authorizing `identity:delete_project(project_id=8701251a6a154488a436faa9b12e3af5)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:02:22.922495 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4bb83c3-48c2-4df3-a14b-6ecd597cad7a admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:02:23.039641 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-c4bb83c3-48c2-4df3-a14b-6ecd597cad7a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8701251a6a154488a436faa9b12e3af5', 'request_id': 'req-c4bb83c3-48c2-4df3-a14b-6ecd597cad7a'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:02:23.046896 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-c4bb83c3-48c2-4df3-a14b-6ecd597cad7a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8701251a6a154488a436faa9b12e3af5', 'request_id': 'req-c4bb83c3-48c2-4df3-a14b-6ecd597cad7a'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:02:23.140913 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-c4bb83c3-48c2-4df3-a14b-6ecd597cad7a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8701251a6a154488a436faa9b12e3af5', 'request_id': 'req-c4bb83c3-48c2-4df3-a14b-6ecd597cad7a'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:02:23.153304 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-c4bb83c3-48c2-4df3-a14b-6ecd597cad7a admin admin] The token cache is being invalidate because project 8701251a6a154488a436faa9b12e3af5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 10:02:23.153587 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-c4bb83c3-48c2-4df3-a14b-6ecd597cad7a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:02:23.154231 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-c4bb83c3-48c2-4df3-a14b-6ecd597cad7a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:02:23.155729 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1109/2221] 10.222.0.65 () {58 vars in 1233 bytes} [Thu Oct 27 10:02:22 2022] DELETE /identity/v3/projects/8701251a6a154488a436faa9b12e3af5 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 10:02:23.161148 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf01140-1c91-4767-b424-c5154ce8947b None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:02:23.161630 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf01140-1c91-4767-b424-c5154ce8947b None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:02:23.161734 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf01140-1c91-4767-b424-c5154ce8947b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:02:23.183935 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-8bf01140-1c91-4767-b424-c5154ce8947b None None] MFA Rules not processed for user `b5065084bf664b99bdeac46067cb0f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 10:02:23.185203 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-8bf01140-1c91-4767-b424-c5154ce8947b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 10:02:23.254725 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1113/2222] 10.222.0.65 () {58 vars in 958 bytes} [Thu Oct 27 10:02:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 10:02:23.260955 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88363672-26a4-46a0-9c09-34e927067c5b None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:02:23.261247 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88363672-26a4-46a0-9c09-34e927067c5b None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:02:23.261516 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88363672-26a4-46a0-9c09-34e927067c5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:02:23.270384 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:02:23.282374 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-88363672-26a4-46a0-9c09-34e927067c5b None None] MFA Rules not processed for user `b5065084bf664b99bdeac46067cb0f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 10:02:23.283616 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-88363672-26a4-46a0-9c09-34e927067c5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 10:02:23.292838 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1110/2223] 10.222.0.65 () {58 vars in 958 bytes} [Thu Oct 27 10:02:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 10:02:23.296510 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf01140-1c91-4767-b424-c5154ce8947b None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:02:23.306224 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf01140-1c91-4767-b424-c5154ce8947b None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:02:23.312326 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600222eb-a622-4088-8819-b41cb57865e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:02:23.312326 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600222eb-a622-4088-8819-b41cb57865e6 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:02:23.312326 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600222eb-a622-4088-8819-b41cb57865e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:02:23.312672 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600222eb-a622-4088-8819-b41cb57865e6 admin admin] PATH_INFO: `/v3/domains` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:02:23.313105 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600222eb-a622-4088-8819-b41cb57865e6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 10:02:23.313407 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600222eb-a622-4088-8819-b41cb57865e6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:02:23.315038 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600222eb-a622-4088-8819-b41cb57865e6 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:02:23.317681 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:02:23.328427 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1114/2224] 10.222.0.65 () {58 vars in 1153 bytes} [Thu Oct 27 10:02:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 10:02:23.333639 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88363672-26a4-46a0-9c09-34e927067c5b None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:02:23.345026 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88363672-26a4-46a0-9c09-34e927067c5b None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:02:23.349827 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56bef73-f240-4df7-a986-c9455c6a5f6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:02:23.350404 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56bef73-f240-4df7-a986-c9455c6a5f6b admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:02:23.350713 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56bef73-f240-4df7-a986-c9455c6a5f6b admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:02:23.350984 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56bef73-f240-4df7-a986-c9455c6a5f6b admin admin] PATH_INFO: `/v3/projects` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:02:23.351629 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56bef73-f240-4df7-a986-c9455c6a5f6b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:02:23.353946 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56bef73-f240-4df7-a986-c9455c6a5f6b admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:02:23.488802 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1111/2225] 10.222.0.65 () {60 vars in 1153 bytes} [Thu Oct 27 10:02:23 2022] POST /identity/v3/projects => generated 367 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 10:02:23.493162 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600222eb-a622-4088-8819-b41cb57865e6 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:02:23.506940 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600222eb-a622-4088-8819-b41cb57865e6 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:02:23.569065 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2a6286-4edf-4a2a-b2fe-3953895c11c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:02:23.569762 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2a6286-4edf-4a2a-b2fe-3953895c11c1 admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:02:23.570053 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2a6286-4edf-4a2a-b2fe-3953895c11c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:02:23.570330 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2a6286-4edf-4a2a-b2fe-3953895c11c1 admin admin] PATH_INFO: `/v3/users` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:02:23.571004 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2a6286-4edf-4a2a-b2fe-3953895c11c1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:02:23.572982 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2a6286-4edf-4a2a-b2fe-3953895c11c1 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:02:23.675231 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1115/2226] 10.222.0.65 () {60 vars in 1144 bytes} [Thu Oct 27 10:02:23 2022] POST /identity/v3/users => generated 284 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 10:02:23.680078 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56bef73-f240-4df7-a986-c9455c6a5f6b admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:02:23.693555 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56bef73-f240-4df7-a986-c9455c6a5f6b admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:02:23.700093 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76000689-ddde-4368-81fc-880511f0e571 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:02:23.700911 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76000689-ddde-4368-81fc-880511f0e571 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:02:23.701343 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76000689-ddde-4368-81fc-880511f0e571 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:02:23.701663 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76000689-ddde-4368-81fc-880511f0e571 admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:02:23.702439 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76000689-ddde-4368-81fc-880511f0e571 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:02:23.705025 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76000689-ddde-4368-81fc-880511f0e571 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:02:23.718083 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1112/2227] 10.222.0.65 () {58 vars in 1122 bytes} [Thu Oct 27 10:02:23 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 10:02:23.722102 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2a6286-4edf-4a2a-b2fe-3953895c11c1 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:02:23.734221 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2a6286-4edf-4a2a-b2fe-3953895c11c1 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:02:23.739018 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48eb111b-e108-4345-90f9-469c3118c5db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:02:23.739800 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48eb111b-e108-4345-90f9-469c3118c5db admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:02:23.740095 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48eb111b-e108-4345-90f9-469c3118c5db admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:02:23.740368 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48eb111b-e108-4345-90f9-469c3118c5db admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:02:23.741039 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48eb111b-e108-4345-90f9-469c3118c5db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:02:23.742654 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48eb111b-e108-4345-90f9-469c3118c5db admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:02:23.754030 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1116/2228] 10.222.0.65 () {58 vars in 1122 bytes} [Thu Oct 27 10:02:23 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 10:02:23.759389 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76000689-ddde-4368-81fc-880511f0e571 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:02:23.771458 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76000689-ddde-4368-81fc-880511f0e571 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:02:23.776712 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab368b1-09fc-46af-9913-3a03f6c4f0e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:02:23.777381 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab368b1-09fc-46af-9913-3a03f6c4f0e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:02:23.777665 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab368b1-09fc-46af-9913-3a03f6c4f0e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:02:23.777944 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab368b1-09fc-46af-9913-3a03f6c4f0e9 admin admin] PATH_INFO: `/v3/projects/f5222d919ad74d828d6fb3f676f56a7f/users/635203591e554bfca93fb143147a1b1d/roles/43543ce1450245af9661cb017bac17bd` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:02:23.793789 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab368b1-09fc-46af-9913-3a03f6c4f0e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f5222d919ad74d828d6fb3f676f56a7f, user_id=635203591e554bfca93fb143147a1b1d, role_id=43543ce1450245af9661cb017bac17bd)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:02:23.796728 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab368b1-09fc-46af-9913-3a03f6c4f0e9 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:02:23.906760 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1113/2229] 10.222.0.65 () {60 vars in 1483 bytes} [Thu Oct 27 10:02:23 2022] PUT /identity/v3/projects/f5222d919ad74d828d6fb3f676f56a7f/users/635203591e554bfca93fb143147a1b1d/roles/43543ce1450245af9661cb017bac17bd => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 10:02:23.917310 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d757364a-39ea-42e4-b62d-17699fcd58d8 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:02:23.917601 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d757364a-39ea-42e4-b62d-17699fcd58d8 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:02:23.917848 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d757364a-39ea-42e4-b62d-17699fcd58d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:02:23.946693 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-d757364a-39ea-42e4-b62d-17699fcd58d8 None None] MFA Rules not processed for user `635203591e554bfca93fb143147a1b1d`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 10:02:23.948510 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-d757364a-39ea-42e4-b62d-17699fcd58d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 10:02:24.019906 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1117/2230] 10.222.0.65 () {58 vars in 958 bytes} [Thu Oct 27 10:02:23 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 10:02:24.024458 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab368b1-09fc-46af-9913-3a03f6c4f0e9 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:02:24.088364 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab368b1-09fc-46af-9913-3a03f6c4f0e9 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:02:24.094076 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe935916-03e4-4a9f-b84c-4db162e9e501 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:02:24.094717 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe935916-03e4-4a9f-b84c-4db162e9e501 admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:02:24.095003 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe935916-03e4-4a9f-b84c-4db162e9e501 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:02:24.095282 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe935916-03e4-4a9f-b84c-4db162e9e501 admin admin] PATH_INFO: `/v3/projects` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:02:24.095927 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe935916-03e4-4a9f-b84c-4db162e9e501 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:02:24.097898 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe935916-03e4-4a9f-b84c-4db162e9e501 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:02:24.200563 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1114/2231] 10.222.0.65 () {60 vars in 1153 bytes} [Thu Oct 27 10:02:24 2022] POST /identity/v3/projects => generated 367 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 10:02:24.204686 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d757364a-39ea-42e4-b62d-17699fcd58d8 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:02:24.216766 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d757364a-39ea-42e4-b62d-17699fcd58d8 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:02:24.275289 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4671ae-ad45-4763-9072-fd9353047593 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:02:24.275924 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4671ae-ad45-4763-9072-fd9353047593 admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:02:24.277096 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4671ae-ad45-4763-9072-fd9353047593 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:02:24.277517 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4671ae-ad45-4763-9072-fd9353047593 admin admin] PATH_INFO: `/v3/users` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:02:24.278157 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4671ae-ad45-4763-9072-fd9353047593 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:02:24.280121 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4671ae-ad45-4763-9072-fd9353047593 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:02:24.290207 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:02:24.395325 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1118/2232] 10.222.0.65 () {60 vars in 1144 bytes} [Thu Oct 27 10:02:24 2022] POST /identity/v3/users => generated 290 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 10:02:24.399764 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe935916-03e4-4a9f-b84c-4db162e9e501 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:02:24.410684 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe935916-03e4-4a9f-b84c-4db162e9e501 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:02:24.415545 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399172a3-00b0-43df-84d2-edffd4c50b79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:02:24.416159 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399172a3-00b0-43df-84d2-edffd4c50b79 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:02:24.416421 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399172a3-00b0-43df-84d2-edffd4c50b79 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:02:24.416767 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399172a3-00b0-43df-84d2-edffd4c50b79 admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:02:24.417599 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399172a3-00b0-43df-84d2-edffd4c50b79 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:02:24.419229 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399172a3-00b0-43df-84d2-edffd4c50b79 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:02:24.431189 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1115/2233] 10.222.0.65 () {58 vars in 1122 bytes} [Thu Oct 27 10:02:24 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 10:02:24.435941 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4671ae-ad45-4763-9072-fd9353047593 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:02:24.446766 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4671ae-ad45-4763-9072-fd9353047593 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:02:24.452238 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d2b22c-108a-4e34-b6d8-52307e03dfe5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:02:24.452835 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d2b22c-108a-4e34-b6d8-52307e03dfe5 admin admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:02:24.453114 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d2b22c-108a-4e34-b6d8-52307e03dfe5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:02:24.453414 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d2b22c-108a-4e34-b6d8-52307e03dfe5 admin admin] PATH_INFO: `/v3/projects/0bed0a22e0ac4e9b9e26b7c77f80c318/users/ad24c43bd9ed4c4d84ebdb6295641a14/roles/6ad17b9f9dea4b66ab2da3677d7e715d` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:02:24.468944 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d2b22c-108a-4e34-b6d8-52307e03dfe5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0bed0a22e0ac4e9b9e26b7c77f80c318, user_id=ad24c43bd9ed4c4d84ebdb6295641a14, role_id=6ad17b9f9dea4b66ab2da3677d7e715d)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:02:24.471687 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d2b22c-108a-4e34-b6d8-52307e03dfe5 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:02:24.592853 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1119/2234] 10.222.0.65 () {60 vars in 1483 bytes} [Thu Oct 27 10:02:24 2022] PUT /identity/v3/projects/0bed0a22e0ac4e9b9e26b7c77f80c318/users/ad24c43bd9ed4c4d84ebdb6295641a14/roles/6ad17b9f9dea4b66ab2da3677d7e715d => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 10:02:24.597032 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399172a3-00b0-43df-84d2-edffd4c50b79 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:02:24.607572 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399172a3-00b0-43df-84d2-edffd4c50b79 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:02:24.666643 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0603886-8f78-4b37-a323-374953ab5b4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:02:24.667417 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0603886-8f78-4b37-a323-374953ab5b4d admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:02:24.667558 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0603886-8f78-4b37-a323-374953ab5b4d admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:02:24.667831 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0603886-8f78-4b37-a323-374953ab5b4d admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:02:24.668466 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0603886-8f78-4b37-a323-374953ab5b4d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:02:24.670111 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0603886-8f78-4b37-a323-374953ab5b4d admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:02:24.680117 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1116/2235] 10.222.0.65 () {58 vars in 1122 bytes} [Thu Oct 27 10:02:24 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 10:02:24.685255 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d2b22c-108a-4e34-b6d8-52307e03dfe5 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:02:24.696192 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d2b22c-108a-4e34-b6d8-52307e03dfe5 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:02:24.701533 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b9d1e7-12ea-4925-8996-f228bb266e11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:02:24.702220 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b9d1e7-12ea-4925-8996-f228bb266e11 admin admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:02:24.702587 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b9d1e7-12ea-4925-8996-f228bb266e11 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:02:24.702809 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b9d1e7-12ea-4925-8996-f228bb266e11 admin admin] PATH_INFO: `/v3/projects/0bed0a22e0ac4e9b9e26b7c77f80c318/users/ad24c43bd9ed4c4d84ebdb6295641a14/roles/6ad17b9f9dea4b66ab2da3677d7e715d` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:02:24.704722 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b9d1e7-12ea-4925-8996-f228bb266e11 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0bed0a22e0ac4e9b9e26b7c77f80c318, user_id=ad24c43bd9ed4c4d84ebdb6295641a14, role_id=6ad17b9f9dea4b66ab2da3677d7e715d)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:02:24.707709 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b9d1e7-12ea-4925-8996-f228bb266e11 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:02:24.718552 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1120/2236] 10.222.0.65 () {60 vars in 1483 bytes} [Thu Oct 27 10:02:24 2022] PUT /identity/v3/projects/0bed0a22e0ac4e9b9e26b7c77f80c318/users/ad24c43bd9ed4c4d84ebdb6295641a14/roles/6ad17b9f9dea4b66ab2da3677d7e715d => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 10:02:24.729039 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1fef38-cb11-456a-8282-cc64833ce5fc None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:02:24.730000 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1fef38-cb11-456a-8282-cc64833ce5fc None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:02:24.730712 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1fef38-cb11-456a-8282-cc64833ce5fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:02:24.756784 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:02:24.766279 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-1e1fef38-cb11-456a-8282-cc64833ce5fc None None] MFA Rules not processed for user `ad24c43bd9ed4c4d84ebdb6295641a14`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 10:02:24.767870 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-1e1fef38-cb11-456a-8282-cc64833ce5fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 10:02:24.849836 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1117/2237] 10.222.0.65 () {58 vars in 958 bytes} [Thu Oct 27 10:02:24 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 10:02:24.865450 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b9d1e7-12ea-4925-8996-f228bb266e11 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:02:24.867220 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-f4b9d1e7-12ea-4925-8996-f228bb266e11 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 10:02:24.931765 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b9d1e7-12ea-4925-8996-f228bb266e11 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:02:24.936270 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab98c36-1c0e-4867-a752-324062489026 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8e5d5f04c4741bb86ca4a0f667d4ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc2e3a7a1bcc480891c0b433291c00b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:02:24.936890 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab98c36-1c0e-4867-a752-324062489026 service cinder] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:02:24.937178 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab98c36-1c0e-4867-a752-324062489026 service cinder] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:02:24.937457 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab98c36-1c0e-4867-a752-324062489026 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:02:24.947069 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab98c36-1c0e-4867-a752-324062489026 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:02:24.948703 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab98c36-1c0e-4867-a752-324062489026 service cinder] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:02:24.959252 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1121/2238] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Oct 27 10:02:24 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 10:02:25.072675 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1fef38-cb11-456a-8282-cc64833ce5fc None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:02:25.074379 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-1e1fef38-cb11-456a-8282-cc64833ce5fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 10:02:25.086648 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1fef38-cb11-456a-8282-cc64833ce5fc None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:02:25.091345 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17295a47-e2a4-4878-a75a-e6c6e0f91c0e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8e5d5f04c4741bb86ca4a0f667d4ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc2e3a7a1bcc480891c0b433291c00b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:02:25.091934 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17295a47-e2a4-4878-a75a-e6c6e0f91c0e service cinder] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:02:25.092210 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17295a47-e2a4-4878-a75a-e6c6e0f91c0e service cinder] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:02:25.092479 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17295a47-e2a4-4878-a75a-e6c6e0f91c0e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:02:25.152238 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17295a47-e2a4-4878-a75a-e6c6e0f91c0e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:02:25.153706 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17295a47-e2a4-4878-a75a-e6c6e0f91c0e service cinder] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:02:25.162609 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1118/2239] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Oct 27 10:02:25 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 10:02:26.362329 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab98c36-1c0e-4867-a752-324062489026 service cinder] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:02:26.364221 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-fab98c36-1c0e-4867-a752-324062489026 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 10:02:26.435858 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab98c36-1c0e-4867-a752-324062489026 service cinder] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:02:26.440614 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9691f604-8ea8-4a46-84df-fc31902ba2f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:02:26.441233 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9691f604-8ea8-4a46-84df-fc31902ba2f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:02:26.441512 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9691f604-8ea8-4a46-84df-fc31902ba2f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:02:26.441805 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9691f604-8ea8-4a46-84df-fc31902ba2f8 admin admin] PATH_INFO: `/v3/users/575b72087a5940888c26545d90b8249c` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:02:26.442947 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9691f604-8ea8-4a46-84df-fc31902ba2f8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=575b72087a5940888c26545d90b8249c)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:02:26.444943 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9691f604-8ea8-4a46-84df-fc31902ba2f8 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:02:26.647377 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-9691f604-8ea8-4a46-84df-fc31902ba2f8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '575b72087a5940888c26545d90b8249c'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:02:26.659200 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:INSERT=3,keystone:SELECT=89,keystone:DELETE=8 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:02:26.661538 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-9691f604-8ea8-4a46-84df-fc31902ba2f8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '575b72087a5940888c26545d90b8249c'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:02:26.662241 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-9691f604-8ea8-4a46-84df-fc31902ba2f8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '575b72087a5940888c26545d90b8249c'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:02:26.669894 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-9691f604-8ea8-4a46-84df-fc31902ba2f8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '575b72087a5940888c26545d90b8249c'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:02:26.752578 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-9691f604-8ea8-4a46-84df-fc31902ba2f8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '575b72087a5940888c26545d90b8249c'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:02:26.758927 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1122/2240] 10.222.0.65 () {58 vars in 1224 bytes} [Thu Oct 27 10:02:26 2022] DELETE /identity/v3/users/575b72087a5940888c26545d90b8249c => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 10:02:26.763758 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd7dbbf-9fe2-4746-a1d4-25fd2de85b86 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:02:26.764284 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd7dbbf-9fe2-4746-a1d4-25fd2de85b86 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:02:26.764574 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd7dbbf-9fe2-4746-a1d4-25fd2de85b86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:02:26.794068 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-2bd7dbbf-9fe2-4746-a1d4-25fd2de85b86 None None] MFA Rules not processed for user `b5065084bf664b99bdeac46067cb0f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 10:02:26.795401 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-2bd7dbbf-9fe2-4746-a1d4-25fd2de85b86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 10:02:26.863952 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1119/2241] 10.222.0.65 () {58 vars in 958 bytes} [Thu Oct 27 10:02:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 10:02:26.874146 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9691f604-8ea8-4a46-84df-fc31902ba2f8 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:02:26.875709 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-9691f604-8ea8-4a46-84df-fc31902ba2f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 10:02:26.938590 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9691f604-8ea8-4a46-84df-fc31902ba2f8 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:02:26.941260 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d5e29a-8e99-49fc-88d8-5a7f0cb5c06c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6191cc41efa74f46b49022cf387f7a4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc2e3a7a1bcc480891c0b433291c00b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:02:26.946170 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d5e29a-8e99-49fc-88d8-5a7f0cb5c06c service neutron] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:02:26.946170 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d5e29a-8e99-49fc-88d8-5a7f0cb5c06c service neutron] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:02:26.946170 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d5e29a-8e99-49fc-88d8-5a7f0cb5c06c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:02:26.954208 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d5e29a-8e99-49fc-88d8-5a7f0cb5c06c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:02:26.956072 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d5e29a-8e99-49fc-88d8-5a7f0cb5c06c service neutron] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:02:26.968249 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1123/2242] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Oct 27 10:02:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 10:02:27.416265 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd7dbbf-9fe2-4746-a1d4-25fd2de85b86 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:02:27.418536 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-2bd7dbbf-9fe2-4746-a1d4-25fd2de85b86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 10:02:27.436435 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd7dbbf-9fe2-4746-a1d4-25fd2de85b86 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:02:27.442263 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cde179-5b79-4894-8b28-7d140648fa6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:02:27.443013 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cde179-5b79-4894-8b28-7d140648fa6a admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:02:27.443172 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cde179-5b79-4894-8b28-7d140648fa6a admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:02:27.443444 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cde179-5b79-4894-8b28-7d140648fa6a admin admin] PATH_INFO: `/v3/projects/15b1beeea6cd4f60ae67a96605597915` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:02:27.444568 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93cde179-5b79-4894-8b28-7d140648fa6a admin admin] RBAC: Authorizing `identity:delete_project(project_id=15b1beeea6cd4f60ae67a96605597915)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:02:27.446486 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93cde179-5b79-4894-8b28-7d140648fa6a admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:02:27.581032 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:02:27.594939 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-93cde179-5b79-4894-8b28-7d140648fa6a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '15b1beeea6cd4f60ae67a96605597915', 'request_id': 'req-93cde179-5b79-4894-8b28-7d140648fa6a'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:02:27.601238 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-93cde179-5b79-4894-8b28-7d140648fa6a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '15b1beeea6cd4f60ae67a96605597915', 'request_id': 'req-93cde179-5b79-4894-8b28-7d140648fa6a'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:02:27.742100 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-93cde179-5b79-4894-8b28-7d140648fa6a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '15b1beeea6cd4f60ae67a96605597915', 'request_id': 'req-93cde179-5b79-4894-8b28-7d140648fa6a'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:02:27.753624 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-93cde179-5b79-4894-8b28-7d140648fa6a admin admin] The token cache is being invalidate because project 15b1beeea6cd4f60ae67a96605597915 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 10:02:27.753917 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-93cde179-5b79-4894-8b28-7d140648fa6a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:02:27.754596 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-93cde179-5b79-4894-8b28-7d140648fa6a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:02:27.756659 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1120/2243] 10.222.0.65 () {58 vars in 1233 bytes} [Thu Oct 27 10:02:27 2022] DELETE /identity/v3/projects/15b1beeea6cd4f60ae67a96605597915 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 10:02:27.760709 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d5e29a-8e99-49fc-88d8-5a7f0cb5c06c service neutron] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:02:27.771142 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d5e29a-8e99-49fc-88d8-5a7f0cb5c06c service neutron] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:02:27.832601 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658c8c1d-6d3a-49a2-8a53-914ab9688720 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:02:27.833244 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658c8c1d-6d3a-49a2-8a53-914ab9688720 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:02:27.833533 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658c8c1d-6d3a-49a2-8a53-914ab9688720 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:02:27.833810 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658c8c1d-6d3a-49a2-8a53-914ab9688720 admin admin] PATH_INFO: `/v3/users/67c7db81e8b64aa19462bec11efaf533` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:02:27.836427 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658c8c1d-6d3a-49a2-8a53-914ab9688720 admin admin] RBAC: Authorizing `identity:delete_user(user_id=67c7db81e8b64aa19462bec11efaf533)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:02:27.836996 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658c8c1d-6d3a-49a2-8a53-914ab9688720 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:02:28.060837 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-658c8c1d-6d3a-49a2-8a53-914ab9688720 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '67c7db81e8b64aa19462bec11efaf533'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:02:28.073022 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-658c8c1d-6d3a-49a2-8a53-914ab9688720 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '67c7db81e8b64aa19462bec11efaf533'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:02:28.073690 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-658c8c1d-6d3a-49a2-8a53-914ab9688720 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '67c7db81e8b64aa19462bec11efaf533'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:02:28.082533 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-658c8c1d-6d3a-49a2-8a53-914ab9688720 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '67c7db81e8b64aa19462bec11efaf533'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:02:28.152592 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-658c8c1d-6d3a-49a2-8a53-914ab9688720 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '67c7db81e8b64aa19462bec11efaf533'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:02:28.155349 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:DELETE=12,keystone:SELECT=86,keystone:INSERT=2 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:02:28.159698 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1124/2244] 10.222.0.65 () {58 vars in 1224 bytes} [Thu Oct 27 10:02:27 2022] DELETE /identity/v3/users/67c7db81e8b64aa19462bec11efaf533 => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 10:02:28.605576 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cde179-5b79-4894-8b28-7d140648fa6a admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:02:28.607784 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-93cde179-5b79-4894-8b28-7d140648fa6a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 10:02:28.621273 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cde179-5b79-4894-8b28-7d140648fa6a admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:02:28.681090 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25baf778-1bd8-49c3-840b-947b76fedbbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:02:28.681726 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25baf778-1bd8-49c3-840b-947b76fedbbb admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:02:28.682003 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25baf778-1bd8-49c3-840b-947b76fedbbb admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:02:28.682276 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25baf778-1bd8-49c3-840b-947b76fedbbb admin admin] PATH_INFO: `/v3/projects/5aaaa1657b8f45fe8876edc3a56ad3e6` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:02:28.683445 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25baf778-1bd8-49c3-840b-947b76fedbbb admin admin] RBAC: Authorizing `identity:delete_project(project_id=5aaaa1657b8f45fe8876edc3a56ad3e6)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:02:28.686027 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25baf778-1bd8-49c3-840b-947b76fedbbb admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:02:28.863371 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-25baf778-1bd8-49c3-840b-947b76fedbbb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5aaaa1657b8f45fe8876edc3a56ad3e6', 'request_id': 'req-25baf778-1bd8-49c3-840b-947b76fedbbb'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:02:28.869158 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-25baf778-1bd8-49c3-840b-947b76fedbbb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5aaaa1657b8f45fe8876edc3a56ad3e6', 'request_id': 'req-25baf778-1bd8-49c3-840b-947b76fedbbb'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:02:29.009643 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-25baf778-1bd8-49c3-840b-947b76fedbbb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5aaaa1657b8f45fe8876edc3a56ad3e6', 'request_id': 'req-25baf778-1bd8-49c3-840b-947b76fedbbb'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:02:29.021567 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-25baf778-1bd8-49c3-840b-947b76fedbbb admin admin] The token cache is being invalidate because project 5aaaa1657b8f45fe8876edc3a56ad3e6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 10:02:29.021863 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-25baf778-1bd8-49c3-840b-947b76fedbbb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:02:29.022535 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-25baf778-1bd8-49c3-840b-947b76fedbbb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:02:29.024042 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1121/2245] 10.222.0.65 () {58 vars in 1233 bytes} [Thu Oct 27 10:02:28 2022] DELETE /identity/v3/projects/5aaaa1657b8f45fe8876edc3a56ad3e6 => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 10:02:29.030154 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92aed7c-45dc-469e-8947-91ae1299a5e2 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:02:29.030673 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92aed7c-45dc-469e-8947-91ae1299a5e2 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:02:29.030764 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92aed7c-45dc-469e-8947-91ae1299a5e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:02:29.052683 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-b92aed7c-45dc-469e-8947-91ae1299a5e2 None None] MFA Rules not processed for user `b5065084bf664b99bdeac46067cb0f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 10:02:29.053907 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-b92aed7c-45dc-469e-8947-91ae1299a5e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 10:02:29.120833 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1125/2246] 10.222.0.65 () {58 vars in 958 bytes} [Thu Oct 27 10:02:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 10:02:29.128894 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7b67ba-ade7-4486-b49b-b7f9d124ea26 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:02:29.129177 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7b67ba-ade7-4486-b49b-b7f9d124ea26 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:02:29.129519 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7b67ba-ade7-4486-b49b-b7f9d124ea26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:02:29.150311 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-6f7b67ba-ade7-4486-b49b-b7f9d124ea26 None None] MFA Rules not processed for user `b5065084bf664b99bdeac46067cb0f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 10:02:29.151569 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-6f7b67ba-ade7-4486-b49b-b7f9d124ea26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 10:02:29.160695 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1122/2247] 10.222.0.65 () {58 vars in 958 bytes} [Thu Oct 27 10:02:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 10:02:29.167015 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92aed7c-45dc-469e-8947-91ae1299a5e2 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:02:29.178633 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92aed7c-45dc-469e-8947-91ae1299a5e2 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:02:29.183506 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d7292e-1c7c-4b78-ae7b-f8380a2bbd76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:02:29.184125 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d7292e-1c7c-4b78-ae7b-f8380a2bbd76 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:02:29.184406 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d7292e-1c7c-4b78-ae7b-f8380a2bbd76 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:02:29.184682 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d7292e-1c7c-4b78-ae7b-f8380a2bbd76 admin admin] PATH_INFO: `/v3/domains` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:02:29.185329 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d7292e-1c7c-4b78-ae7b-f8380a2bbd76 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 10:02:29.185633 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d7292e-1c7c-4b78-ae7b-f8380a2bbd76 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:02:29.187337 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d7292e-1c7c-4b78-ae7b-f8380a2bbd76 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:02:29.199303 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1126/2248] 10.222.0.65 () {58 vars in 1153 bytes} [Thu Oct 27 10:02:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 10:02:29.204193 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7b67ba-ade7-4486-b49b-b7f9d124ea26 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:02:29.213819 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7b67ba-ade7-4486-b49b-b7f9d124ea26 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:02:29.219427 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd53be7a-da12-44f6-af5b-505e3039acf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:02:29.220070 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd53be7a-da12-44f6-af5b-505e3039acf5 admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:02:29.220349 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd53be7a-da12-44f6-af5b-505e3039acf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:02:29.220621 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd53be7a-da12-44f6-af5b-505e3039acf5 admin admin] PATH_INFO: `/v3/projects` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:02:29.221264 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd53be7a-da12-44f6-af5b-505e3039acf5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:02:29.223222 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd53be7a-da12-44f6-af5b-505e3039acf5 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:02:29.314097 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1123/2249] 10.222.0.65 () {60 vars in 1153 bytes} [Thu Oct 27 10:02:29 2022] POST /identity/v3/projects => generated 379 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 10:02:29.318536 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d7292e-1c7c-4b78-ae7b-f8380a2bbd76 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:02:29.330100 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d7292e-1c7c-4b78-ae7b-f8380a2bbd76 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:02:29.395941 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedc0d15-9665-43f2-91c1-65b369771559 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:02:29.396562 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedc0d15-9665-43f2-91c1-65b369771559 admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:02:29.396852 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedc0d15-9665-43f2-91c1-65b369771559 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:02:29.397129 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedc0d15-9665-43f2-91c1-65b369771559 admin admin] PATH_INFO: `/v3/users` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:02:29.397876 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dedc0d15-9665-43f2-91c1-65b369771559 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:02:29.399735 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dedc0d15-9665-43f2-91c1-65b369771559 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:02:29.467673 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1127/2250] 10.222.0.65 () {60 vars in 1144 bytes} [Thu Oct 27 10:02:29 2022] POST /identity/v3/users => generated 290 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 10:02:29.471847 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd53be7a-da12-44f6-af5b-505e3039acf5 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:02:29.482660 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd53be7a-da12-44f6-af5b-505e3039acf5 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:02:29.487483 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bdf61e-70a2-4909-8ae6-1b59c6ab266c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:02:29.488113 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bdf61e-70a2-4909-8ae6-1b59c6ab266c admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:02:29.488396 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bdf61e-70a2-4909-8ae6-1b59c6ab266c admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:02:29.488670 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bdf61e-70a2-4909-8ae6-1b59c6ab266c admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:02:29.489309 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0bdf61e-70a2-4909-8ae6-1b59c6ab266c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:02:29.490944 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0bdf61e-70a2-4909-8ae6-1b59c6ab266c admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:02:29.496292 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:02:29.507040 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1124/2251] 10.222.0.65 () {58 vars in 1122 bytes} [Thu Oct 27 10:02:29 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 10:02:29.511055 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedc0d15-9665-43f2-91c1-65b369771559 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:02:29.523757 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedc0d15-9665-43f2-91c1-65b369771559 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:02:29.527158 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607fb9a0-ae3b-4bf2-bb45-8c0abd5569d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:02:29.528402 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607fb9a0-ae3b-4bf2-bb45-8c0abd5569d7 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:02:29.528759 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607fb9a0-ae3b-4bf2-bb45-8c0abd5569d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:02:29.529036 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607fb9a0-ae3b-4bf2-bb45-8c0abd5569d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:02:29.529838 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607fb9a0-ae3b-4bf2-bb45-8c0abd5569d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:02:29.531463 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607fb9a0-ae3b-4bf2-bb45-8c0abd5569d7 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:02:29.542774 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1128/2252] 10.222.0.65 () {58 vars in 1122 bytes} [Thu Oct 27 10:02:29 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 10:02:29.548397 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bdf61e-70a2-4909-8ae6-1b59c6ab266c admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:02:29.558497 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bdf61e-70a2-4909-8ae6-1b59c6ab266c admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:02:29.564659 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021fab14-596a-4097-9436-c5c5cdfebeeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:02:29.567473 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021fab14-596a-4097-9436-c5c5cdfebeeb admin admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:02:29.567473 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021fab14-596a-4097-9436-c5c5cdfebeeb admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:02:29.567473 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021fab14-596a-4097-9436-c5c5cdfebeeb admin admin] PATH_INFO: `/v3/projects/4f2759d1d2a54f4ba149fa59903ce34c/users/3e5b1a47433a4bfaa788b7ef47395fea/roles/43543ce1450245af9661cb017bac17bd` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:02:29.584210 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021fab14-596a-4097-9436-c5c5cdfebeeb admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f2759d1d2a54f4ba149fa59903ce34c, user_id=3e5b1a47433a4bfaa788b7ef47395fea, role_id=43543ce1450245af9661cb017bac17bd)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:02:29.587110 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021fab14-596a-4097-9436-c5c5cdfebeeb admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:02:29.696175 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1125/2253] 10.222.0.65 () {60 vars in 1483 bytes} [Thu Oct 27 10:02:29 2022] PUT /identity/v3/projects/4f2759d1d2a54f4ba149fa59903ce34c/users/3e5b1a47433a4bfaa788b7ef47395fea/roles/43543ce1450245af9661cb017bac17bd => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 10:02:29.708782 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b359da-02a8-42bb-b994-f20f48c69c16 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:02:29.709096 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b359da-02a8-42bb-b994-f20f48c69c16 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:02:29.709391 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b359da-02a8-42bb-b994-f20f48c69c16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:02:29.737737 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-e4b359da-02a8-42bb-b994-f20f48c69c16 None None] MFA Rules not processed for user `3e5b1a47433a4bfaa788b7ef47395fea`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 10:02:29.741743 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-e4b359da-02a8-42bb-b994-f20f48c69c16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 10:02:29.795515 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:02:29.804323 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1129/2254] 10.222.0.65 () {58 vars in 958 bytes} [Thu Oct 27 10:02:29 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 10:02:29.809625 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021fab14-596a-4097-9436-c5c5cdfebeeb admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:02:29.878012 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021fab14-596a-4097-9436-c5c5cdfebeeb admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:02:29.882806 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf0ee42-7f17-45bb-bf3d-8abdd342cadb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:02:29.883415 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf0ee42-7f17-45bb-bf3d-8abdd342cadb admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:02:29.883697 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf0ee42-7f17-45bb-bf3d-8abdd342cadb admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:02:29.883973 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf0ee42-7f17-45bb-bf3d-8abdd342cadb admin admin] PATH_INFO: `/v3/projects` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:02:29.884606 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf0ee42-7f17-45bb-bf3d-8abdd342cadb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:02:29.886539 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf0ee42-7f17-45bb-bf3d-8abdd342cadb admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:02:30.005716 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1126/2255] 10.222.0.65 () {60 vars in 1153 bytes} [Thu Oct 27 10:02:29 2022] POST /identity/v3/projects => generated 377 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 10:02:30.006712 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b359da-02a8-42bb-b994-f20f48c69c16 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:02:30.018499 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b359da-02a8-42bb-b994-f20f48c69c16 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:02:30.079166 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e286bd-ae11-455e-8212-186384891f62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:02:30.079823 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e286bd-ae11-455e-8212-186384891f62 admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:02:30.080035 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e286bd-ae11-455e-8212-186384891f62 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:02:30.080304 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e286bd-ae11-455e-8212-186384891f62 admin admin] PATH_INFO: `/v3/users` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:02:30.081210 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e286bd-ae11-455e-8212-186384891f62 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:02:30.083157 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e286bd-ae11-455e-8212-186384891f62 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:02:30.185766 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf0ee42-7f17-45bb-bf3d-8abdd342cadb admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:02:30.187557 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-fdf0ee42-7f17-45bb-bf3d-8abdd342cadb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 10:02:30.200969 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf0ee42-7f17-45bb-bf3d-8abdd342cadb admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:02:30.208748 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1130/2256] 10.222.0.65 () {60 vars in 1144 bytes} [Thu Oct 27 10:02:30 2022] POST /identity/v3/users => generated 295 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 10:02:30.208951 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da55c9f-9149-44ff-93e0-bd4a6cb6b56a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:02:30.208951 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da55c9f-9149-44ff-93e0-bd4a6cb6b56a admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:02:30.208951 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da55c9f-9149-44ff-93e0-bd4a6cb6b56a admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:02:30.208951 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da55c9f-9149-44ff-93e0-bd4a6cb6b56a admin admin] PATH_INFO: `/v3/users/635203591e554bfca93fb143147a1b1d` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:02:30.209332 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da55c9f-9149-44ff-93e0-bd4a6cb6b56a admin admin] RBAC: Authorizing `identity:delete_user(user_id=635203591e554bfca93fb143147a1b1d)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:02:30.210585 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e286bd-ae11-455e-8212-186384891f62 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:02:30.211239 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da55c9f-9149-44ff-93e0-bd4a6cb6b56a admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:02:30.221224 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e286bd-ae11-455e-8212-186384891f62 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:02:30.226119 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5da8bb-be33-41d5-ae4e-2bea63d84c67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:02:30.226746 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5da8bb-be33-41d5-ae4e-2bea63d84c67 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:02:30.227032 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5da8bb-be33-41d5-ae4e-2bea63d84c67 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:02:30.227309 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5da8bb-be33-41d5-ae4e-2bea63d84c67 admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:02:30.228013 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5da8bb-be33-41d5-ae4e-2bea63d84c67 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:02:30.229726 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5da8bb-be33-41d5-ae4e-2bea63d84c67 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:02:30.241367 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1131/2257] 10.222.0.65 () {58 vars in 1122 bytes} [Thu Oct 27 10:02:30 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 10:02:30.250403 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5da8bb-be33-41d5-ae4e-2bea63d84c67 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:02:30.257096 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5da8bb-be33-41d5-ae4e-2bea63d84c67 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:02:30.263145 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd10312f-36f5-4e24-9e87-f83086b3363d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:02:30.263798 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd10312f-36f5-4e24-9e87-f83086b3363d admin admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:02:30.264089 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd10312f-36f5-4e24-9e87-f83086b3363d admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:02:30.264372 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd10312f-36f5-4e24-9e87-f83086b3363d admin admin] PATH_INFO: `/v3/projects/c878f628db784a0581ac3e9135df97d3/users/c078b5042e364931927ddd27e20690a5/roles/6ad17b9f9dea4b66ab2da3677d7e715d` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:02:30.280493 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd10312f-36f5-4e24-9e87-f83086b3363d admin admin] RBAC: Authorizing `identity:create_grant(project_id=c878f628db784a0581ac3e9135df97d3, user_id=c078b5042e364931927ddd27e20690a5, role_id=6ad17b9f9dea4b66ab2da3677d7e715d)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:02:30.283267 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd10312f-36f5-4e24-9e87-f83086b3363d admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:02:30.347908 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1132/2258] 10.222.0.65 () {60 vars in 1483 bytes} [Thu Oct 27 10:02:30 2022] PUT /identity/v3/projects/c878f628db784a0581ac3e9135df97d3/users/c078b5042e364931927ddd27e20690a5/roles/6ad17b9f9dea4b66ab2da3677d7e715d => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 10:02:30.351824 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd10312f-36f5-4e24-9e87-f83086b3363d admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:02:30.383620 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-0da55c9f-9149-44ff-93e0-bd4a6cb6b56a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '635203591e554bfca93fb143147a1b1d'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:02:30.384298 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-0da55c9f-9149-44ff-93e0-bd4a6cb6b56a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '635203591e554bfca93fb143147a1b1d'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:02:30.392607 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-0da55c9f-9149-44ff-93e0-bd4a6cb6b56a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '635203591e554bfca93fb143147a1b1d'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:02:30.393353 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-0da55c9f-9149-44ff-93e0-bd4a6cb6b56a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '635203591e554bfca93fb143147a1b1d'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:02:30.407171 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-0da55c9f-9149-44ff-93e0-bd4a6cb6b56a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '635203591e554bfca93fb143147a1b1d'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:02:30.419584 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd10312f-36f5-4e24-9e87-f83086b3363d admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:02:30.424430 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd31c951-d299-497b-8f38-f067fc68a95a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:02:30.425034 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd31c951-d299-497b-8f38-f067fc68a95a admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:02:30.425318 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd31c951-d299-497b-8f38-f067fc68a95a admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:02:30.425660 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd31c951-d299-497b-8f38-f067fc68a95a admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:02:30.426308 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd31c951-d299-497b-8f38-f067fc68a95a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:02:30.427944 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd31c951-d299-497b-8f38-f067fc68a95a admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:02:30.438257 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1133/2259] 10.222.0.65 () {58 vars in 1122 bytes} [Thu Oct 27 10:02:30 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 10:02:30.442326 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd31c951-d299-497b-8f38-f067fc68a95a admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:02:30.444026 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-fd31c951-d299-497b-8f38-f067fc68a95a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 10:02:30.456813 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd31c951-d299-497b-8f38-f067fc68a95a admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:02:30.461429 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5d7135-dc5e-4e70-9a9a-58abdf87cc3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:02:30.465771 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5d7135-dc5e-4e70-9a9a-58abdf87cc3e admin admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:02:30.465771 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5d7135-dc5e-4e70-9a9a-58abdf87cc3e admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:02:30.465771 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5d7135-dc5e-4e70-9a9a-58abdf87cc3e admin admin] PATH_INFO: `/v3/projects/c878f628db784a0581ac3e9135df97d3/users/c078b5042e364931927ddd27e20690a5/roles/6ad17b9f9dea4b66ab2da3677d7e715d` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:02:30.465771 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5d7135-dc5e-4e70-9a9a-58abdf87cc3e admin admin] RBAC: Authorizing `identity:create_grant(project_id=c878f628db784a0581ac3e9135df97d3, user_id=c078b5042e364931927ddd27e20690a5, role_id=6ad17b9f9dea4b66ab2da3677d7e715d)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:02:30.467935 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5d7135-dc5e-4e70-9a9a-58abdf87cc3e admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:02:30.478109 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1134/2260] 10.222.0.65 () {60 vars in 1483 bytes} [Thu Oct 27 10:02:30 2022] PUT /identity/v3/projects/c878f628db784a0581ac3e9135df97d3/users/c078b5042e364931927ddd27e20690a5/roles/6ad17b9f9dea4b66ab2da3677d7e715d => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 10:02:30.489016 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e3cd8e-054a-41e2-aec3-4d401582f9cc None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:02:30.489303 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e3cd8e-054a-41e2-aec3-4d401582f9cc None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:02:30.489573 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e3cd8e-054a-41e2-aec3-4d401582f9cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:02:30.489952 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1127/2261] 10.222.0.65 () {58 vars in 1224 bytes} [Thu Oct 27 10:02:30 2022] DELETE /identity/v3/users/635203591e554bfca93fb143147a1b1d => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 10:02:30.493944 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364d5c46-989a-4e66-b0c9-2f00bda9819d None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:02:30.494233 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364d5c46-989a-4e66-b0c9-2f00bda9819d None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:02:30.494511 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364d5c46-989a-4e66-b0c9-2f00bda9819d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:02:30.514152 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-364d5c46-989a-4e66-b0c9-2f00bda9819d None None] MFA Rules not processed for user `b5065084bf664b99bdeac46067cb0f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 10:02:30.515502 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-364d5c46-989a-4e66-b0c9-2f00bda9819d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 10:02:30.518586 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-99e3cd8e-054a-41e2-aec3-4d401582f9cc None None] MFA Rules not processed for user `c078b5042e364931927ddd27e20690a5`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 10:02:30.519777 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-99e3cd8e-054a-41e2-aec3-4d401582f9cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 10:02:30.540229 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:02:30.547453 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:02:30.579328 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1128/2262] 10.222.0.65 () {58 vars in 958 bytes} [Thu Oct 27 10:02:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 10:02:30.589464 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364d5c46-989a-4e66-b0c9-2f00bda9819d None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:02:30.591478 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-364d5c46-989a-4e66-b0c9-2f00bda9819d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 10:02:30.594729 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1135/2263] 10.222.0.65 () {58 vars in 958 bytes} [Thu Oct 27 10:02:30 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 10:02:30.606767 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e3cd8e-054a-41e2-aec3-4d401582f9cc None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:02:30.608235 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-99e3cd8e-054a-41e2-aec3-4d401582f9cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 10:02:30.651357 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364d5c46-989a-4e66-b0c9-2f00bda9819d None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:02:30.656174 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57154b1f-e571-42f0-bbbe-75ee1fd37bc6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6191cc41efa74f46b49022cf387f7a4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc2e3a7a1bcc480891c0b433291c00b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:02:30.656786 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57154b1f-e571-42f0-bbbe-75ee1fd37bc6 service neutron] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:02:30.657078 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57154b1f-e571-42f0-bbbe-75ee1fd37bc6 service neutron] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:02:30.657337 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57154b1f-e571-42f0-bbbe-75ee1fd37bc6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:02:30.666962 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57154b1f-e571-42f0-bbbe-75ee1fd37bc6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:02:30.667244 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e3cd8e-054a-41e2-aec3-4d401582f9cc None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:02:30.669895 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57154b1f-e571-42f0-bbbe-75ee1fd37bc6 service neutron] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:02:30.673574 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8173c362-4596-4d83-a21f-0ac663a3250f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8e5d5f04c4741bb86ca4a0f667d4ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc2e3a7a1bcc480891c0b433291c00b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:02:30.674190 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8173c362-4596-4d83-a21f-0ac663a3250f service cinder] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:02:30.674499 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8173c362-4596-4d83-a21f-0ac663a3250f service cinder] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:02:30.674805 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8173c362-4596-4d83-a21f-0ac663a3250f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:02:30.676665 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-8173c362-4596-4d83-a21f-0ac663a3250f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 10:02:30.680255 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1129/2264] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Oct 27 10:02:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 10:02:30.741186 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8173c362-4596-4d83-a21f-0ac663a3250f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:02:30.742725 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8173c362-4596-4d83-a21f-0ac663a3250f service cinder] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:02:30.752788 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1136/2265] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Oct 27 10:02:30 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 10:02:31.166445 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57154b1f-e571-42f0-bbbe-75ee1fd37bc6 service neutron] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:02:31.167911 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-57154b1f-e571-42f0-bbbe-75ee1fd37bc6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 10:02:31.182311 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57154b1f-e571-42f0-bbbe-75ee1fd37bc6 service neutron] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:02:31.188659 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c81efd-b46f-4328-a8aa-20e1a5b7e145 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:02:31.188881 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c81efd-b46f-4328-a8aa-20e1a5b7e145 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:02:31.189066 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c81efd-b46f-4328-a8aa-20e1a5b7e145 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:02:31.189271 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c81efd-b46f-4328-a8aa-20e1a5b7e145 admin admin] PATH_INFO: `/v3/projects/f5222d919ad74d828d6fb3f676f56a7f` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:02:31.190411 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c81efd-b46f-4328-a8aa-20e1a5b7e145 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f5222d919ad74d828d6fb3f676f56a7f)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:02:31.192419 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c81efd-b46f-4328-a8aa-20e1a5b7e145 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:02:31.360605 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-72c81efd-b46f-4328-a8aa-20e1a5b7e145 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f5222d919ad74d828d6fb3f676f56a7f', 'request_id': 'req-72c81efd-b46f-4328-a8aa-20e1a5b7e145'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:02:31.366994 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-72c81efd-b46f-4328-a8aa-20e1a5b7e145 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f5222d919ad74d828d6fb3f676f56a7f', 'request_id': 'req-72c81efd-b46f-4328-a8aa-20e1a5b7e145'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:02:31.490322 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-72c81efd-b46f-4328-a8aa-20e1a5b7e145 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f5222d919ad74d828d6fb3f676f56a7f', 'request_id': 'req-72c81efd-b46f-4328-a8aa-20e1a5b7e145'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:02:31.502779 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-72c81efd-b46f-4328-a8aa-20e1a5b7e145 admin admin] The token cache is being invalidate because project f5222d919ad74d828d6fb3f676f56a7f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 10:02:31.503079 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-72c81efd-b46f-4328-a8aa-20e1a5b7e145 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:02:31.503732 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-72c81efd-b46f-4328-a8aa-20e1a5b7e145 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:02:31.505206 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1130/2266] 10.222.0.65 () {58 vars in 1233 bytes} [Thu Oct 27 10:02:31 2022] DELETE /identity/v3/projects/f5222d919ad74d828d6fb3f676f56a7f => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 10:02:31.509268 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8173c362-4596-4d83-a21f-0ac663a3250f service cinder] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:02:31.527555 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8173c362-4596-4d83-a21f-0ac663a3250f service cinder] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:02:31.591657 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349ffb05-6e1f-4218-97c8-57a678022956 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:02:31.592175 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349ffb05-6e1f-4218-97c8-57a678022956 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:02:31.592462 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349ffb05-6e1f-4218-97c8-57a678022956 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:02:31.592738 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349ffb05-6e1f-4218-97c8-57a678022956 admin admin] PATH_INFO: `/v3/users/ad24c43bd9ed4c4d84ebdb6295641a14` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:02:31.593870 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349ffb05-6e1f-4218-97c8-57a678022956 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ad24c43bd9ed4c4d84ebdb6295641a14)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:02:31.595830 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349ffb05-6e1f-4218-97c8-57a678022956 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:02:31.610685 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:02:31.784517 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-349ffb05-6e1f-4218-97c8-57a678022956 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ad24c43bd9ed4c4d84ebdb6295641a14'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:02:31.797619 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-349ffb05-6e1f-4218-97c8-57a678022956 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ad24c43bd9ed4c4d84ebdb6295641a14'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:02:31.798333 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-349ffb05-6e1f-4218-97c8-57a678022956 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ad24c43bd9ed4c4d84ebdb6295641a14'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:02:31.805348 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-349ffb05-6e1f-4218-97c8-57a678022956 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ad24c43bd9ed4c4d84ebdb6295641a14'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:02:31.884150 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-349ffb05-6e1f-4218-97c8-57a678022956 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ad24c43bd9ed4c4d84ebdb6295641a14'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:02:31.891715 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1137/2267] 10.222.0.65 () {58 vars in 1224 bytes} [Thu Oct 27 10:02:31 2022] DELETE /identity/v3/users/ad24c43bd9ed4c4d84ebdb6295641a14 => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 10:02:32.268425 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c81efd-b46f-4328-a8aa-20e1a5b7e145 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:02:32.269843 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-72c81efd-b46f-4328-a8aa-20e1a5b7e145 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 10:02:32.285219 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c81efd-b46f-4328-a8aa-20e1a5b7e145 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:02:32.345051 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bd94ee-28be-4db3-a107-d1939a8e2fc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:02:32.345686 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bd94ee-28be-4db3-a107-d1939a8e2fc6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:02:32.345965 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bd94ee-28be-4db3-a107-d1939a8e2fc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:02:32.346238 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bd94ee-28be-4db3-a107-d1939a8e2fc6 admin admin] PATH_INFO: `/v3/projects/0bed0a22e0ac4e9b9e26b7c77f80c318` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:02:32.347427 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61bd94ee-28be-4db3-a107-d1939a8e2fc6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0bed0a22e0ac4e9b9e26b7c77f80c318)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:02:32.349417 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61bd94ee-28be-4db3-a107-d1939a8e2fc6 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:02:32.350982 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:02:32.485542 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-61bd94ee-28be-4db3-a107-d1939a8e2fc6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0bed0a22e0ac4e9b9e26b7c77f80c318', 'request_id': 'req-61bd94ee-28be-4db3-a107-d1939a8e2fc6'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:02:32.491694 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-61bd94ee-28be-4db3-a107-d1939a8e2fc6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0bed0a22e0ac4e9b9e26b7c77f80c318', 'request_id': 'req-61bd94ee-28be-4db3-a107-d1939a8e2fc6'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:02:32.572944 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349ffb05-6e1f-4218-97c8-57a678022956 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:02:32.574357 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-349ffb05-6e1f-4218-97c8-57a678022956 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 10:02:32.598195 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-61bd94ee-28be-4db3-a107-d1939a8e2fc6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0bed0a22e0ac4e9b9e26b7c77f80c318', 'request_id': 'req-61bd94ee-28be-4db3-a107-d1939a8e2fc6'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:02:32.610414 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-61bd94ee-28be-4db3-a107-d1939a8e2fc6 admin admin] The token cache is being invalidate because project 0bed0a22e0ac4e9b9e26b7c77f80c318 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 10:02:32.610748 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-61bd94ee-28be-4db3-a107-d1939a8e2fc6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:02:32.611398 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-61bd94ee-28be-4db3-a107-d1939a8e2fc6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:02:32.612958 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1131/2268] 10.222.0.65 () {58 vars in 1233 bytes} [Thu Oct 27 10:02:32 2022] DELETE /identity/v3/projects/0bed0a22e0ac4e9b9e26b7c77f80c318 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 10:02:32.617751 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837dc7db-0f98-470b-9b95-92267dfbebd9 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:02:32.618085 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837dc7db-0f98-470b-9b95-92267dfbebd9 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:02:32.618302 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837dc7db-0f98-470b-9b95-92267dfbebd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:02:32.636357 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349ffb05-6e1f-4218-97c8-57a678022956 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:02:32.638311 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-837dc7db-0f98-470b-9b95-92267dfbebd9 None None] MFA Rules not processed for user `b5065084bf664b99bdeac46067cb0f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 10:02:32.639631 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-837dc7db-0f98-470b-9b95-92267dfbebd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 10:02:32.688854 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ce1f2e-893b-4281-9354-76818680c65d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8e5d5f04c4741bb86ca4a0f667d4ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc2e3a7a1bcc480891c0b433291c00b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:02:32.689642 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ce1f2e-893b-4281-9354-76818680c65d service cinder] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:02:32.689964 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ce1f2e-893b-4281-9354-76818680c65d service cinder] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:02:32.690294 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ce1f2e-893b-4281-9354-76818680c65d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:02:32.692205 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-67ce1f2e-893b-4281-9354-76818680c65d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 10:02:32.705530 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1132/2269] 10.222.0.65 () {58 vars in 958 bytes} [Thu Oct 27 10:02:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 10:02:32.713613 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ace455-9eec-405d-abba-05755b2bb2fa None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:02:32.714316 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ace455-9eec-405d-abba-05755b2bb2fa None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:02:32.714629 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ace455-9eec-405d-abba-05755b2bb2fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:02:32.735394 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-81ace455-9eec-405d-abba-05755b2bb2fa None None] MFA Rules not processed for user `b5065084bf664b99bdeac46067cb0f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 10:02:32.736660 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-81ace455-9eec-405d-abba-05755b2bb2fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 10:02:32.745335 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1133/2270] 10.222.0.65 () {58 vars in 958 bytes} [Thu Oct 27 10:02:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 10:02:32.750248 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ace455-9eec-405d-abba-05755b2bb2fa None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:02:32.759396 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ace455-9eec-405d-abba-05755b2bb2fa None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:02:32.761160 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ce1f2e-893b-4281-9354-76818680c65d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:02:32.763315 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ce1f2e-893b-4281-9354-76818680c65d service cinder] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:02:32.765326 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deab2dca-3fa0-446e-b0ba-0618627bccae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:02:32.766856 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deab2dca-3fa0-446e-b0ba-0618627bccae admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:02:32.767146 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deab2dca-3fa0-446e-b0ba-0618627bccae admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:02:32.767421 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deab2dca-3fa0-446e-b0ba-0618627bccae admin admin] PATH_INFO: `/v3/domains` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:02:32.767538 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:02:32.768074 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deab2dca-3fa0-446e-b0ba-0618627bccae admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 10:02:32.768385 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deab2dca-3fa0-446e-b0ba-0618627bccae admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:02:32.769991 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deab2dca-3fa0-446e-b0ba-0618627bccae admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:02:32.773656 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1138/2271] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Oct 27 10:02:32 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 10:02:32.786020 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1134/2272] 10.222.0.65 () {58 vars in 1153 bytes} [Thu Oct 27 10:02:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 10:02:32.787563 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ce1f2e-893b-4281-9354-76818680c65d service cinder] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:02:32.801545 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ce1f2e-893b-4281-9354-76818680c65d service cinder] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:02:32.806720 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3c6324-447e-4b6b-8c2e-18ac3bef980d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:02:32.807361 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3c6324-447e-4b6b-8c2e-18ac3bef980d admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:02:32.807651 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3c6324-447e-4b6b-8c2e-18ac3bef980d admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:02:32.807930 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3c6324-447e-4b6b-8c2e-18ac3bef980d admin admin] PATH_INFO: `/v3/projects` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:02:32.808773 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3c6324-447e-4b6b-8c2e-18ac3bef980d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:02:32.811634 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3c6324-447e-4b6b-8c2e-18ac3bef980d admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:02:32.892128 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1139/2273] 10.222.0.65 () {60 vars in 1153 bytes} [Thu Oct 27 10:02:32 2022] POST /identity/v3/projects => generated 399 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 10:02:32.896560 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deab2dca-3fa0-446e-b0ba-0618627bccae admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:02:32.907537 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deab2dca-3fa0-446e-b0ba-0618627bccae admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:02:32.975035 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8ef9ed-8336-45d0-afca-7f1801e5f6f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:02:32.975668 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8ef9ed-8336-45d0-afca-7f1801e5f6f8 admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:02:32.975942 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8ef9ed-8336-45d0-afca-7f1801e5f6f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:02:32.976210 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8ef9ed-8336-45d0-afca-7f1801e5f6f8 admin admin] PATH_INFO: `/v3/users` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:02:32.976883 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8ef9ed-8336-45d0-afca-7f1801e5f6f8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:02:32.978893 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8ef9ed-8336-45d0-afca-7f1801e5f6f8 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:02:33.063078 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:02:33.068623 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1135/2274] 10.222.0.65 () {60 vars in 1144 bytes} [Thu Oct 27 10:02:32 2022] POST /identity/v3/users => generated 300 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 10:02:33.072823 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3c6324-447e-4b6b-8c2e-18ac3bef980d admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:02:33.084291 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3c6324-447e-4b6b-8c2e-18ac3bef980d admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:02:33.089150 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2a9e2f-69a9-48bc-8aae-8ea0980a0b7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:02:33.089760 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2a9e2f-69a9-48bc-8aae-8ea0980a0b7b admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:02:33.090047 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2a9e2f-69a9-48bc-8aae-8ea0980a0b7b admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:02:33.090334 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2a9e2f-69a9-48bc-8aae-8ea0980a0b7b admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:02:33.091073 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2a9e2f-69a9-48bc-8aae-8ea0980a0b7b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:02:33.092738 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2a9e2f-69a9-48bc-8aae-8ea0980a0b7b admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:02:33.104027 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1140/2275] 10.222.0.65 () {58 vars in 1122 bytes} [Thu Oct 27 10:02:33 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 10:02:33.108732 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8ef9ed-8336-45d0-afca-7f1801e5f6f8 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:02:33.118963 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8ef9ed-8336-45d0-afca-7f1801e5f6f8 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:02:33.125491 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc9b121-3840-46a3-aa64-ca3e9204048d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:02:33.126085 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc9b121-3840-46a3-aa64-ca3e9204048d admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:02:33.130046 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc9b121-3840-46a3-aa64-ca3e9204048d admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:02:33.130046 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc9b121-3840-46a3-aa64-ca3e9204048d admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:02:33.130046 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc9b121-3840-46a3-aa64-ca3e9204048d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:02:33.130046 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc9b121-3840-46a3-aa64-ca3e9204048d admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:02:33.140253 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1136/2276] 10.222.0.65 () {58 vars in 1122 bytes} [Thu Oct 27 10:02:33 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 10:02:33.144466 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2a9e2f-69a9-48bc-8aae-8ea0980a0b7b admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:02:33.155344 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2a9e2f-69a9-48bc-8aae-8ea0980a0b7b admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:02:33.161462 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f9351b-dae5-4b7c-b422-c45b5cdfecee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:02:33.162121 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f9351b-dae5-4b7c-b422-c45b5cdfecee admin admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:02:33.162407 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f9351b-dae5-4b7c-b422-c45b5cdfecee admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:02:33.162788 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f9351b-dae5-4b7c-b422-c45b5cdfecee admin admin] PATH_INFO: `/v3/projects/2ba7844138d1457595dc9dc39f4df4a0/users/c183ca951ff54f68a5640bf399d2618d/roles/43543ce1450245af9661cb017bac17bd` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:02:33.178879 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f9351b-dae5-4b7c-b422-c45b5cdfecee admin admin] RBAC: Authorizing `identity:create_grant(project_id=2ba7844138d1457595dc9dc39f4df4a0, user_id=c183ca951ff54f68a5640bf399d2618d, role_id=43543ce1450245af9661cb017bac17bd)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:02:33.181698 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f9351b-dae5-4b7c-b422-c45b5cdfecee admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:02:33.267415 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1141/2277] 10.222.0.65 () {60 vars in 1483 bytes} [Thu Oct 27 10:02:33 2022] PUT /identity/v3/projects/2ba7844138d1457595dc9dc39f4df4a0/users/c183ca951ff54f68a5640bf399d2618d/roles/43543ce1450245af9661cb017bac17bd => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 10:02:33.278894 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b7a26f-c40e-4bbd-a4e4-402da4ba10ca None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:02:33.279370 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b7a26f-c40e-4bbd-a4e4-402da4ba10ca None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:02:33.279483 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b7a26f-c40e-4bbd-a4e4-402da4ba10ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:02:33.308182 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-d5b7a26f-c40e-4bbd-a4e4-402da4ba10ca None None] MFA Rules not processed for user `c183ca951ff54f68a5640bf399d2618d`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 10:02:33.314503 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-d5b7a26f-c40e-4bbd-a4e4-402da4ba10ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 10:02:33.376393 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1137/2278] 10.222.0.65 () {58 vars in 958 bytes} [Thu Oct 27 10:02:33 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 10:02:33.380961 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f9351b-dae5-4b7c-b422-c45b5cdfecee admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:02:33.445657 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f9351b-dae5-4b7c-b422-c45b5cdfecee admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:02:33.450678 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c60ae32-541c-47b1-a1c5-dbad349a819a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:02:33.451247 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c60ae32-541c-47b1-a1c5-dbad349a819a admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:02:33.451534 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c60ae32-541c-47b1-a1c5-dbad349a819a admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:02:33.451810 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c60ae32-541c-47b1-a1c5-dbad349a819a admin admin] PATH_INFO: `/v3/projects` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:02:33.452451 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c60ae32-541c-47b1-a1c5-dbad349a819a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:02:33.454363 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c60ae32-541c-47b1-a1c5-dbad349a819a admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:02:33.560583 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1142/2279] 10.222.0.65 () {60 vars in 1153 bytes} [Thu Oct 27 10:02:33 2022] POST /identity/v3/projects => generated 399 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 10:02:33.572139 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b7a26f-c40e-4bbd-a4e4-402da4ba10ca None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:02:33.575961 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b7a26f-c40e-4bbd-a4e4-402da4ba10ca None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:02:33.634381 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71131444-0dcf-4be8-bddd-e88fec030cef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:02:33.635017 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71131444-0dcf-4be8-bddd-e88fec030cef admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:02:33.635302 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71131444-0dcf-4be8-bddd-e88fec030cef admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:02:33.635581 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71131444-0dcf-4be8-bddd-e88fec030cef admin admin] PATH_INFO: `/v3/users` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:02:33.636224 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71131444-0dcf-4be8-bddd-e88fec030cef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:02:33.638275 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71131444-0dcf-4be8-bddd-e88fec030cef admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:02:33.724563 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1138/2280] 10.222.0.65 () {60 vars in 1144 bytes} [Thu Oct 27 10:02:33 2022] POST /identity/v3/users => generated 306 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 10:02:33.728540 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c60ae32-541c-47b1-a1c5-dbad349a819a admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:02:33.739322 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c60ae32-541c-47b1-a1c5-dbad349a819a admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:02:33.744158 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227813bb-ddda-4957-abfd-edf43dd85e57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:02:33.744756 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227813bb-ddda-4957-abfd-edf43dd85e57 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:02:33.745050 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227813bb-ddda-4957-abfd-edf43dd85e57 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:02:33.745361 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227813bb-ddda-4957-abfd-edf43dd85e57 admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:02:33.746040 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227813bb-ddda-4957-abfd-edf43dd85e57 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:02:33.747921 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227813bb-ddda-4957-abfd-edf43dd85e57 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:02:33.758681 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1143/2281] 10.222.0.65 () {58 vars in 1122 bytes} [Thu Oct 27 10:02:33 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 10:02:33.764104 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71131444-0dcf-4be8-bddd-e88fec030cef admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:02:33.774111 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71131444-0dcf-4be8-bddd-e88fec030cef admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:02:33.779981 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3accd25e-45b0-4753-a650-4d88c2949094 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:02:33.780623 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3accd25e-45b0-4753-a650-4d88c2949094 admin admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:02:33.780909 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3accd25e-45b0-4753-a650-4d88c2949094 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:02:33.781188 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3accd25e-45b0-4753-a650-4d88c2949094 admin admin] PATH_INFO: `/v3/projects/8e5f827d38e84c6e82a1887aa03f6d0d/users/0987a30971af4bd880ecc16d803308b0/roles/6ad17b9f9dea4b66ab2da3677d7e715d` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:02:33.796629 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3accd25e-45b0-4753-a650-4d88c2949094 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e5f827d38e84c6e82a1887aa03f6d0d, user_id=0987a30971af4bd880ecc16d803308b0, role_id=6ad17b9f9dea4b66ab2da3677d7e715d)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:02:33.799359 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3accd25e-45b0-4753-a650-4d88c2949094 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:02:33.873626 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1139/2282] 10.222.0.65 () {60 vars in 1483 bytes} [Thu Oct 27 10:02:33 2022] PUT /identity/v3/projects/8e5f827d38e84c6e82a1887aa03f6d0d/users/0987a30971af4bd880ecc16d803308b0/roles/6ad17b9f9dea4b66ab2da3677d7e715d => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 10:02:33.877574 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227813bb-ddda-4957-abfd-edf43dd85e57 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:02:33.888827 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227813bb-ddda-4957-abfd-edf43dd85e57 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:02:33.947755 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b2fe66-af66-4a5c-82e8-4c20c2e977a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:02:33.948365 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b2fe66-af66-4a5c-82e8-4c20c2e977a7 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:02:33.948649 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b2fe66-af66-4a5c-82e8-4c20c2e977a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:02:33.948931 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b2fe66-af66-4a5c-82e8-4c20c2e977a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:02:33.949571 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b2fe66-af66-4a5c-82e8-4c20c2e977a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:02:33.951950 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b2fe66-af66-4a5c-82e8-4c20c2e977a7 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:02:33.962114 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1144/2283] 10.222.0.65 () {58 vars in 1122 bytes} [Thu Oct 27 10:02:33 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 10:02:33.966998 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3accd25e-45b0-4753-a650-4d88c2949094 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:02:33.977222 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3accd25e-45b0-4753-a650-4d88c2949094 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:02:33.984052 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893e2372-da10-4bc3-bac8-acbe3feadf5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:02:33.984924 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893e2372-da10-4bc3-bac8-acbe3feadf5b admin admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:02:33.985032 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893e2372-da10-4bc3-bac8-acbe3feadf5b admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:02:33.985303 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893e2372-da10-4bc3-bac8-acbe3feadf5b admin admin] PATH_INFO: `/v3/projects/8e5f827d38e84c6e82a1887aa03f6d0d/users/0987a30971af4bd880ecc16d803308b0/roles/6ad17b9f9dea4b66ab2da3677d7e715d` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:02:33.987259 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893e2372-da10-4bc3-bac8-acbe3feadf5b admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e5f827d38e84c6e82a1887aa03f6d0d, user_id=0987a30971af4bd880ecc16d803308b0, role_id=6ad17b9f9dea4b66ab2da3677d7e715d)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:02:33.989929 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893e2372-da10-4bc3-bac8-acbe3feadf5b admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:02:34.002108 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1140/2284] 10.222.0.65 () {60 vars in 1483 bytes} [Thu Oct 27 10:02:33 2022] PUT /identity/v3/projects/8e5f827d38e84c6e82a1887aa03f6d0d/users/0987a30971af4bd880ecc16d803308b0/roles/6ad17b9f9dea4b66ab2da3677d7e715d => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 10:02:34.013863 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d67d616-c18c-4b35-8bb5-5f8bf18b1a68 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:02:34.014112 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d67d616-c18c-4b35-8bb5-5f8bf18b1a68 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:02:34.014403 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d67d616-c18c-4b35-8bb5-5f8bf18b1a68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:02:34.036215 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:02:34.043833 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-1d67d616-c18c-4b35-8bb5-5f8bf18b1a68 None None] MFA Rules not processed for user `0987a30971af4bd880ecc16d803308b0`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 10:02:34.045694 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-1d67d616-c18c-4b35-8bb5-5f8bf18b1a68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 10:02:34.119912 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1145/2285] 10.222.0.65 () {58 vars in 958 bytes} [Thu Oct 27 10:02:34 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 10:02:34.131422 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893e2372-da10-4bc3-bac8-acbe3feadf5b admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:02:34.133339 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-893e2372-da10-4bc3-bac8-acbe3feadf5b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 10:02:34.170442 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:02:34.194790 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893e2372-da10-4bc3-bac8-acbe3feadf5b admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:02:34.198668 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24f94fe-035d-4368-9426-f2556e67f037 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8e5d5f04c4741bb86ca4a0f667d4ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc2e3a7a1bcc480891c0b433291c00b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:02:34.201998 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24f94fe-035d-4368-9426-f2556e67f037 service cinder] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:02:34.201998 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24f94fe-035d-4368-9426-f2556e67f037 service cinder] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:02:34.201998 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24f94fe-035d-4368-9426-f2556e67f037 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:02:34.210563 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24f94fe-035d-4368-9426-f2556e67f037 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:02:34.211997 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24f94fe-035d-4368-9426-f2556e67f037 service cinder] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:02:34.221355 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1141/2286] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Oct 27 10:02:34 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 10:02:34.443401 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d67d616-c18c-4b35-8bb5-5f8bf18b1a68 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:02:34.453802 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d67d616-c18c-4b35-8bb5-5f8bf18b1a68 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:02:34.457755 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e96db4-2b44-4a93-b449-d58b18cd3f55 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8e5d5f04c4741bb86ca4a0f667d4ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc2e3a7a1bcc480891c0b433291c00b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:02:34.458356 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e96db4-2b44-4a93-b449-d58b18cd3f55 service cinder] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:02:34.458728 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e96db4-2b44-4a93-b449-d58b18cd3f55 service cinder] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:02:34.458960 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e96db4-2b44-4a93-b449-d58b18cd3f55 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:02:34.520435 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e96db4-2b44-4a93-b449-d58b18cd3f55 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:02:34.521954 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e96db4-2b44-4a93-b449-d58b18cd3f55 service cinder] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:02:34.532827 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1146/2287] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Oct 27 10:02:34 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 10:02:36.398955 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24f94fe-035d-4368-9426-f2556e67f037 service cinder] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:02:36.400552 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-d24f94fe-035d-4368-9426-f2556e67f037 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 10:02:36.462399 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24f94fe-035d-4368-9426-f2556e67f037 service cinder] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:02:36.466955 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa97f844-bc6a-49e1-8141-1667b16fa914 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6191cc41efa74f46b49022cf387f7a4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc2e3a7a1bcc480891c0b433291c00b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:02:36.467553 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa97f844-bc6a-49e1-8141-1667b16fa914 service neutron] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:02:36.467833 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa97f844-bc6a-49e1-8141-1667b16fa914 service neutron] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:02:36.468158 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa97f844-bc6a-49e1-8141-1667b16fa914 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:02:36.469977 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-fa97f844-bc6a-49e1-8141-1667b16fa914 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 10:02:36.543252 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa97f844-bc6a-49e1-8141-1667b16fa914 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:02:36.545277 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa97f844-bc6a-49e1-8141-1667b16fa914 service neutron] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:02:36.557503 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1142/2288] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Oct 27 10:02:36 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 10:02:37.067567 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e96db4-2b44-4a93-b449-d58b18cd3f55 service cinder] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:02:37.069056 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-40e96db4-2b44-4a93-b449-d58b18cd3f55 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 10:02:37.135454 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e96db4-2b44-4a93-b449-d58b18cd3f55 service cinder] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:02:37.140587 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd80bf65-29d4-488a-bdeb-115c5213013f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:02:37.141200 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd80bf65-29d4-488a-bdeb-115c5213013f admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:02:37.141504 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd80bf65-29d4-488a-bdeb-115c5213013f admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:02:37.141775 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd80bf65-29d4-488a-bdeb-115c5213013f admin admin] PATH_INFO: `/v3/users/3e5b1a47433a4bfaa788b7ef47395fea` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:02:37.142912 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd80bf65-29d4-488a-bdeb-115c5213013f admin admin] RBAC: Authorizing `identity:delete_user(user_id=3e5b1a47433a4bfaa788b7ef47395fea)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:02:37.144919 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd80bf65-29d4-488a-bdeb-115c5213013f admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:02:37.330795 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:02:37.339499 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-dd80bf65-29d4-488a-bdeb-115c5213013f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3e5b1a47433a4bfaa788b7ef47395fea'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:02:37.352982 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-dd80bf65-29d4-488a-bdeb-115c5213013f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3e5b1a47433a4bfaa788b7ef47395fea'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:02:37.353688 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-dd80bf65-29d4-488a-bdeb-115c5213013f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3e5b1a47433a4bfaa788b7ef47395fea'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:02:37.361300 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-dd80bf65-29d4-488a-bdeb-115c5213013f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3e5b1a47433a4bfaa788b7ef47395fea'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:02:37.432930 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-dd80bf65-29d4-488a-bdeb-115c5213013f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3e5b1a47433a4bfaa788b7ef47395fea'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:02:37.439800 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1147/2289] 10.222.0.65 () {58 vars in 1224 bytes} [Thu Oct 27 10:02:37 2022] DELETE /identity/v3/users/3e5b1a47433a4bfaa788b7ef47395fea => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 10:02:37.445405 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f541a3f8-0b18-4945-a028-3a2a0aa8c645 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:02:37.445899 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f541a3f8-0b18-4945-a028-3a2a0aa8c645 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:02:37.446016 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f541a3f8-0b18-4945-a028-3a2a0aa8c645 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:02:37.466758 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-f541a3f8-0b18-4945-a028-3a2a0aa8c645 None None] MFA Rules not processed for user `b5065084bf664b99bdeac46067cb0f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 10:02:37.467962 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-f541a3f8-0b18-4945-a028-3a2a0aa8c645 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 10:02:37.525396 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1143/2290] 10.222.0.65 () {58 vars in 958 bytes} [Thu Oct 27 10:02:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 10:02:37.537365 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd80bf65-29d4-488a-bdeb-115c5213013f admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:02:37.538927 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-dd80bf65-29d4-488a-bdeb-115c5213013f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 10:02:37.597535 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd80bf65-29d4-488a-bdeb-115c5213013f admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:02:37.601388 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1165ebfc-4538-4908-be8f-881cabd0ab04 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6191cc41efa74f46b49022cf387f7a4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc2e3a7a1bcc480891c0b433291c00b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:02:37.602029 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1165ebfc-4538-4908-be8f-881cabd0ab04 service neutron] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:02:37.602313 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1165ebfc-4538-4908-be8f-881cabd0ab04 service neutron] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:02:37.602616 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1165ebfc-4538-4908-be8f-881cabd0ab04 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:02:37.612113 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1165ebfc-4538-4908-be8f-881cabd0ab04 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:02:37.613583 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1165ebfc-4538-4908-be8f-881cabd0ab04 service neutron] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:02:37.624332 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1148/2291] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Oct 27 10:02:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 10:02:37.757329 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f541a3f8-0b18-4945-a028-3a2a0aa8c645 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:02:37.769080 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f541a3f8-0b18-4945-a028-3a2a0aa8c645 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:02:37.772883 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28444f23-f28c-4b53-ad9c-f4788f922ace service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6191cc41efa74f46b49022cf387f7a4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc2e3a7a1bcc480891c0b433291c00b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:02:37.779699 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28444f23-f28c-4b53-ad9c-f4788f922ace service neutron] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:02:37.779699 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28444f23-f28c-4b53-ad9c-f4788f922ace service neutron] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:02:37.779699 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28444f23-f28c-4b53-ad9c-f4788f922ace service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:02:37.779699 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-28444f23-f28c-4b53-ad9c-f4788f922ace service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 10:02:37.790822 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:02:37.860753 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28444f23-f28c-4b53-ad9c-f4788f922ace service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:02:37.862257 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28444f23-f28c-4b53-ad9c-f4788f922ace service neutron] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:02:37.875828 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1144/2292] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Oct 27 10:02:37 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 10:02:38.166158 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1165ebfc-4538-4908-be8f-881cabd0ab04 service neutron] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:02:38.167824 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-1165ebfc-4538-4908-be8f-881cabd0ab04 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 10:02:38.185735 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1165ebfc-4538-4908-be8f-881cabd0ab04 service neutron] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:02:38.191255 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f51c8e2-8189-45e6-9418-db8b066a61a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:02:38.192052 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f51c8e2-8189-45e6-9418-db8b066a61a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:02:38.192316 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f51c8e2-8189-45e6-9418-db8b066a61a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:02:38.192601 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f51c8e2-8189-45e6-9418-db8b066a61a8 admin admin] PATH_INFO: `/v3/projects/4f2759d1d2a54f4ba149fa59903ce34c` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:02:38.193769 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f51c8e2-8189-45e6-9418-db8b066a61a8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4f2759d1d2a54f4ba149fa59903ce34c)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:02:38.195990 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f51c8e2-8189-45e6-9418-db8b066a61a8 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:02:38.308894 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-6f51c8e2-8189-45e6-9418-db8b066a61a8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4f2759d1d2a54f4ba149fa59903ce34c', 'request_id': 'req-6f51c8e2-8189-45e6-9418-db8b066a61a8'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:02:38.393055 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-6f51c8e2-8189-45e6-9418-db8b066a61a8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4f2759d1d2a54f4ba149fa59903ce34c', 'request_id': 'req-6f51c8e2-8189-45e6-9418-db8b066a61a8'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:02:38.400533 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-6f51c8e2-8189-45e6-9418-db8b066a61a8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4f2759d1d2a54f4ba149fa59903ce34c', 'request_id': 'req-6f51c8e2-8189-45e6-9418-db8b066a61a8'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:02:38.413098 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-6f51c8e2-8189-45e6-9418-db8b066a61a8 admin admin] The token cache is being invalidate because project 4f2759d1d2a54f4ba149fa59903ce34c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 10:02:38.413403 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-6f51c8e2-8189-45e6-9418-db8b066a61a8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:02:38.414394 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-6f51c8e2-8189-45e6-9418-db8b066a61a8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:02:38.415629 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1149/2293] 10.222.0.65 () {58 vars in 1233 bytes} [Thu Oct 27 10:02:38 2022] DELETE /identity/v3/projects/4f2759d1d2a54f4ba149fa59903ce34c => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 10:02:38.420961 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28444f23-f28c-4b53-ad9c-f4788f922ace service neutron] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:02:38.432449 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28444f23-f28c-4b53-ad9c-f4788f922ace service neutron] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:02:38.494796 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63d0fe2-a4f5-43a3-ae60-6e778f735509 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:02:38.495493 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63d0fe2-a4f5-43a3-ae60-6e778f735509 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:02:38.495704 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63d0fe2-a4f5-43a3-ae60-6e778f735509 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:02:38.495971 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63d0fe2-a4f5-43a3-ae60-6e778f735509 admin admin] PATH_INFO: `/v3/users/c078b5042e364931927ddd27e20690a5` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:02:38.497882 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63d0fe2-a4f5-43a3-ae60-6e778f735509 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c078b5042e364931927ddd27e20690a5)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:02:38.499868 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63d0fe2-a4f5-43a3-ae60-6e778f735509 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:02:38.762298 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-e63d0fe2-a4f5-43a3-ae60-6e778f735509 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c078b5042e364931927ddd27e20690a5'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:02:38.763094 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-e63d0fe2-a4f5-43a3-ae60-6e778f735509 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c078b5042e364931927ddd27e20690a5'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:02:38.771284 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-e63d0fe2-a4f5-43a3-ae60-6e778f735509 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c078b5042e364931927ddd27e20690a5'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:02:38.771973 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-e63d0fe2-a4f5-43a3-ae60-6e778f735509 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c078b5042e364931927ddd27e20690a5'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:02:38.785009 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-e63d0fe2-a4f5-43a3-ae60-6e778f735509 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c078b5042e364931927ddd27e20690a5'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:02:38.897978 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1145/2294] 10.222.0.65 () {58 vars in 1224 bytes} [Thu Oct 27 10:02:38 2022] DELETE /identity/v3/users/c078b5042e364931927ddd27e20690a5 => generated 0 bytes in 479 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 10:02:39.459971 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f51c8e2-8189-45e6-9418-db8b066a61a8 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:02:39.464755 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-6f51c8e2-8189-45e6-9418-db8b066a61a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 10:02:39.485989 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f51c8e2-8189-45e6-9418-db8b066a61a8 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:02:39.549694 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:02:39.570644 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249d4cfa-0588-4ee7-90d3-9286931f0222 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:02:39.571319 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249d4cfa-0588-4ee7-90d3-9286931f0222 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:02:39.571579 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249d4cfa-0588-4ee7-90d3-9286931f0222 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:02:39.571858 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249d4cfa-0588-4ee7-90d3-9286931f0222 admin admin] PATH_INFO: `/v3/projects/c878f628db784a0581ac3e9135df97d3` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:02:39.573016 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249d4cfa-0588-4ee7-90d3-9286931f0222 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c878f628db784a0581ac3e9135df97d3)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:02:39.575029 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249d4cfa-0588-4ee7-90d3-9286931f0222 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:02:39.710247 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-249d4cfa-0588-4ee7-90d3-9286931f0222 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c878f628db784a0581ac3e9135df97d3', 'request_id': 'req-249d4cfa-0588-4ee7-90d3-9286931f0222'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:02:39.804793 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63d0fe2-a4f5-43a3-ae60-6e778f735509 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:02:39.807038 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-e63d0fe2-a4f5-43a3-ae60-6e778f735509 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 10:02:39.816688 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-249d4cfa-0588-4ee7-90d3-9286931f0222 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c878f628db784a0581ac3e9135df97d3', 'request_id': 'req-249d4cfa-0588-4ee7-90d3-9286931f0222'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:02:39.823756 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-249d4cfa-0588-4ee7-90d3-9286931f0222 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c878f628db784a0581ac3e9135df97d3', 'request_id': 'req-249d4cfa-0588-4ee7-90d3-9286931f0222'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:02:39.829484 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63d0fe2-a4f5-43a3-ae60-6e778f735509 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:02:39.851425 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-249d4cfa-0588-4ee7-90d3-9286931f0222 admin admin] The token cache is being invalidate because project c878f628db784a0581ac3e9135df97d3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 10:02:39.851425 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-249d4cfa-0588-4ee7-90d3-9286931f0222 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:02:39.852935 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-249d4cfa-0588-4ee7-90d3-9286931f0222 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:02:39.855062 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1150/2295] 10.222.0.65 () {58 vars in 1233 bytes} [Thu Oct 27 10:02:39 2022] DELETE /identity/v3/projects/c878f628db784a0581ac3e9135df97d3 => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 10:02:39.859950 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:02:39.860350 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c5da7d-f744-4d4b-bcba-9a9ab6dd8825 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:02:39.860713 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c5da7d-f744-4d4b-bcba-9a9ab6dd8825 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:02:39.861063 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c5da7d-f744-4d4b-bcba-9a9ab6dd8825 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:02:39.886052 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-a0c5da7d-f744-4d4b-bcba-9a9ab6dd8825 None None] MFA Rules not processed for user `b5065084bf664b99bdeac46067cb0f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 10:02:39.890965 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-a0c5da7d-f744-4d4b-bcba-9a9ab6dd8825 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 10:02:39.930772 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6829be3-a8b6-4bc1-8073-a06b745d3a81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:02:39.931440 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6829be3-a8b6-4bc1-8073-a06b745d3a81 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:02:39.931730 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6829be3-a8b6-4bc1-8073-a06b745d3a81 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:02:39.932011 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6829be3-a8b6-4bc1-8073-a06b745d3a81 admin admin] PATH_INFO: `/v3/users/c183ca951ff54f68a5640bf399d2618d` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:02:39.933203 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6829be3-a8b6-4bc1-8073-a06b745d3a81 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c183ca951ff54f68a5640bf399d2618d)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:02:39.936659 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6829be3-a8b6-4bc1-8073-a06b745d3a81 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:02:39.990154 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1151/2296] 10.222.0.65 () {58 vars in 958 bytes} [Thu Oct 27 10:02:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 10:02:39.998414 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce4257e-4ad0-4e20-bbda-efb75ea8b265 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:02:39.998759 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce4257e-4ad0-4e20-bbda-efb75ea8b265 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:02:39.999007 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce4257e-4ad0-4e20-bbda-efb75ea8b265 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:02:40.020561 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-fce4257e-4ad0-4e20-bbda-efb75ea8b265 None None] MFA Rules not processed for user `b5065084bf664b99bdeac46067cb0f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 10:02:40.023579 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-fce4257e-4ad0-4e20-bbda-efb75ea8b265 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 10:02:40.031477 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1152/2297] 10.222.0.65 () {58 vars in 958 bytes} [Thu Oct 27 10:02:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 10:02:40.036074 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce4257e-4ad0-4e20-bbda-efb75ea8b265 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:02:40.045895 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce4257e-4ad0-4e20-bbda-efb75ea8b265 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:02:40.051130 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8978850e-65b5-4f46-8992-5423315aeab2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:02:40.051744 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8978850e-65b5-4f46-8992-5423315aeab2 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:02:40.052026 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8978850e-65b5-4f46-8992-5423315aeab2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:02:40.052302 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8978850e-65b5-4f46-8992-5423315aeab2 admin admin] PATH_INFO: `/v3/domains` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:02:40.052956 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8978850e-65b5-4f46-8992-5423315aeab2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 10:02:40.053259 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8978850e-65b5-4f46-8992-5423315aeab2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:02:40.054939 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8978850e-65b5-4f46-8992-5423315aeab2 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:02:40.070560 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1153/2298] 10.222.0.65 () {58 vars in 1153 bytes} [Thu Oct 27 10:02:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 10:02:40.074181 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8978850e-65b5-4f46-8992-5423315aeab2 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:02:40.085629 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8978850e-65b5-4f46-8992-5423315aeab2 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:02:40.090265 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db114e5b-675f-409a-a12e-00f52ac27532 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:02:40.092387 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db114e5b-675f-409a-a12e-00f52ac27532 admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:02:40.092387 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db114e5b-675f-409a-a12e-00f52ac27532 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:02:40.092387 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db114e5b-675f-409a-a12e-00f52ac27532 admin admin] PATH_INFO: `/v3/projects` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:02:40.092387 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db114e5b-675f-409a-a12e-00f52ac27532 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:02:40.094232 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db114e5b-675f-409a-a12e-00f52ac27532 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:02:40.121954 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-f6829be3-a8b6-4bc1-8073-a06b745d3a81 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c183ca951ff54f68a5640bf399d2618d'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:02:40.123307 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-f6829be3-a8b6-4bc1-8073-a06b745d3a81 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c183ca951ff54f68a5640bf399d2618d'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:02:40.130730 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-f6829be3-a8b6-4bc1-8073-a06b745d3a81 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c183ca951ff54f68a5640bf399d2618d'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:02:40.138611 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-f6829be3-a8b6-4bc1-8073-a06b745d3a81 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c183ca951ff54f68a5640bf399d2618d'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:02:40.151309 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-f6829be3-a8b6-4bc1-8073-a06b745d3a81 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c183ca951ff54f68a5640bf399d2618d'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:02:40.221314 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1146/2299] 10.222.0.65 () {58 vars in 1224 bytes} [Thu Oct 27 10:02:39 2022] DELETE /identity/v3/users/c183ca951ff54f68a5640bf399d2618d => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 10:02:40.222712 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1154/2300] 10.222.0.65 () {60 vars in 1153 bytes} [Thu Oct 27 10:02:40 2022] POST /identity/v3/projects => generated 407 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 10:02:40.225738 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df2dc64-fb22-4926-9e73-72d9c30d85cd None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:02:40.226058 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df2dc64-fb22-4926-9e73-72d9c30d85cd None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:02:40.226354 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df2dc64-fb22-4926-9e73-72d9c30d85cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:02:40.228131 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db114e5b-675f-409a-a12e-00f52ac27532 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:02:40.229929 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-db114e5b-675f-409a-a12e-00f52ac27532 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 10:02:40.248412 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-3df2dc64-fb22-4926-9e73-72d9c30d85cd None None] MFA Rules not processed for user `b5065084bf664b99bdeac46067cb0f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 10:02:40.249751 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-3df2dc64-fb22-4926-9e73-72d9c30d85cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 10:02:40.267700 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:02:40.313955 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db114e5b-675f-409a-a12e-00f52ac27532 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:02:40.318752 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb63814-159a-43f2-b255-25cab0e6ab53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:02:40.319392 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb63814-159a-43f2-b255-25cab0e6ab53 admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:02:40.319672 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb63814-159a-43f2-b255-25cab0e6ab53 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:02:40.319952 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb63814-159a-43f2-b255-25cab0e6ab53 admin admin] PATH_INFO: `/v3/users` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:02:40.320092 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1147/2301] 10.222.0.65 () {58 vars in 958 bytes} [Thu Oct 27 10:02:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 10:02:40.323172 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb63814-159a-43f2-b255-25cab0e6ab53 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:02:40.326084 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb63814-159a-43f2-b255-25cab0e6ab53 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:02:40.330945 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df2dc64-fb22-4926-9e73-72d9c30d85cd None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:02:40.332510 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-3df2dc64-fb22-4926-9e73-72d9c30d85cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 10:02:40.388593 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:02:40.406688 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df2dc64-fb22-4926-9e73-72d9c30d85cd None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:02:40.411368 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e867b0ce-956d-46ab-9c17-4e4a62bfdfd4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6191cc41efa74f46b49022cf387f7a4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc2e3a7a1bcc480891c0b433291c00b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:02:40.411985 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e867b0ce-956d-46ab-9c17-4e4a62bfdfd4 service neutron] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:02:40.412294 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e867b0ce-956d-46ab-9c17-4e4a62bfdfd4 service neutron] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:02:40.412806 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e867b0ce-956d-46ab-9c17-4e4a62bfdfd4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:02:40.419543 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1155/2302] 10.222.0.65 () {60 vars in 1144 bytes} [Thu Oct 27 10:02:40 2022] POST /identity/v3/users => generated 304 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 10:02:40.423036 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb63814-159a-43f2-b255-25cab0e6ab53 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:02:40.426806 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e867b0ce-956d-46ab-9c17-4e4a62bfdfd4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:02:40.428359 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e867b0ce-956d-46ab-9c17-4e4a62bfdfd4 service neutron] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:02:40.436701 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb63814-159a-43f2-b255-25cab0e6ab53 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:02:40.439794 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1148/2303] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Oct 27 10:02:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 10:02:40.445107 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28f20a2-6392-4d7d-b796-264d109c1bf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:02:40.445997 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28f20a2-6392-4d7d-b796-264d109c1bf0 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:02:40.446426 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28f20a2-6392-4d7d-b796-264d109c1bf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:02:40.446881 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28f20a2-6392-4d7d-b796-264d109c1bf0 admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:02:40.447706 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28f20a2-6392-4d7d-b796-264d109c1bf0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:02:40.449567 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28f20a2-6392-4d7d-b796-264d109c1bf0 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:02:40.463153 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1156/2304] 10.222.0.65 () {58 vars in 1122 bytes} [Thu Oct 27 10:02:40 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 10:02:40.467429 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e867b0ce-956d-46ab-9c17-4e4a62bfdfd4 service neutron] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:02:40.477648 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e867b0ce-956d-46ab-9c17-4e4a62bfdfd4 service neutron] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:02:40.484385 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f01d2a-e6d8-44a5-92ea-9918b1002ebb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:02:40.485173 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f01d2a-e6d8-44a5-92ea-9918b1002ebb admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:02:40.485434 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f01d2a-e6d8-44a5-92ea-9918b1002ebb admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:02:40.485735 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f01d2a-e6d8-44a5-92ea-9918b1002ebb admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:02:40.486389 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f01d2a-e6d8-44a5-92ea-9918b1002ebb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:02:40.488020 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f01d2a-e6d8-44a5-92ea-9918b1002ebb admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:02:40.499414 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1149/2305] 10.222.0.65 () {58 vars in 1122 bytes} [Thu Oct 27 10:02:40 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 10:02:40.503471 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28f20a2-6392-4d7d-b796-264d109c1bf0 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:02:40.514897 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28f20a2-6392-4d7d-b796-264d109c1bf0 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:02:40.519855 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097236cd-9411-4233-8ecc-919efd44b3ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:02:40.520528 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097236cd-9411-4233-8ecc-919efd44b3ad admin admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:02:40.520807 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097236cd-9411-4233-8ecc-919efd44b3ad admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:02:40.521082 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097236cd-9411-4233-8ecc-919efd44b3ad admin admin] PATH_INFO: `/v3/projects/53d0716badea403bae3bed0bec15caa7/users/2a71dc8b39ac49ab8fd730c4f7f073ae/roles/43543ce1450245af9661cb017bac17bd` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:02:40.537688 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097236cd-9411-4233-8ecc-919efd44b3ad admin admin] RBAC: Authorizing `identity:create_grant(project_id=53d0716badea403bae3bed0bec15caa7, user_id=2a71dc8b39ac49ab8fd730c4f7f073ae, role_id=43543ce1450245af9661cb017bac17bd)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:02:40.540572 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097236cd-9411-4233-8ecc-919efd44b3ad admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:02:40.628501 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1157/2306] 10.222.0.65 () {60 vars in 1483 bytes} [Thu Oct 27 10:02:40 2022] PUT /identity/v3/projects/53d0716badea403bae3bed0bec15caa7/users/2a71dc8b39ac49ab8fd730c4f7f073ae/roles/43543ce1450245af9661cb017bac17bd => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 10:02:40.639731 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d3fa67-f42e-4246-9053-2a7e792bbac2 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:02:40.640020 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d3fa67-f42e-4246-9053-2a7e792bbac2 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:02:40.640299 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d3fa67-f42e-4246-9053-2a7e792bbac2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:02:40.670446 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-a1d3fa67-f42e-4246-9053-2a7e792bbac2 None None] MFA Rules not processed for user `2a71dc8b39ac49ab8fd730c4f7f073ae`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 10:02:40.671693 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-a1d3fa67-f42e-4246-9053-2a7e792bbac2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 10:02:40.760893 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1150/2307] 10.222.0.65 () {58 vars in 958 bytes} [Thu Oct 27 10:02:40 2022] POST /identity/v3/auth/tokens => generated 3284 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 10:02:40.765976 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097236cd-9411-4233-8ecc-919efd44b3ad admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:02:40.882090 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097236cd-9411-4233-8ecc-919efd44b3ad admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:02:40.888047 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194f62d5-abb8-4ecc-b55f-e534bbdecccf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:02:40.889807 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194f62d5-abb8-4ecc-b55f-e534bbdecccf admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:02:40.889807 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194f62d5-abb8-4ecc-b55f-e534bbdecccf admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:02:40.889807 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194f62d5-abb8-4ecc-b55f-e534bbdecccf admin admin] PATH_INFO: `/v3/projects` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:02:40.890158 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194f62d5-abb8-4ecc-b55f-e534bbdecccf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:02:40.892101 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194f62d5-abb8-4ecc-b55f-e534bbdecccf admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:02:41.014180 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1158/2308] 10.222.0.65 () {60 vars in 1153 bytes} [Thu Oct 27 10:02:40 2022] POST /identity/v3/projects => generated 409 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 10:02:41.015633 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d3fa67-f42e-4246-9053-2a7e792bbac2 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:02:41.026610 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d3fa67-f42e-4246-9053-2a7e792bbac2 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:02:41.041073 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194f62d5-abb8-4ecc-b55f-e534bbdecccf admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:02:41.043497 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-194f62d5-abb8-4ecc-b55f-e534bbdecccf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 10:02:41.121749 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6a9c15-3a15-4342-807e-6e5fb6c2d5fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:02:41.123419 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6a9c15-3a15-4342-807e-6e5fb6c2d5fa admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:02:41.123706 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6a9c15-3a15-4342-807e-6e5fb6c2d5fa admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:02:41.123980 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6a9c15-3a15-4342-807e-6e5fb6c2d5fa admin admin] PATH_INFO: `/v3/users` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:02:41.124627 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6a9c15-3a15-4342-807e-6e5fb6c2d5fa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:02:41.127049 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6a9c15-3a15-4342-807e-6e5fb6c2d5fa admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:02:41.132567 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194f62d5-abb8-4ecc-b55f-e534bbdecccf admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:02:41.143565 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a8cc33-9d3e-4532-9abd-208a734a164b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:02:41.146019 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a8cc33-9d3e-4532-9abd-208a734a164b admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:02:41.146019 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a8cc33-9d3e-4532-9abd-208a734a164b admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:02:41.146019 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a8cc33-9d3e-4532-9abd-208a734a164b admin admin] PATH_INFO: `/v3/projects/2ba7844138d1457595dc9dc39f4df4a0` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:02:41.146019 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a8cc33-9d3e-4532-9abd-208a734a164b admin admin] RBAC: Authorizing `identity:delete_project(project_id=2ba7844138d1457595dc9dc39f4df4a0)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:02:41.147836 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a8cc33-9d3e-4532-9abd-208a734a164b admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:02:41.160090 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:02:41.248143 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1151/2309] 10.222.0.65 () {60 vars in 1144 bytes} [Thu Oct 27 10:02:41 2022] POST /identity/v3/users => generated 311 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 10:02:41.251751 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6a9c15-3a15-4342-807e-6e5fb6c2d5fa admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:02:41.261956 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6a9c15-3a15-4342-807e-6e5fb6c2d5fa admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:02:41.278672 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-49a8cc33-9d3e-4532-9abd-208a734a164b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2ba7844138d1457595dc9dc39f4df4a0', 'request_id': 'req-49a8cc33-9d3e-4532-9abd-208a734a164b'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:02:41.318195 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:02:41.335701 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd15af3-ca01-4bc8-ac4b-890efbb7d14b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:02:41.335701 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd15af3-ca01-4bc8-ac4b-890efbb7d14b admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:02:41.335701 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd15af3-ca01-4bc8-ac4b-890efbb7d14b admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:02:41.335701 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd15af3-ca01-4bc8-ac4b-890efbb7d14b admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:02:41.336054 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd15af3-ca01-4bc8-ac4b-890efbb7d14b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:02:41.336054 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd15af3-ca01-4bc8-ac4b-890efbb7d14b admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:02:41.346983 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-49a8cc33-9d3e-4532-9abd-208a734a164b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2ba7844138d1457595dc9dc39f4df4a0', 'request_id': 'req-49a8cc33-9d3e-4532-9abd-208a734a164b'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:02:41.350561 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1152/2310] 10.222.0.65 () {58 vars in 1122 bytes} [Thu Oct 27 10:02:41 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 10:02:41.353013 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd15af3-ca01-4bc8-ac4b-890efbb7d14b admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:02:41.353642 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-49a8cc33-9d3e-4532-9abd-208a734a164b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2ba7844138d1457595dc9dc39f4df4a0', 'request_id': 'req-49a8cc33-9d3e-4532-9abd-208a734a164b'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:02:41.364922 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd15af3-ca01-4bc8-ac4b-890efbb7d14b admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:02:41.367077 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-49a8cc33-9d3e-4532-9abd-208a734a164b admin admin] The token cache is being invalidate because project 2ba7844138d1457595dc9dc39f4df4a0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 10:02:41.367378 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-49a8cc33-9d3e-4532-9abd-208a734a164b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:02:41.368059 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-49a8cc33-9d3e-4532-9abd-208a734a164b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:02:41.370110 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1159/2311] 10.222.0.65 () {58 vars in 1233 bytes} [Thu Oct 27 10:02:41 2022] DELETE /identity/v3/projects/2ba7844138d1457595dc9dc39f4df4a0 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 10:02:41.374143 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a8cc33-9d3e-4532-9abd-208a734a164b admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:02:41.375455 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c511a7-25a3-43bc-a98d-aeab433c9d42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:02:41.376157 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c511a7-25a3-43bc-a98d-aeab433c9d42 admin admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:02:41.381310 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-49a8cc33-9d3e-4532-9abd-208a734a164b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 10:02:41.381450 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c511a7-25a3-43bc-a98d-aeab433c9d42 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:02:41.381450 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c511a7-25a3-43bc-a98d-aeab433c9d42 admin admin] PATH_INFO: `/v3/projects/8d2476db53634cc18b36b2846827c55e/users/8687db7d3dcc4a51b7d0b24448354ff3/roles/6ad17b9f9dea4b66ab2da3677d7e715d` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:02:41.390090 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a8cc33-9d3e-4532-9abd-208a734a164b admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:02:41.393875 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c511a7-25a3-43bc-a98d-aeab433c9d42 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8d2476db53634cc18b36b2846827c55e, user_id=8687db7d3dcc4a51b7d0b24448354ff3, role_id=6ad17b9f9dea4b66ab2da3677d7e715d)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:02:41.395411 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68cafed-bd45-4204-9e58-14daac6a387f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:02:41.396059 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68cafed-bd45-4204-9e58-14daac6a387f admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:02:41.396344 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68cafed-bd45-4204-9e58-14daac6a387f admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:02:41.396621 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68cafed-bd45-4204-9e58-14daac6a387f admin admin] PATH_INFO: `/v3/users/0987a30971af4bd880ecc16d803308b0` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:02:41.396850 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c511a7-25a3-43bc-a98d-aeab433c9d42 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:02:41.397765 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68cafed-bd45-4204-9e58-14daac6a387f admin admin] RBAC: Authorizing `identity:delete_user(user_id=0987a30971af4bd880ecc16d803308b0)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:02:41.399723 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68cafed-bd45-4204-9e58-14daac6a387f admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:02:41.473871 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1153/2312] 10.222.0.65 () {60 vars in 1483 bytes} [Thu Oct 27 10:02:41 2022] PUT /identity/v3/projects/8d2476db53634cc18b36b2846827c55e/users/8687db7d3dcc4a51b7d0b24448354ff3/roles/6ad17b9f9dea4b66ab2da3677d7e715d => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 10:02:41.478484 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c511a7-25a3-43bc-a98d-aeab433c9d42 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:02:41.480159 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-98c511a7-25a3-43bc-a98d-aeab433c9d42 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 10:02:41.546398 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c511a7-25a3-43bc-a98d-aeab433c9d42 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:02:41.550778 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f31fb3-7954-4072-b89d-f2f7e12791a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:02:41.551470 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f31fb3-7954-4072-b89d-f2f7e12791a9 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:02:41.551754 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f31fb3-7954-4072-b89d-f2f7e12791a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:02:41.552032 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f31fb3-7954-4072-b89d-f2f7e12791a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:02:41.552746 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f31fb3-7954-4072-b89d-f2f7e12791a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:02:41.554348 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f31fb3-7954-4072-b89d-f2f7e12791a9 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:02:41.566127 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1154/2313] 10.222.0.65 () {58 vars in 1122 bytes} [Thu Oct 27 10:02:41 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 10:02:41.570471 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f31fb3-7954-4072-b89d-f2f7e12791a9 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:02:41.583860 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f31fb3-7954-4072-b89d-f2f7e12791a9 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:02:41.586978 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db2da92-6378-4316-8098-c0b04561418b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:02:41.587627 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db2da92-6378-4316-8098-c0b04561418b admin admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:02:41.587923 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db2da92-6378-4316-8098-c0b04561418b admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:02:41.588177 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db2da92-6378-4316-8098-c0b04561418b admin admin] PATH_INFO: `/v3/projects/8d2476db53634cc18b36b2846827c55e/users/8687db7d3dcc4a51b7d0b24448354ff3/roles/6ad17b9f9dea4b66ab2da3677d7e715d` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:02:41.590159 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db2da92-6378-4316-8098-c0b04561418b admin admin] RBAC: Authorizing `identity:create_grant(project_id=8d2476db53634cc18b36b2846827c55e, user_id=8687db7d3dcc4a51b7d0b24448354ff3, role_id=6ad17b9f9dea4b66ab2da3677d7e715d)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:02:41.592923 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db2da92-6378-4316-8098-c0b04561418b admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:02:41.605224 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1155/2314] 10.222.0.65 () {60 vars in 1483 bytes} [Thu Oct 27 10:02:41 2022] PUT /identity/v3/projects/8d2476db53634cc18b36b2846827c55e/users/8687db7d3dcc4a51b7d0b24448354ff3/roles/6ad17b9f9dea4b66ab2da3677d7e715d => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 10:02:41.615980 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3e495b-08d0-49e9-a866-25db8b46d0cf None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:02:41.616285 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3e495b-08d0-49e9-a866-25db8b46d0cf None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:02:41.616555 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3e495b-08d0-49e9-a866-25db8b46d0cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:02:41.643817 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-e68cafed-bd45-4204-9e58-14daac6a387f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0987a30971af4bd880ecc16d803308b0'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:02:41.649520 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-dc3e495b-08d0-49e9-a866-25db8b46d0cf None None] MFA Rules not processed for user `8687db7d3dcc4a51b7d0b24448354ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 10:02:41.652725 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-dc3e495b-08d0-49e9-a866-25db8b46d0cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 10:02:41.658474 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-e68cafed-bd45-4204-9e58-14daac6a387f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0987a30971af4bd880ecc16d803308b0'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:02:41.659192 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-e68cafed-bd45-4204-9e58-14daac6a387f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0987a30971af4bd880ecc16d803308b0'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:02:41.666269 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-e68cafed-bd45-4204-9e58-14daac6a387f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0987a30971af4bd880ecc16d803308b0'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:02:41.724299 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1156/2315] 10.222.0.65 () {58 vars in 958 bytes} [Thu Oct 27 10:02:41 2022] POST /identity/v3/auth/tokens => generated 3353 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 10:02:41.735260 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3e495b-08d0-49e9-a866-25db8b46d0cf None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:02:41.736571 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-dc3e495b-08d0-49e9-a866-25db8b46d0cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 10:02:41.741453 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-e68cafed-bd45-4204-9e58-14daac6a387f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0987a30971af4bd880ecc16d803308b0'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:02:41.749655 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1160/2316] 10.222.0.65 () {58 vars in 1224 bytes} [Thu Oct 27 10:02:41 2022] DELETE /identity/v3/users/0987a30971af4bd880ecc16d803308b0 => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 10:02:41.774680 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:02:41.799727 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3e495b-08d0-49e9-a866-25db8b46d0cf None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:02:41.853034 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9556539-0f1f-432b-9ca4-1e8676af96e6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8e5d5f04c4741bb86ca4a0f667d4ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc2e3a7a1bcc480891c0b433291c00b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:02:41.853713 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9556539-0f1f-432b-9ca4-1e8676af96e6 service cinder] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:02:41.854011 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9556539-0f1f-432b-9ca4-1e8676af96e6 service cinder] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:02:41.854362 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9556539-0f1f-432b-9ca4-1e8676af96e6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:02:41.857205 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-c9556539-0f1f-432b-9ca4-1e8676af96e6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 10:02:41.923457 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9556539-0f1f-432b-9ca4-1e8676af96e6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:02:41.924889 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9556539-0f1f-432b-9ca4-1e8676af96e6 service cinder] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:02:41.934323 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1157/2317] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Oct 27 10:02:41 2022] GET /identity/v3/auth/tokens => generated 3353 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 10:02:42.218086 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68cafed-bd45-4204-9e58-14daac6a387f admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:02:42.219671 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-e68cafed-bd45-4204-9e58-14daac6a387f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 10:02:42.291575 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68cafed-bd45-4204-9e58-14daac6a387f admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:02:42.296445 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9556539-0f1f-432b-9ca4-1e8676af96e6 service cinder] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:02:42.296942 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f85a46-a813-45b4-bda3-5eaa9b5315ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:02:42.297212 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f85a46-a813-45b4-bda3-5eaa9b5315ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:02:42.297498 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f85a46-a813-45b4-bda3-5eaa9b5315ac admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:02:42.297811 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f85a46-a813-45b4-bda3-5eaa9b5315ac admin admin] PATH_INFO: `/v3/projects/8e5f827d38e84c6e82a1887aa03f6d0d` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:02:42.297928 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-c9556539-0f1f-432b-9ca4-1e8676af96e6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 10:02:42.298952 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f85a46-a813-45b4-bda3-5eaa9b5315ac admin admin] RBAC: Authorizing `identity:delete_project(project_id=8e5f827d38e84c6e82a1887aa03f6d0d)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:02:42.302246 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f85a46-a813-45b4-bda3-5eaa9b5315ac admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:02:42.309323 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9556539-0f1f-432b-9ca4-1e8676af96e6 service cinder] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:02:42.314448 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cfc31d-4133-4cba-bfb5-99da188f3528 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8e5d5f04c4741bb86ca4a0f667d4ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc2e3a7a1bcc480891c0b433291c00b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:02:42.315182 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:02:42.315390 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cfc31d-4133-4cba-bfb5-99da188f3528 service cinder] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:02:42.315664 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cfc31d-4133-4cba-bfb5-99da188f3528 service cinder] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:02:42.316002 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cfc31d-4133-4cba-bfb5-99da188f3528 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:02:42.317779 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-e5cfc31d-4133-4cba-bfb5-99da188f3528 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 10:02:42.381244 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5cfc31d-4133-4cba-bfb5-99da188f3528 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:02:42.382728 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5cfc31d-4133-4cba-bfb5-99da188f3528 service cinder] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:02:42.392160 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1158/2318] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Oct 27 10:02:42 2022] GET /identity/v3/auth/tokens => generated 3284 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 10:02:42.439849 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-c9f85a46-a813-45b4-bda3-5eaa9b5315ac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8e5f827d38e84c6e82a1887aa03f6d0d', 'request_id': 'req-c9f85a46-a813-45b4-bda3-5eaa9b5315ac'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:02:42.575980 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-c9f85a46-a813-45b4-bda3-5eaa9b5315ac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8e5f827d38e84c6e82a1887aa03f6d0d', 'request_id': 'req-c9f85a46-a813-45b4-bda3-5eaa9b5315ac'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:02:42.582303 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-c9f85a46-a813-45b4-bda3-5eaa9b5315ac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8e5f827d38e84c6e82a1887aa03f6d0d', 'request_id': 'req-c9f85a46-a813-45b4-bda3-5eaa9b5315ac'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:02:42.594053 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-c9f85a46-a813-45b4-bda3-5eaa9b5315ac admin admin] The token cache is being invalidate because project 8e5f827d38e84c6e82a1887aa03f6d0d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 10:02:42.594345 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-c9f85a46-a813-45b4-bda3-5eaa9b5315ac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:02:42.595019 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-c9f85a46-a813-45b4-bda3-5eaa9b5315ac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:02:42.596503 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1161/2319] 10.222.0.65 () {58 vars in 1233 bytes} [Thu Oct 27 10:02:42 2022] DELETE /identity/v3/projects/8e5f827d38e84c6e82a1887aa03f6d0d => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 10:02:42.601581 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94030877-5770-4b79-8ab7-1b8320f581e3 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:02:42.601867 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94030877-5770-4b79-8ab7-1b8320f581e3 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:02:42.602145 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94030877-5770-4b79-8ab7-1b8320f581e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:02:42.630314 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-94030877-5770-4b79-8ab7-1b8320f581e3 None None] MFA Rules not processed for user `b5065084bf664b99bdeac46067cb0f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 10:02:42.631601 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-94030877-5770-4b79-8ab7-1b8320f581e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 10:02:42.665071 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:02:42.698285 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1159/2320] 10.222.0.65 () {58 vars in 958 bytes} [Thu Oct 27 10:02:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 10:02:42.707169 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da37b88-3078-4b44-a287-cbc9080cdc26 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:02:42.707680 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da37b88-3078-4b44-a287-cbc9080cdc26 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:02:42.715925 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da37b88-3078-4b44-a287-cbc9080cdc26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:02:42.732629 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-6da37b88-3078-4b44-a287-cbc9080cdc26 None None] MFA Rules not processed for user `b5065084bf664b99bdeac46067cb0f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 10:02:42.733853 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-6da37b88-3078-4b44-a287-cbc9080cdc26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 10:02:42.742373 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1162/2321] 10.222.0.65 () {58 vars in 958 bytes} [Thu Oct 27 10:02:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 10:02:42.746689 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94030877-5770-4b79-8ab7-1b8320f581e3 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:02:42.759486 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94030877-5770-4b79-8ab7-1b8320f581e3 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:02:42.765310 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a222b4-2908-43c9-bdda-5a6987e76adb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:02:42.765911 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a222b4-2908-43c9-bdda-5a6987e76adb admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:02:42.766192 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a222b4-2908-43c9-bdda-5a6987e76adb admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:02:42.766465 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a222b4-2908-43c9-bdda-5a6987e76adb admin admin] PATH_INFO: `/v3/domains` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:02:42.767147 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a222b4-2908-43c9-bdda-5a6987e76adb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 10:02:42.767452 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a222b4-2908-43c9-bdda-5a6987e76adb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:02:42.769093 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a222b4-2908-43c9-bdda-5a6987e76adb admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:02:42.781903 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1160/2322] 10.222.0.65 () {58 vars in 1153 bytes} [Thu Oct 27 10:02:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 10:02:42.786362 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da37b88-3078-4b44-a287-cbc9080cdc26 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:02:42.795721 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da37b88-3078-4b44-a287-cbc9080cdc26 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:02:42.800961 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61d09e1-759b-4f23-a01f-7c6d6b456ffe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:02:42.801760 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61d09e1-759b-4f23-a01f-7c6d6b456ffe admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:02:42.802046 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61d09e1-759b-4f23-a01f-7c6d6b456ffe admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:02:42.802325 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61d09e1-759b-4f23-a01f-7c6d6b456ffe admin admin] PATH_INFO: `/v3/projects` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:02:42.803012 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61d09e1-759b-4f23-a01f-7c6d6b456ffe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:02:42.804971 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61d09e1-759b-4f23-a01f-7c6d6b456ffe admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:02:42.955852 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1163/2323] 10.222.0.65 () {60 vars in 1153 bytes} [Thu Oct 27 10:02:42 2022] POST /identity/v3/projects => generated 371 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 10:02:42.960159 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a222b4-2908-43c9-bdda-5a6987e76adb admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:02:42.971375 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a222b4-2908-43c9-bdda-5a6987e76adb admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:02:43.042775 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109d5e2a-6cc8-40ce-a950-fd22d334b70d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:02:43.042775 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109d5e2a-6cc8-40ce-a950-fd22d334b70d admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:02:43.042775 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109d5e2a-6cc8-40ce-a950-fd22d334b70d admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:02:43.042775 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109d5e2a-6cc8-40ce-a950-fd22d334b70d admin admin] PATH_INFO: `/v3/users` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:02:43.043122 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109d5e2a-6cc8-40ce-a950-fd22d334b70d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:02:43.043122 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109d5e2a-6cc8-40ce-a950-fd22d334b70d admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:02:43.140220 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1161/2324] 10.222.0.65 () {60 vars in 1144 bytes} [Thu Oct 27 10:02:42 2022] POST /identity/v3/users => generated 286 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 10:02:43.141745 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61d09e1-759b-4f23-a01f-7c6d6b456ffe admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:02:43.152362 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61d09e1-759b-4f23-a01f-7c6d6b456ffe admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:02:43.157342 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63df1c8a-12e0-4892-ba98-7c7ba808bbce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:02:43.157944 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63df1c8a-12e0-4892-ba98-7c7ba808bbce admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:02:43.161514 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63df1c8a-12e0-4892-ba98-7c7ba808bbce admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:02:43.161514 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63df1c8a-12e0-4892-ba98-7c7ba808bbce admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:02:43.161514 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63df1c8a-12e0-4892-ba98-7c7ba808bbce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:02:43.161514 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63df1c8a-12e0-4892-ba98-7c7ba808bbce admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:02:43.171186 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1164/2325] 10.222.0.65 () {58 vars in 1122 bytes} [Thu Oct 27 10:02:43 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 10:02:43.175240 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109d5e2a-6cc8-40ce-a950-fd22d334b70d admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:02:43.186319 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109d5e2a-6cc8-40ce-a950-fd22d334b70d admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:02:43.191370 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5105680a-08d8-489c-843e-27576e2ef5bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:02:43.191934 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5105680a-08d8-489c-843e-27576e2ef5bd admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:02:43.192210 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5105680a-08d8-489c-843e-27576e2ef5bd admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:02:43.192479 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5105680a-08d8-489c-843e-27576e2ef5bd admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:02:43.193110 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5105680a-08d8-489c-843e-27576e2ef5bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:02:43.194926 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5105680a-08d8-489c-843e-27576e2ef5bd admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:02:43.209625 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1162/2326] 10.222.0.65 () {58 vars in 1122 bytes} [Thu Oct 27 10:02:43 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 10:02:43.210840 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63df1c8a-12e0-4892-ba98-7c7ba808bbce admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:02:43.221981 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63df1c8a-12e0-4892-ba98-7c7ba808bbce admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:02:43.227149 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e80c0f4-3d79-41fa-af5c-e082a433d245 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:02:43.227902 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e80c0f4-3d79-41fa-af5c-e082a433d245 admin admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:02:43.228295 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e80c0f4-3d79-41fa-af5c-e082a433d245 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:02:43.228609 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e80c0f4-3d79-41fa-af5c-e082a433d245 admin admin] PATH_INFO: `/v3/projects/88b9eda8d1724429b8856ce88f274d97/users/22fd943b05b34c11937acb11ceda5ba6/roles/43543ce1450245af9661cb017bac17bd` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:02:43.244790 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e80c0f4-3d79-41fa-af5c-e082a433d245 admin admin] RBAC: Authorizing `identity:create_grant(project_id=88b9eda8d1724429b8856ce88f274d97, user_id=22fd943b05b34c11937acb11ceda5ba6, role_id=43543ce1450245af9661cb017bac17bd)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:02:43.248530 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e80c0f4-3d79-41fa-af5c-e082a433d245 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:02:43.302193 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1165/2327] 10.222.0.65 () {60 vars in 1483 bytes} [Thu Oct 27 10:02:43 2022] PUT /identity/v3/projects/88b9eda8d1724429b8856ce88f274d97/users/22fd943b05b34c11937acb11ceda5ba6/roles/43543ce1450245af9661cb017bac17bd => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 10:02:43.307284 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbd734d-5c9d-45a3-8318-f085620db2c2 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:02:43.307744 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbd734d-5c9d-45a3-8318-f085620db2c2 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:02:43.307843 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbd734d-5c9d-45a3-8318-f085620db2c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:02:43.328119 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-9dbd734d-5c9d-45a3-8318-f085620db2c2 None None] MFA Rules not processed for user `b5065084bf664b99bdeac46067cb0f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 10:02:43.329362 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-9dbd734d-5c9d-45a3-8318-f085620db2c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 10:02:43.393155 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1163/2328] 10.222.0.65 () {58 vars in 958 bytes} [Thu Oct 27 10:02:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 10:02:43.403866 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e80c0f4-3d79-41fa-af5c-e082a433d245 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:02:43.406320 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-5e80c0f4-3d79-41fa-af5c-e082a433d245 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 10:02:43.467418 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e80c0f4-3d79-41fa-af5c-e082a433d245 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:02:43.471167 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb43f88-62a0-48a4-b0c0-e836ae1620fe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6191cc41efa74f46b49022cf387f7a4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc2e3a7a1bcc480891c0b433291c00b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:02:43.471783 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb43f88-62a0-48a4-b0c0-e836ae1620fe service neutron] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:02:43.472064 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb43f88-62a0-48a4-b0c0-e836ae1620fe service neutron] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:02:43.472344 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb43f88-62a0-48a4-b0c0-e836ae1620fe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:02:43.482000 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb43f88-62a0-48a4-b0c0-e836ae1620fe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:02:43.483464 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb43f88-62a0-48a4-b0c0-e836ae1620fe service neutron] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:02:43.493187 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1166/2329] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Oct 27 10:02:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 10:02:44.170607 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbd734d-5c9d-45a3-8318-f085620db2c2 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:02:44.180938 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbd734d-5c9d-45a3-8318-f085620db2c2 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:02:44.187447 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26991026-3d1d-47f8-9e99-84caa94519e6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6191cc41efa74f46b49022cf387f7a4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc2e3a7a1bcc480891c0b433291c00b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:02:44.187447 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26991026-3d1d-47f8-9e99-84caa94519e6 service neutron] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:02:44.187447 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26991026-3d1d-47f8-9e99-84caa94519e6 service neutron] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:02:44.187447 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26991026-3d1d-47f8-9e99-84caa94519e6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:02:44.189822 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-26991026-3d1d-47f8-9e99-84caa94519e6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 10:02:44.216223 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26991026-3d1d-47f8-9e99-84caa94519e6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:02:44.217728 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26991026-3d1d-47f8-9e99-84caa94519e6 service neutron] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:02:44.229452 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1164/2330] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Oct 27 10:02:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 10:02:44.932984 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea9c389-2602-41ee-bb90-e1b6251221e2 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:02:44.933878 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea9c389-2602-41ee-bb90-e1b6251221e2 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:02:44.934325 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea9c389-2602-41ee-bb90-e1b6251221e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:02:44.975920 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-7ea9c389-2602-41ee-bb90-e1b6251221e2 None None] MFA Rules not processed for user `22fd943b05b34c11937acb11ceda5ba6`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 10:02:44.977558 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-7ea9c389-2602-41ee-bb90-e1b6251221e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 10:02:45.013858 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:02:45.058003 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1167/2331] 10.222.0.65 () {58 vars in 958 bytes} [Thu Oct 27 10:02:44 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 10:02:45.062846 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26991026-3d1d-47f8-9e99-84caa94519e6 service neutron] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:02:45.073425 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26991026-3d1d-47f8-9e99-84caa94519e6 service neutron] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:02:45.078468 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ce89c3-d5e6-420b-b4ba-0690fe751f4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:02:45.079104 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ce89c3-d5e6-420b-b4ba-0690fe751f4f admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:02:45.079385 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ce89c3-d5e6-420b-b4ba-0690fe751f4f admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:02:45.079654 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ce89c3-d5e6-420b-b4ba-0690fe751f4f admin admin] PATH_INFO: `/v3/projects` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:02:45.080285 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ce89c3-d5e6-420b-b4ba-0690fe751f4f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:02:45.082465 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ce89c3-d5e6-420b-b4ba-0690fe751f4f admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:02:45.151664 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1165/2332] 10.222.0.65 () {60 vars in 1153 bytes} [Thu Oct 27 10:02:45 2022] POST /identity/v3/projects => generated 373 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 10:02:45.152926 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea9c389-2602-41ee-bb90-e1b6251221e2 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:02:45.164284 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea9c389-2602-41ee-bb90-e1b6251221e2 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:02:45.224218 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647493d8-663d-4c6c-9a6c-f6f7f77b2aec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:02:45.224833 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647493d8-663d-4c6c-9a6c-f6f7f77b2aec admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:02:45.225118 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647493d8-663d-4c6c-9a6c-f6f7f77b2aec admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:02:45.225400 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647493d8-663d-4c6c-9a6c-f6f7f77b2aec admin admin] PATH_INFO: `/v3/users` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:02:45.226032 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647493d8-663d-4c6c-9a6c-f6f7f77b2aec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:02:45.228149 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647493d8-663d-4c6c-9a6c-f6f7f77b2aec admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:02:45.331542 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1168/2333] 10.222.0.65 () {60 vars in 1144 bytes} [Thu Oct 27 10:02:45 2022] POST /identity/v3/users => generated 293 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 10:02:45.335690 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ce89c3-d5e6-420b-b4ba-0690fe751f4f admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:02:45.347183 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ce89c3-d5e6-420b-b4ba-0690fe751f4f admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:02:45.351999 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0aa4a6-aedb-48eb-a7ef-8c19a1e00aab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:02:45.352654 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0aa4a6-aedb-48eb-a7ef-8c19a1e00aab admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:02:45.356225 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0aa4a6-aedb-48eb-a7ef-8c19a1e00aab admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:02:45.356225 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0aa4a6-aedb-48eb-a7ef-8c19a1e00aab admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:02:45.356225 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0aa4a6-aedb-48eb-a7ef-8c19a1e00aab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:02:45.356225 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0aa4a6-aedb-48eb-a7ef-8c19a1e00aab admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:02:45.357892 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:02:45.371039 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1166/2334] 10.222.0.65 () {58 vars in 1122 bytes} [Thu Oct 27 10:02:45 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 10:02:45.372556 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647493d8-663d-4c6c-9a6c-f6f7f77b2aec admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:02:45.384839 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647493d8-663d-4c6c-9a6c-f6f7f77b2aec admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:02:45.396027 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cb6196-5a91-4e69-ac54-c6f918325182 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:02:45.396743 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cb6196-5a91-4e69-ac54-c6f918325182 admin admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:02:45.397035 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cb6196-5a91-4e69-ac54-c6f918325182 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:02:45.397312 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cb6196-5a91-4e69-ac54-c6f918325182 admin admin] PATH_INFO: `/v3/projects/8df56fffe31640ab86b2ade27187ad9b/users/24f6b5941cf94f398d68aa01cbec5d7b/roles/6ad17b9f9dea4b66ab2da3677d7e715d` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:02:45.417218 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59cb6196-5a91-4e69-ac54-c6f918325182 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8df56fffe31640ab86b2ade27187ad9b, user_id=24f6b5941cf94f398d68aa01cbec5d7b, role_id=6ad17b9f9dea4b66ab2da3677d7e715d)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:02:45.420603 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59cb6196-5a91-4e69-ac54-c6f918325182 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:02:45.509436 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1169/2335] 10.222.0.65 () {60 vars in 1483 bytes} [Thu Oct 27 10:02:45 2022] PUT /identity/v3/projects/8df56fffe31640ab86b2ade27187ad9b/users/24f6b5941cf94f398d68aa01cbec5d7b/roles/6ad17b9f9dea4b66ab2da3677d7e715d => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 10:02:45.513637 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0aa4a6-aedb-48eb-a7ef-8c19a1e00aab admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:02:45.525750 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0aa4a6-aedb-48eb-a7ef-8c19a1e00aab admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:02:45.599499 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63246c65-c235-4646-9812-e97618330201 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:02:45.600113 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63246c65-c235-4646-9812-e97618330201 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:02:45.600484 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63246c65-c235-4646-9812-e97618330201 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:02:45.600769 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63246c65-c235-4646-9812-e97618330201 admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:02:45.601414 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63246c65-c235-4646-9812-e97618330201 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:02:45.603099 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63246c65-c235-4646-9812-e97618330201 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:02:45.614644 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1167/2336] 10.222.0.65 () {58 vars in 1122 bytes} [Thu Oct 27 10:02:45 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 10:02:45.618815 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cb6196-5a91-4e69-ac54-c6f918325182 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:02:45.631275 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cb6196-5a91-4e69-ac54-c6f918325182 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:02:45.637619 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7fb29e-839c-4289-9635-8f2938cdc26d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:02:45.638484 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7fb29e-839c-4289-9635-8f2938cdc26d admin admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:02:45.638885 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7fb29e-839c-4289-9635-8f2938cdc26d admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:02:45.639267 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7fb29e-839c-4289-9635-8f2938cdc26d admin admin] PATH_INFO: `/v3/projects/8df56fffe31640ab86b2ade27187ad9b/users/24f6b5941cf94f398d68aa01cbec5d7b/roles/6ad17b9f9dea4b66ab2da3677d7e715d` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:02:45.641241 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7fb29e-839c-4289-9635-8f2938cdc26d admin admin] RBAC: Authorizing `identity:create_grant(project_id=8df56fffe31640ab86b2ade27187ad9b, user_id=24f6b5941cf94f398d68aa01cbec5d7b, role_id=6ad17b9f9dea4b66ab2da3677d7e715d)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:02:45.644011 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7fb29e-839c-4289-9635-8f2938cdc26d admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:02:45.655573 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1170/2337] 10.222.0.65 () {60 vars in 1483 bytes} [Thu Oct 27 10:02:45 2022] PUT /identity/v3/projects/8df56fffe31640ab86b2ade27187ad9b/users/24f6b5941cf94f398d68aa01cbec5d7b/roles/6ad17b9f9dea4b66ab2da3677d7e715d => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 10:02:47.509306 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416602b3-368a-4e85-bef7-2d483fdd911c None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:02:47.510312 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416602b3-368a-4e85-bef7-2d483fdd911c None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:02:47.510775 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416602b3-368a-4e85-bef7-2d483fdd911c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:02:47.543818 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-416602b3-368a-4e85-bef7-2d483fdd911c None None] MFA Rules not processed for user `24f6b5941cf94f398d68aa01cbec5d7b`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 10:02:47.546090 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-416602b3-368a-4e85-bef7-2d483fdd911c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 10:02:47.633652 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1168/2338] 10.222.0.65 () {58 vars in 958 bytes} [Thu Oct 27 10:02:47 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 10:02:47.644934 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffecd274-2fcc-4b38-8186-e99ee4e22874 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:02:47.645502 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffecd274-2fcc-4b38-8186-e99ee4e22874 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:02:47.645502 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffecd274-2fcc-4b38-8186-e99ee4e22874 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:02:47.673670 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-ffecd274-2fcc-4b38-8186-e99ee4e22874 None None] MFA Rules not processed for user `22fd943b05b34c11937acb11ceda5ba6`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 10:02:47.675135 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-ffecd274-2fcc-4b38-8186-e99ee4e22874 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 10:02:47.748679 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1171/2339] 10.222.0.65 () {58 vars in 958 bytes} [Thu Oct 27 10:02:47 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 10:02:47.760191 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416602b3-368a-4e85-bef7-2d483fdd911c None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:02:47.761579 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-416602b3-368a-4e85-bef7-2d483fdd911c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 10:02:47.841496 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416602b3-368a-4e85-bef7-2d483fdd911c None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:02:47.848167 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d115a3d9-bdde-44e7-910d-624b4d6b07f3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd0d23ef039d4f1591a589d302ef165f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc2e3a7a1bcc480891c0b433291c00b1', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:02:47.848856 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d115a3d9-bdde-44e7-910d-624b4d6b07f3 service nova] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:02:47.849140 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d115a3d9-bdde-44e7-910d-624b4d6b07f3 service nova] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:02:47.849418 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d115a3d9-bdde-44e7-910d-624b4d6b07f3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:02:47.858645 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d115a3d9-bdde-44e7-910d-624b4d6b07f3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:02:47.860253 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d115a3d9-bdde-44e7-910d-624b4d6b07f3 service nova] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:02:47.869854 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1169/2340] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Oct 27 10:02:47 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 10:02:49.087710 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffecd274-2fcc-4b38-8186-e99ee4e22874 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:02:49.089246 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-ffecd274-2fcc-4b38-8186-e99ee4e22874 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 10:02:49.124591 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:02:49.160855 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffecd274-2fcc-4b38-8186-e99ee4e22874 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:02:49.165956 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45ba8f8-1252-437e-bb95-249fe5309072 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:02:49.168859 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45ba8f8-1252-437e-bb95-249fe5309072 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:02:49.169771 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45ba8f8-1252-437e-bb95-249fe5309072 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:02:49.170147 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45ba8f8-1252-437e-bb95-249fe5309072 admin admin] PATH_INFO: `/v3/users/c46fe9f4b4db4dcb981c5a1a2cc5f463` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:02:49.185868 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45ba8f8-1252-437e-bb95-249fe5309072 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c46fe9f4b4db4dcb981c5a1a2cc5f463)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:02:49.187895 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45ba8f8-1252-437e-bb95-249fe5309072 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:02:49.397618 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-b45ba8f8-1252-437e-bb95-249fe5309072 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c46fe9f4b4db4dcb981c5a1a2cc5f463'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:02:49.413508 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-b45ba8f8-1252-437e-bb95-249fe5309072 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c46fe9f4b4db4dcb981c5a1a2cc5f463'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:02:49.414278 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-b45ba8f8-1252-437e-bb95-249fe5309072 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c46fe9f4b4db4dcb981c5a1a2cc5f463'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:02:49.422477 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-b45ba8f8-1252-437e-bb95-249fe5309072 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c46fe9f4b4db4dcb981c5a1a2cc5f463'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:02:49.536007 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-b45ba8f8-1252-437e-bb95-249fe5309072 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c46fe9f4b4db4dcb981c5a1a2cc5f463'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:02:49.544041 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1172/2341] 10.222.0.65 () {58 vars in 1224 bytes} [Thu Oct 27 10:02:49 2022] DELETE /identity/v3/users/c46fe9f4b4db4dcb981c5a1a2cc5f463 => generated 0 bytes in 457 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 10:02:49.757853 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d115a3d9-bdde-44e7-910d-624b4d6b07f3 service nova] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:02:49.759355 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-d115a3d9-bdde-44e7-910d-624b4d6b07f3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 10:02:49.768490 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:02:49.774331 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d115a3d9-bdde-44e7-910d-624b4d6b07f3 service nova] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:02:49.833207 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18eed0c-7f4d-43c0-8dd4-7295e55fdb1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:02:49.833894 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18eed0c-7f4d-43c0-8dd4-7295e55fdb1e admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:02:49.834179 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18eed0c-7f4d-43c0-8dd4-7295e55fdb1e admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:02:49.834456 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18eed0c-7f4d-43c0-8dd4-7295e55fdb1e admin admin] PATH_INFO: `/v3/users/2a71dc8b39ac49ab8fd730c4f7f073ae` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:02:49.835682 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18eed0c-7f4d-43c0-8dd4-7295e55fdb1e admin admin] RBAC: Authorizing `identity:delete_user(user_id=2a71dc8b39ac49ab8fd730c4f7f073ae)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:02:49.846374 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18eed0c-7f4d-43c0-8dd4-7295e55fdb1e admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:02:49.851928 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45ba8f8-1252-437e-bb95-249fe5309072 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:02:49.853441 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-b45ba8f8-1252-437e-bb95-249fe5309072 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 10:02:49.872320 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45ba8f8-1252-437e-bb95-249fe5309072 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:02:49.874811 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf43687-3430-4b00-8476-b90fbc8ea765 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:02:49.875563 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf43687-3430-4b00-8476-b90fbc8ea765 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:02:49.875849 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf43687-3430-4b00-8476-b90fbc8ea765 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:02:49.876134 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf43687-3430-4b00-8476-b90fbc8ea765 admin admin] PATH_INFO: `/v3/projects/a34bb5aa40d94208a1416eab1fc20f2f` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:02:49.889540 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf43687-3430-4b00-8476-b90fbc8ea765 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a34bb5aa40d94208a1416eab1fc20f2f)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:02:49.891935 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf43687-3430-4b00-8476-b90fbc8ea765 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:02:50.099207 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-fcf43687-3430-4b00-8476-b90fbc8ea765 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a34bb5aa40d94208a1416eab1fc20f2f', 'request_id': 'req-fcf43687-3430-4b00-8476-b90fbc8ea765'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:02:50.099853 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-b18eed0c-7f4d-43c0-8dd4-7295e55fdb1e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2a71dc8b39ac49ab8fd730c4f7f073ae'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:02:50.100688 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-b18eed0c-7f4d-43c0-8dd4-7295e55fdb1e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2a71dc8b39ac49ab8fd730c4f7f073ae'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:02:50.108927 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-b18eed0c-7f4d-43c0-8dd4-7295e55fdb1e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2a71dc8b39ac49ab8fd730c4f7f073ae'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:02:50.109587 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-b18eed0c-7f4d-43c0-8dd4-7295e55fdb1e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2a71dc8b39ac49ab8fd730c4f7f073ae'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:02:50.121656 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-b18eed0c-7f4d-43c0-8dd4-7295e55fdb1e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2a71dc8b39ac49ab8fd730c4f7f073ae'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:02:50.187271 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-fcf43687-3430-4b00-8476-b90fbc8ea765 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a34bb5aa40d94208a1416eab1fc20f2f', 'request_id': 'req-fcf43687-3430-4b00-8476-b90fbc8ea765'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:02:50.193793 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-fcf43687-3430-4b00-8476-b90fbc8ea765 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a34bb5aa40d94208a1416eab1fc20f2f', 'request_id': 'req-fcf43687-3430-4b00-8476-b90fbc8ea765'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:02:50.205854 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-fcf43687-3430-4b00-8476-b90fbc8ea765 admin admin] The token cache is being invalidate because project a34bb5aa40d94208a1416eab1fc20f2f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 10:02:50.206147 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-fcf43687-3430-4b00-8476-b90fbc8ea765 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:02:50.207093 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-fcf43687-3430-4b00-8476-b90fbc8ea765 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:02:50.208577 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1173/2342] 10.222.0.65 () {58 vars in 1233 bytes} [Thu Oct 27 10:02:49 2022] DELETE /identity/v3/projects/a34bb5aa40d94208a1416eab1fc20f2f => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 10:02:50.213439 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4a94de-f9e5-412d-9c4f-ddde637e09f2 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:02:50.213754 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4a94de-f9e5-412d-9c4f-ddde637e09f2 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:02:50.214035 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4a94de-f9e5-412d-9c4f-ddde637e09f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:02:50.234814 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-1a4a94de-f9e5-412d-9c4f-ddde637e09f2 None None] MFA Rules not processed for user `b5065084bf664b99bdeac46067cb0f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 10:02:50.236036 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-1a4a94de-f9e5-412d-9c4f-ddde637e09f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 10:02:50.240271 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:02:50.285632 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1170/2343] 10.222.0.65 () {58 vars in 1224 bytes} [Thu Oct 27 10:02:49 2022] DELETE /identity/v3/users/2a71dc8b39ac49ab8fd730c4f7f073ae => generated 0 bytes in 528 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 10:02:50.289974 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca91f2f-31c6-4241-a540-4b331e2ec8bb None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:02:50.290259 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca91f2f-31c6-4241-a540-4b331e2ec8bb None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:02:50.290555 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca91f2f-31c6-4241-a540-4b331e2ec8bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:02:50.301404 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1174/2344] 10.222.0.65 () {58 vars in 958 bytes} [Thu Oct 27 10:02:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 10:02:50.309486 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-dca91f2f-31c6-4241-a540-4b331e2ec8bb None None] MFA Rules not processed for user `b5065084bf664b99bdeac46067cb0f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 10:02:50.310966 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-dca91f2f-31c6-4241-a540-4b331e2ec8bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 10:02:50.316741 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46367371-4cae-4440-9da7-2d95edf47b8c None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:02:50.317060 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46367371-4cae-4440-9da7-2d95edf47b8c None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:02:50.317339 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46367371-4cae-4440-9da7-2d95edf47b8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:02:50.339329 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-46367371-4cae-4440-9da7-2d95edf47b8c None None] MFA Rules not processed for user `b5065084bf664b99bdeac46067cb0f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 10:02:50.340532 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-46367371-4cae-4440-9da7-2d95edf47b8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 10:02:50.378340 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1171/2345] 10.222.0.65 () {58 vars in 958 bytes} [Thu Oct 27 10:02:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 10:02:50.390601 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca91f2f-31c6-4241-a540-4b331e2ec8bb None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:02:50.394316 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-dca91f2f-31c6-4241-a540-4b331e2ec8bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 10:02:50.419255 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1175/2346] 10.222.0.65 () {58 vars in 958 bytes} [Thu Oct 27 10:02:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 10:02:50.423627 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:02:50.424537 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46367371-4cae-4440-9da7-2d95edf47b8c None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:02:50.434450 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46367371-4cae-4440-9da7-2d95edf47b8c None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:02:50.439539 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d2eaee-9bdb-4364-9538-175fe40b35e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:02:50.440151 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d2eaee-9bdb-4364-9538-175fe40b35e3 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:02:50.440818 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d2eaee-9bdb-4364-9538-175fe40b35e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:02:50.443826 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d2eaee-9bdb-4364-9538-175fe40b35e3 admin admin] PATH_INFO: `/v3/domains` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:02:50.443826 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d2eaee-9bdb-4364-9538-175fe40b35e3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 10:02:50.443826 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d2eaee-9bdb-4364-9538-175fe40b35e3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:02:50.444175 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d2eaee-9bdb-4364-9538-175fe40b35e3 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:02:50.459406 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1176/2347] 10.222.0.65 () {58 vars in 1153 bytes} [Thu Oct 27 10:02:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 10:02:50.460712 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca91f2f-31c6-4241-a540-4b331e2ec8bb None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:02:50.463633 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d2eaee-9bdb-4364-9538-175fe40b35e3 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:02:50.464863 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95cf84d-3a2c-49a2-8048-a4d6f062f943 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6191cc41efa74f46b49022cf387f7a4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc2e3a7a1bcc480891c0b433291c00b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:02:50.465553 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95cf84d-3a2c-49a2-8048-a4d6f062f943 service neutron] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:02:50.465999 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95cf84d-3a2c-49a2-8048-a4d6f062f943 service neutron] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:02:50.466473 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95cf84d-3a2c-49a2-8048-a4d6f062f943 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:02:50.474288 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d2eaee-9bdb-4364-9538-175fe40b35e3 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:02:50.476412 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95cf84d-3a2c-49a2-8048-a4d6f062f943 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:02:50.478149 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95cf84d-3a2c-49a2-8048-a4d6f062f943 service neutron] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:02:50.479163 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8341896-eabc-4e1f-823a-c5f4a114d223 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:02:50.479759 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8341896-eabc-4e1f-823a-c5f4a114d223 admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:02:50.480038 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8341896-eabc-4e1f-823a-c5f4a114d223 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:02:50.480312 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8341896-eabc-4e1f-823a-c5f4a114d223 admin admin] PATH_INFO: `/v3/projects` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:02:50.480931 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8341896-eabc-4e1f-823a-c5f4a114d223 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:02:50.483510 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8341896-eabc-4e1f-823a-c5f4a114d223 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:02:50.489370 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1172/2348] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Oct 27 10:02:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 10:02:50.563847 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1177/2349] 10.222.0.65 () {60 vars in 1153 bytes} [Thu Oct 27 10:02:50 2022] POST /identity/v3/projects => generated 405 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 10:02:50.568194 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95cf84d-3a2c-49a2-8048-a4d6f062f943 service neutron] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:02:50.580469 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95cf84d-3a2c-49a2-8048-a4d6f062f943 service neutron] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:02:50.639509 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09c39c9-67b3-4da9-9c31-de7ea0d36bc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:02:50.640073 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09c39c9-67b3-4da9-9c31-de7ea0d36bc3 admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:02:50.640356 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09c39c9-67b3-4da9-9c31-de7ea0d36bc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:02:50.640627 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09c39c9-67b3-4da9-9c31-de7ea0d36bc3 admin admin] PATH_INFO: `/v3/users` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:02:50.641246 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09c39c9-67b3-4da9-9c31-de7ea0d36bc3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:02:50.643369 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09c39c9-67b3-4da9-9c31-de7ea0d36bc3 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:02:50.771221 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1173/2350] 10.222.0.65 () {60 vars in 1144 bytes} [Thu Oct 27 10:02:50 2022] POST /identity/v3/users => generated 303 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 10:02:50.775509 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8341896-eabc-4e1f-823a-c5f4a114d223 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:02:50.789569 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8341896-eabc-4e1f-823a-c5f4a114d223 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:02:50.795308 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d291e82-7ebd-4813-92bc-553c0af12049 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:02:50.796174 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d291e82-7ebd-4813-92bc-553c0af12049 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:02:50.796504 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d291e82-7ebd-4813-92bc-553c0af12049 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:02:50.796752 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d291e82-7ebd-4813-92bc-553c0af12049 admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:02:50.797558 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d291e82-7ebd-4813-92bc-553c0af12049 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:02:50.799123 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d291e82-7ebd-4813-92bc-553c0af12049 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:02:50.813376 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1178/2351] 10.222.0.65 () {58 vars in 1122 bytes} [Thu Oct 27 10:02:50 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 10:02:50.815097 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09c39c9-67b3-4da9-9c31-de7ea0d36bc3 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:02:50.826323 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09c39c9-67b3-4da9-9c31-de7ea0d36bc3 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:02:50.832062 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3469593a-9899-4b2f-8d5e-180ab7ccd300 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:02:50.832676 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3469593a-9899-4b2f-8d5e-180ab7ccd300 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:02:50.832960 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3469593a-9899-4b2f-8d5e-180ab7ccd300 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:02:50.833237 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3469593a-9899-4b2f-8d5e-180ab7ccd300 admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:02:50.834022 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3469593a-9899-4b2f-8d5e-180ab7ccd300 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:02:50.835687 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3469593a-9899-4b2f-8d5e-180ab7ccd300 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:02:50.847217 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1174/2352] 10.222.0.65 () {58 vars in 1122 bytes} [Thu Oct 27 10:02:50 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 10:02:50.851655 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d291e82-7ebd-4813-92bc-553c0af12049 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:02:50.863540 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d291e82-7ebd-4813-92bc-553c0af12049 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:02:50.868587 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6326a2-a4cd-4468-a26e-e861ed5881cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:02:50.869575 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6326a2-a4cd-4468-a26e-e861ed5881cb admin admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:02:50.869575 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6326a2-a4cd-4468-a26e-e861ed5881cb admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:02:50.869788 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6326a2-a4cd-4468-a26e-e861ed5881cb admin admin] PATH_INFO: `/v3/projects/e0140596ef41445a96600088af79ed7e/users/b123bf9799244e6aa9b83796c6024113/roles/43543ce1450245af9661cb017bac17bd` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:02:50.891281 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6326a2-a4cd-4468-a26e-e861ed5881cb admin admin] RBAC: Authorizing `identity:create_grant(project_id=e0140596ef41445a96600088af79ed7e, user_id=b123bf9799244e6aa9b83796c6024113, role_id=43543ce1450245af9661cb017bac17bd)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:02:50.893977 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6326a2-a4cd-4468-a26e-e861ed5881cb admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:02:50.993276 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3469593a-9899-4b2f-8d5e-180ab7ccd300 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:02:50.995257 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-3469593a-9899-4b2f-8d5e-180ab7ccd300 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 10:02:51.010049 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3469593a-9899-4b2f-8d5e-180ab7ccd300 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:02:51.024141 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1179/2353] 10.222.0.65 () {60 vars in 1483 bytes} [Thu Oct 27 10:02:50 2022] PUT /identity/v3/projects/e0140596ef41445a96600088af79ed7e/users/b123bf9799244e6aa9b83796c6024113/roles/43543ce1450245af9661cb017bac17bd => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 10:02:51.030302 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ac5edd-5855-4394-9730-6113bd21c9fa None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:02:51.030499 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ac5edd-5855-4394-9730-6113bd21c9fa None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:02:51.030853 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ac5edd-5855-4394-9730-6113bd21c9fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:02:51.053501 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-c6ac5edd-5855-4394-9730-6113bd21c9fa None None] MFA Rules not processed for user `b5065084bf664b99bdeac46067cb0f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 10:02:51.054826 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-c6ac5edd-5855-4394-9730-6113bd21c9fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 10:02:51.071560 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d1105a-dca7-4693-b6f7-713e750ec52f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:02:51.072193 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d1105a-dca7-4693-b6f7-713e750ec52f admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:02:51.072544 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d1105a-dca7-4693-b6f7-713e750ec52f admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:02:51.072888 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d1105a-dca7-4693-b6f7-713e750ec52f admin admin] PATH_INFO: `/v3/projects/53d0716badea403bae3bed0bec15caa7` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:02:51.074051 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d1105a-dca7-4693-b6f7-713e750ec52f admin admin] RBAC: Authorizing `identity:delete_project(project_id=53d0716badea403bae3bed0bec15caa7)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:02:51.076110 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d1105a-dca7-4693-b6f7-713e750ec52f admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:02:51.093810 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:02:51.120695 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1180/2354] 10.222.0.65 () {58 vars in 958 bytes} [Thu Oct 27 10:02:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 10:02:51.131352 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ac5edd-5855-4394-9730-6113bd21c9fa None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:02:51.132767 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-c6ac5edd-5855-4394-9730-6113bd21c9fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 10:02:51.193840 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ac5edd-5855-4394-9730-6113bd21c9fa None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:02:51.198483 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1255ea-7e61-4caf-bba8-11e8fbee7142 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6191cc41efa74f46b49022cf387f7a4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc2e3a7a1bcc480891c0b433291c00b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:02:51.199473 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1255ea-7e61-4caf-bba8-11e8fbee7142 service neutron] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:02:51.200245 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1255ea-7e61-4caf-bba8-11e8fbee7142 service neutron] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:02:51.201436 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1255ea-7e61-4caf-bba8-11e8fbee7142 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:02:51.214079 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1255ea-7e61-4caf-bba8-11e8fbee7142 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:02:51.216975 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1255ea-7e61-4caf-bba8-11e8fbee7142 service neutron] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:02:51.218249 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=94,keystone:INSERT=3,keystone:DELETE=3 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:02:51.221545 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-e0d1105a-dca7-4693-b6f7-713e750ec52f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '53d0716badea403bae3bed0bec15caa7', 'request_id': 'req-e0d1105a-dca7-4693-b6f7-713e750ec52f'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:02:51.229069 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1181/2355] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Oct 27 10:02:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 10:02:51.229906 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-e0d1105a-dca7-4693-b6f7-713e750ec52f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '53d0716badea403bae3bed0bec15caa7', 'request_id': 'req-e0d1105a-dca7-4693-b6f7-713e750ec52f'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:02:51.299523 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-e0d1105a-dca7-4693-b6f7-713e750ec52f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '53d0716badea403bae3bed0bec15caa7', 'request_id': 'req-e0d1105a-dca7-4693-b6f7-713e750ec52f'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:02:51.311107 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-e0d1105a-dca7-4693-b6f7-713e750ec52f admin admin] The token cache is being invalidate because project 53d0716badea403bae3bed0bec15caa7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 10:02:51.311465 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-e0d1105a-dca7-4693-b6f7-713e750ec52f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:02:51.312139 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-e0d1105a-dca7-4693-b6f7-713e750ec52f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:02:51.313783 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1175/2356] 10.222.0.65 () {58 vars in 1233 bytes} [Thu Oct 27 10:02:50 2022] DELETE /identity/v3/projects/53d0716badea403bae3bed0bec15caa7 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 10:02:51.318010 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1255ea-7e61-4caf-bba8-11e8fbee7142 service neutron] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:02:51.329398 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1255ea-7e61-4caf-bba8-11e8fbee7142 service neutron] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:02:51.406761 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b2b87e-95e8-40a3-b85c-9afebb35bdb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:02:51.409628 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b2b87e-95e8-40a3-b85c-9afebb35bdb7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:02:51.409628 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b2b87e-95e8-40a3-b85c-9afebb35bdb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:02:51.409628 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b2b87e-95e8-40a3-b85c-9afebb35bdb7 admin admin] PATH_INFO: `/v3/users/8687db7d3dcc4a51b7d0b24448354ff3` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:02:51.409628 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b2b87e-95e8-40a3-b85c-9afebb35bdb7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8687db7d3dcc4a51b7d0b24448354ff3)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:02:51.411401 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b2b87e-95e8-40a3-b85c-9afebb35bdb7 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:02:51.677685 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-56b2b87e-95e8-40a3-b85c-9afebb35bdb7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8687db7d3dcc4a51b7d0b24448354ff3'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:02:51.690486 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-56b2b87e-95e8-40a3-b85c-9afebb35bdb7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8687db7d3dcc4a51b7d0b24448354ff3'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:02:51.691275 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-56b2b87e-95e8-40a3-b85c-9afebb35bdb7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8687db7d3dcc4a51b7d0b24448354ff3'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:02:51.698808 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-56b2b87e-95e8-40a3-b85c-9afebb35bdb7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8687db7d3dcc4a51b7d0b24448354ff3'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:02:51.770280 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-56b2b87e-95e8-40a3-b85c-9afebb35bdb7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8687db7d3dcc4a51b7d0b24448354ff3'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:02:51.777321 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1182/2357] 10.222.0.65 () {58 vars in 1224 bytes} [Thu Oct 27 10:02:51 2022] DELETE /identity/v3/users/8687db7d3dcc4a51b7d0b24448354ff3 => generated 0 bytes in 460 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 10:02:52.241323 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d1105a-dca7-4693-b6f7-713e750ec52f admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:02:52.243546 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-e0d1105a-dca7-4693-b6f7-713e750ec52f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 10:02:52.257145 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d1105a-dca7-4693-b6f7-713e750ec52f admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:02:52.329814 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db02ab8-d206-40b7-8e0b-17d2cd7fccbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:02:52.330727 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db02ab8-d206-40b7-8e0b-17d2cd7fccbc admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:02:52.331115 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db02ab8-d206-40b7-8e0b-17d2cd7fccbc admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:02:52.331802 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db02ab8-d206-40b7-8e0b-17d2cd7fccbc admin admin] PATH_INFO: `/v3/projects/8d2476db53634cc18b36b2846827c55e` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:02:52.333785 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db02ab8-d206-40b7-8e0b-17d2cd7fccbc admin admin] RBAC: Authorizing `identity:delete_project(project_id=8d2476db53634cc18b36b2846827c55e)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:02:52.335826 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db02ab8-d206-40b7-8e0b-17d2cd7fccbc admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:02:52.436479 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-2db02ab8-d206-40b7-8e0b-17d2cd7fccbc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8d2476db53634cc18b36b2846827c55e', 'request_id': 'req-2db02ab8-d206-40b7-8e0b-17d2cd7fccbc'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:02:52.444891 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-2db02ab8-d206-40b7-8e0b-17d2cd7fccbc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8d2476db53634cc18b36b2846827c55e', 'request_id': 'req-2db02ab8-d206-40b7-8e0b-17d2cd7fccbc'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:02:52.502252 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-2db02ab8-d206-40b7-8e0b-17d2cd7fccbc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8d2476db53634cc18b36b2846827c55e', 'request_id': 'req-2db02ab8-d206-40b7-8e0b-17d2cd7fccbc'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:02:52.514559 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-2db02ab8-d206-40b7-8e0b-17d2cd7fccbc admin admin] The token cache is being invalidate because project 8d2476db53634cc18b36b2846827c55e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 10:02:52.514859 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-2db02ab8-d206-40b7-8e0b-17d2cd7fccbc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:02:52.515539 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-2db02ab8-d206-40b7-8e0b-17d2cd7fccbc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:02:52.517423 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1176/2358] 10.222.0.65 () {58 vars in 1233 bytes} [Thu Oct 27 10:02:52 2022] DELETE /identity/v3/projects/8d2476db53634cc18b36b2846827c55e => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 10:02:52.522228 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f72d1d-cf07-4cb7-9fdc-aacb336ce2ff None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:02:52.522769 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f72d1d-cf07-4cb7-9fdc-aacb336ce2ff None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:02:52.522916 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f72d1d-cf07-4cb7-9fdc-aacb336ce2ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:02:52.532074 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:02:52.545770 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-37f72d1d-cf07-4cb7-9fdc-aacb336ce2ff None None] MFA Rules not processed for user `b5065084bf664b99bdeac46067cb0f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 10:02:52.547050 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-37f72d1d-cf07-4cb7-9fdc-aacb336ce2ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 10:02:52.618291 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef31376-6c12-43f1-baa9-2df9ddeafd1c None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:02:52.629945 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef31376-6c12-43f1-baa9-2df9ddeafd1c None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:02:52.630101 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1183/2359] 10.222.0.65 () {58 vars in 958 bytes} [Thu Oct 27 10:02:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 10:02:52.630207 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef31376-6c12-43f1-baa9-2df9ddeafd1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:02:52.640462 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-eef31376-6c12-43f1-baa9-2df9ddeafd1c None None] MFA Rules not processed for user `b5065084bf664b99bdeac46067cb0f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 10:02:52.641702 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-eef31376-6c12-43f1-baa9-2df9ddeafd1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 10:02:52.650211 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1177/2360] 10.222.0.65 () {58 vars in 958 bytes} [Thu Oct 27 10:02:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 10:02:52.655282 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f72d1d-cf07-4cb7-9fdc-aacb336ce2ff None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:02:52.666575 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f72d1d-cf07-4cb7-9fdc-aacb336ce2ff None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:02:52.671725 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266e49c9-b80f-4d2c-8f65-7d473d8f5136 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:02:52.672332 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266e49c9-b80f-4d2c-8f65-7d473d8f5136 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:02:52.672616 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266e49c9-b80f-4d2c-8f65-7d473d8f5136 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:02:52.672972 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266e49c9-b80f-4d2c-8f65-7d473d8f5136 admin admin] PATH_INFO: `/v3/domains` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:02:52.673671 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266e49c9-b80f-4d2c-8f65-7d473d8f5136 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 10:02:52.673954 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266e49c9-b80f-4d2c-8f65-7d473d8f5136 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:02:52.675584 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266e49c9-b80f-4d2c-8f65-7d473d8f5136 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:02:52.688801 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1184/2361] 10.222.0.65 () {58 vars in 1153 bytes} [Thu Oct 27 10:02:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 10:02:52.693648 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef31376-6c12-43f1-baa9-2df9ddeafd1c None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:02:52.704668 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef31376-6c12-43f1-baa9-2df9ddeafd1c None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:02:52.709781 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472bf72f-607a-4584-83ab-e29940c7e43a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:02:52.710380 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472bf72f-607a-4584-83ab-e29940c7e43a admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:02:52.710699 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472bf72f-607a-4584-83ab-e29940c7e43a admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:02:52.710993 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472bf72f-607a-4584-83ab-e29940c7e43a admin admin] PATH_INFO: `/v3/projects` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:02:52.711626 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472bf72f-607a-4584-83ab-e29940c7e43a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:02:52.713623 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472bf72f-607a-4584-83ab-e29940c7e43a admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:02:52.826928 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1178/2362] 10.222.0.65 () {60 vars in 1153 bytes} [Thu Oct 27 10:02:52 2022] POST /identity/v3/projects => generated 371 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 10:02:52.831090 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266e49c9-b80f-4d2c-8f65-7d473d8f5136 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:02:52.842868 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266e49c9-b80f-4d2c-8f65-7d473d8f5136 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:02:52.906424 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fa65fb-c804-45ac-80c2-b1c6ff691501 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:02:52.907274 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fa65fb-c804-45ac-80c2-b1c6ff691501 admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:02:52.907274 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fa65fb-c804-45ac-80c2-b1c6ff691501 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:02:52.907590 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fa65fb-c804-45ac-80c2-b1c6ff691501 admin admin] PATH_INFO: `/v3/users` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:02:52.908742 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54fa65fb-c804-45ac-80c2-b1c6ff691501 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:02:52.915268 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54fa65fb-c804-45ac-80c2-b1c6ff691501 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:02:52.961341 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7ad006-6ab6-49ae-82f5-aafb61c480cc None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:02:52.961629 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7ad006-6ab6-49ae-82f5-aafb61c480cc None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:02:52.961951 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7ad006-6ab6-49ae-82f5-aafb61c480cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:02:52.993740 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-5f7ad006-6ab6-49ae-82f5-aafb61c480cc None None] MFA Rules not processed for user `b123bf9799244e6aa9b83796c6024113`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 10:02:52.995016 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-5f7ad006-6ab6-49ae-82f5-aafb61c480cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 10:02:53.032836 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:DELETE=11,keystone:SELECT=86,keystone:INSERT=3 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:02:53.054447 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1185/2363] 10.222.0.65 () {60 vars in 1144 bytes} [Thu Oct 27 10:02:52 2022] POST /identity/v3/users => generated 286 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 10:02:53.055957 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fa65fb-c804-45ac-80c2-b1c6ff691501 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:02:53.067619 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fa65fb-c804-45ac-80c2-b1c6ff691501 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:02:53.079902 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8813ade0-cec1-4636-8deb-71dbcfb14d26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:02:53.079902 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8813ade0-cec1-4636-8deb-71dbcfb14d26 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:02:53.079902 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8813ade0-cec1-4636-8deb-71dbcfb14d26 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:02:53.079902 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8813ade0-cec1-4636-8deb-71dbcfb14d26 admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:02:53.080544 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8813ade0-cec1-4636-8deb-71dbcfb14d26 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:02:53.080544 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8813ade0-cec1-4636-8deb-71dbcfb14d26 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:02:53.098104 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1186/2364] 10.222.0.65 () {58 vars in 1122 bytes} [Thu Oct 27 10:02:53 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 10:02:53.099566 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8813ade0-cec1-4636-8deb-71dbcfb14d26 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:02:53.101050 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1179/2365] 10.222.0.65 () {58 vars in 958 bytes} [Thu Oct 27 10:02:52 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 10:02:53.106361 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7ad006-6ab6-49ae-82f5-aafb61c480cc None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:02:53.108375 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-5f7ad006-6ab6-49ae-82f5-aafb61c480cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 10:02:53.110212 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8813ade0-cec1-4636-8deb-71dbcfb14d26 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:02:53.118146 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b5df83-41f2-4803-89c9-46316819b5de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:02:53.118146 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b5df83-41f2-4803-89c9-46316819b5de admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:02:53.118146 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b5df83-41f2-4803-89c9-46316819b5de admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:02:53.118146 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b5df83-41f2-4803-89c9-46316819b5de admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:02:53.118565 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b5df83-41f2-4803-89c9-46316819b5de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:02:53.118565 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b5df83-41f2-4803-89c9-46316819b5de admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:02:53.129003 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7ad006-6ab6-49ae-82f5-aafb61c480cc None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:02:53.133602 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1187/2366] 10.222.0.65 () {58 vars in 1122 bytes} [Thu Oct 27 10:02:53 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 10:02:53.135192 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b5df83-41f2-4803-89c9-46316819b5de admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:02:53.139770 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21dad9d-bb09-4e2d-b783-2b00f1775242 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:02:53.140528 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21dad9d-bb09-4e2d-b783-2b00f1775242 admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:02:53.141005 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21dad9d-bb09-4e2d-b783-2b00f1775242 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:02:53.141383 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21dad9d-bb09-4e2d-b783-2b00f1775242 admin admin] PATH_INFO: `/v3/projects` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:02:53.142505 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21dad9d-bb09-4e2d-b783-2b00f1775242 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:02:53.144800 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21dad9d-bb09-4e2d-b783-2b00f1775242 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:02:53.148105 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b5df83-41f2-4803-89c9-46316819b5de admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:02:53.153611 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319832a1-3297-424a-bc0d-e1849ce79b7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:02:53.154221 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319832a1-3297-424a-bc0d-e1849ce79b7c admin admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:02:53.154582 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319832a1-3297-424a-bc0d-e1849ce79b7c admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:02:53.154824 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319832a1-3297-424a-bc0d-e1849ce79b7c admin admin] PATH_INFO: `/v3/projects/529d410167574507a8a292a7de4b9f8d/users/bdc61fad73524f48bf078b3ffb3ed4e8/roles/43543ce1450245af9661cb017bac17bd` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:02:53.171868 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319832a1-3297-424a-bc0d-e1849ce79b7c admin admin] RBAC: Authorizing `identity:create_grant(project_id=529d410167574507a8a292a7de4b9f8d, user_id=bdc61fad73524f48bf078b3ffb3ed4e8, role_id=43543ce1450245af9661cb017bac17bd)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:02:53.174952 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319832a1-3297-424a-bc0d-e1849ce79b7c admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:02:53.255554 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1180/2367] 10.222.0.65 () {60 vars in 1153 bytes} [Thu Oct 27 10:02:53 2022] POST /identity/v3/projects => generated 405 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 10:02:53.259721 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21dad9d-bb09-4e2d-b783-2b00f1775242 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:02:53.297630 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1188/2368] 10.222.0.65 () {60 vars in 1483 bytes} [Thu Oct 27 10:02:53 2022] PUT /identity/v3/projects/529d410167574507a8a292a7de4b9f8d/users/bdc61fad73524f48bf078b3ffb3ed4e8/roles/43543ce1450245af9661cb017bac17bd => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 10:02:53.308278 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845fd89a-3eac-4ab7-815d-e8fbd5f1f7c8 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:02:53.308476 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845fd89a-3eac-4ab7-815d-e8fbd5f1f7c8 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:02:53.308748 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845fd89a-3eac-4ab7-815d-e8fbd5f1f7c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:02:53.333323 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21dad9d-bb09-4e2d-b783-2b00f1775242 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:02:53.367417 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-845fd89a-3eac-4ab7-815d-e8fbd5f1f7c8 None None] MFA Rules not processed for user `bdc61fad73524f48bf078b3ffb3ed4e8`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 10:02:53.368946 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-845fd89a-3eac-4ab7-815d-e8fbd5f1f7c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 10:02:53.395199 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:02:53.427928 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f5cfba-daec-48d3-b1f4-ad128248d364 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:02:53.438199 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f5cfba-daec-48d3-b1f4-ad128248d364 admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:02:53.438199 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f5cfba-daec-48d3-b1f4-ad128248d364 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:02:53.438199 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f5cfba-daec-48d3-b1f4-ad128248d364 admin admin] PATH_INFO: `/v3/users` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:02:53.438199 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f5cfba-daec-48d3-b1f4-ad128248d364 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:02:53.438199 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f5cfba-daec-48d3-b1f4-ad128248d364 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:02:53.455984 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1189/2369] 10.222.0.65 () {58 vars in 958 bytes} [Thu Oct 27 10:02:53 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 10:02:53.467244 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845fd89a-3eac-4ab7-815d-e8fbd5f1f7c8 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:02:53.469109 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-845fd89a-3eac-4ab7-815d-e8fbd5f1f7c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 10:02:53.520491 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1181/2370] 10.222.0.65 () {60 vars in 1144 bytes} [Thu Oct 27 10:02:53 2022] POST /identity/v3/users => generated 309 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 10:02:53.521557 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f5cfba-daec-48d3-b1f4-ad128248d364 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:02:53.538039 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f5cfba-daec-48d3-b1f4-ad128248d364 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:02:53.543692 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a46181-4881-42e4-9a42-45c910b6d1b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:02:53.545247 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a46181-4881-42e4-9a42-45c910b6d1b5 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:02:53.547100 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a46181-4881-42e4-9a42-45c910b6d1b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:02:53.547643 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a46181-4881-42e4-9a42-45c910b6d1b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:02:53.549101 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a46181-4881-42e4-9a42-45c910b6d1b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:02:53.550342 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845fd89a-3eac-4ab7-815d-e8fbd5f1f7c8 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:02:53.552610 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a46181-4881-42e4-9a42-45c910b6d1b5 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:02:53.555101 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f3a7c9-7091-43b0-8aa7-860827d7583d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8e5d5f04c4741bb86ca4a0f667d4ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc2e3a7a1bcc480891c0b433291c00b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:02:53.556460 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f3a7c9-7091-43b0-8aa7-860827d7583d service cinder] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:02:53.556844 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f3a7c9-7091-43b0-8aa7-860827d7583d service cinder] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:02:53.557218 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f3a7c9-7091-43b0-8aa7-860827d7583d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:02:53.568466 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1182/2371] 10.222.0.65 () {58 vars in 1122 bytes} [Thu Oct 27 10:02:53 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 10:02:53.568659 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f3a7c9-7091-43b0-8aa7-860827d7583d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:02:53.569043 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f3a7c9-7091-43b0-8aa7-860827d7583d service cinder] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:02:53.569495 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a46181-4881-42e4-9a42-45c910b6d1b5 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:02:53.581564 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1190/2372] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Oct 27 10:02:53 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 10:02:53.583723 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a46181-4881-42e4-9a42-45c910b6d1b5 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:02:53.594303 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f20962e-adb6-4c1f-b6a6-54fd608b55ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:02:53.595033 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f20962e-adb6-4c1f-b6a6-54fd608b55ec admin admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:02:53.595315 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f20962e-adb6-4c1f-b6a6-54fd608b55ec admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:02:53.595599 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f20962e-adb6-4c1f-b6a6-54fd608b55ec admin admin] PATH_INFO: `/v3/projects/5824291cd14949b3a5a5d488cd7febef/users/7344ab63bb0c410fad6725d97fabcc38/roles/6ad17b9f9dea4b66ab2da3677d7e715d` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:02:53.606202 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f3a7c9-7091-43b0-8aa7-860827d7583d service cinder] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:02:53.613656 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f20962e-adb6-4c1f-b6a6-54fd608b55ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=5824291cd14949b3a5a5d488cd7febef, user_id=7344ab63bb0c410fad6725d97fabcc38, role_id=6ad17b9f9dea4b66ab2da3677d7e715d)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:02:53.616628 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f20962e-adb6-4c1f-b6a6-54fd608b55ec admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:02:53.618570 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f3a7c9-7091-43b0-8aa7-860827d7583d service cinder] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:02:53.624576 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2fec00-72eb-43a3-9ed5-5e5d8df72b51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:02:53.625245 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2fec00-72eb-43a3-9ed5-5e5d8df72b51 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:02:53.625526 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2fec00-72eb-43a3-9ed5-5e5d8df72b51 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:02:53.625870 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2fec00-72eb-43a3-9ed5-5e5d8df72b51 admin admin] PATH_INFO: `/v3/users/bdc61fad73524f48bf078b3ffb3ed4e8` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:02:53.627187 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2fec00-72eb-43a3-9ed5-5e5d8df72b51 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bdc61fad73524f48bf078b3ffb3ed4e8)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:02:53.630056 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2fec00-72eb-43a3-9ed5-5e5d8df72b51 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:02:53.680927 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1183/2373] 10.222.0.65 () {60 vars in 1483 bytes} [Thu Oct 27 10:02:53 2022] PUT /identity/v3/projects/5824291cd14949b3a5a5d488cd7febef/users/7344ab63bb0c410fad6725d97fabcc38/roles/6ad17b9f9dea4b66ab2da3677d7e715d => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 10:02:53.684571 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f20962e-adb6-4c1f-b6a6-54fd608b55ec admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:02:53.690498 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:02:53.755645 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f20962e-adb6-4c1f-b6a6-54fd608b55ec admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:02:53.762922 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266ff40a-aa26-4cf9-b391-6a13c736cffc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:02:53.763744 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266ff40a-aa26-4cf9-b391-6a13c736cffc admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:02:53.764048 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266ff40a-aa26-4cf9-b391-6a13c736cffc admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:02:53.764321 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266ff40a-aa26-4cf9-b391-6a13c736cffc admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:02:53.764997 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266ff40a-aa26-4cf9-b391-6a13c736cffc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:02:53.766702 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266ff40a-aa26-4cf9-b391-6a13c736cffc admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:02:53.778123 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1184/2374] 10.222.0.65 () {58 vars in 1122 bytes} [Thu Oct 27 10:02:53 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 10:02:53.783735 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266ff40a-aa26-4cf9-b391-6a13c736cffc admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:02:53.795465 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266ff40a-aa26-4cf9-b391-6a13c736cffc admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:02:53.801110 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d106a8-2228-4272-ae9f-551334e40208 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:02:53.801783 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d106a8-2228-4272-ae9f-551334e40208 admin admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:02:53.802065 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d106a8-2228-4272-ae9f-551334e40208 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:02:53.802348 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d106a8-2228-4272-ae9f-551334e40208 admin admin] PATH_INFO: `/v3/projects/5824291cd14949b3a5a5d488cd7febef/users/7344ab63bb0c410fad6725d97fabcc38/roles/6ad17b9f9dea4b66ab2da3677d7e715d` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:02:53.804649 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d106a8-2228-4272-ae9f-551334e40208 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5824291cd14949b3a5a5d488cd7febef, user_id=7344ab63bb0c410fad6725d97fabcc38, role_id=6ad17b9f9dea4b66ab2da3677d7e715d)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:02:53.807428 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d106a8-2228-4272-ae9f-551334e40208 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:02:53.812386 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-ae2fec00-72eb-43a3-9ed5-5e5d8df72b51 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bdc61fad73524f48bf078b3ffb3ed4e8'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:02:53.820038 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1185/2375] 10.222.0.65 () {60 vars in 1483 bytes} [Thu Oct 27 10:02:53 2022] PUT /identity/v3/projects/5824291cd14949b3a5a5d488cd7febef/users/7344ab63bb0c410fad6725d97fabcc38/roles/6ad17b9f9dea4b66ab2da3677d7e715d => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 10:02:53.830658 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-ae2fec00-72eb-43a3-9ed5-5e5d8df72b51 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bdc61fad73524f48bf078b3ffb3ed4e8'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:02:53.831837 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-ae2fec00-72eb-43a3-9ed5-5e5d8df72b51 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bdc61fad73524f48bf078b3ffb3ed4e8'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:02:53.847607 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-ae2fec00-72eb-43a3-9ed5-5e5d8df72b51 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bdc61fad73524f48bf078b3ffb3ed4e8'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:02:53.913001 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-ae2fec00-72eb-43a3-9ed5-5e5d8df72b51 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bdc61fad73524f48bf078b3ffb3ed4e8'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:02:53.921155 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1191/2376] 10.222.0.65 () {58 vars in 1224 bytes} [Thu Oct 27 10:02:53 2022] DELETE /identity/v3/users/bdc61fad73524f48bf078b3ffb3ed4e8 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 10:02:53.925995 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2845823c-ff4e-493f-9e1c-6ae915a6519f None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:02:53.926289 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2845823c-ff4e-493f-9e1c-6ae915a6519f None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:02:53.926602 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2845823c-ff4e-493f-9e1c-6ae915a6519f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:02:53.954789 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-2845823c-ff4e-493f-9e1c-6ae915a6519f None None] MFA Rules not processed for user `b5065084bf664b99bdeac46067cb0f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 10:02:53.956056 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-2845823c-ff4e-493f-9e1c-6ae915a6519f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 10:02:54.031151 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1186/2377] 10.222.0.65 () {58 vars in 958 bytes} [Thu Oct 27 10:02:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 10:02:54.041555 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2fec00-72eb-43a3-9ed5-5e5d8df72b51 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:02:54.043109 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-ae2fec00-72eb-43a3-9ed5-5e5d8df72b51 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 10:02:54.094624 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:02:54.123302 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2fec00-72eb-43a3-9ed5-5e5d8df72b51 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:02:54.128168 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b113ca8-3476-4daa-8370-4d0b58434b8d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6191cc41efa74f46b49022cf387f7a4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc2e3a7a1bcc480891c0b433291c00b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:02:54.130798 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b113ca8-3476-4daa-8370-4d0b58434b8d service neutron] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:02:54.130798 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b113ca8-3476-4daa-8370-4d0b58434b8d service neutron] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:02:54.131781 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b113ca8-3476-4daa-8370-4d0b58434b8d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:02:54.145784 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b113ca8-3476-4daa-8370-4d0b58434b8d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:02:54.147390 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b113ca8-3476-4daa-8370-4d0b58434b8d service neutron] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:02:54.160688 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1192/2378] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Oct 27 10:02:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 10:02:54.678103 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2845823c-ff4e-493f-9e1c-6ae915a6519f None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:02:54.679982 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-2845823c-ff4e-493f-9e1c-6ae915a6519f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 10:02:54.695137 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2845823c-ff4e-493f-9e1c-6ae915a6519f None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:02:54.704087 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f840e47f-c9d9-49d3-a9a7-cdf50c4ba150 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:02:54.704087 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f840e47f-c9d9-49d3-a9a7-cdf50c4ba150 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:02:54.704087 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f840e47f-c9d9-49d3-a9a7-cdf50c4ba150 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:02:54.704087 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f840e47f-c9d9-49d3-a9a7-cdf50c4ba150 admin admin] PATH_INFO: `/v3/projects/529d410167574507a8a292a7de4b9f8d` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:02:54.705220 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f840e47f-c9d9-49d3-a9a7-cdf50c4ba150 admin admin] RBAC: Authorizing `identity:delete_project(project_id=529d410167574507a8a292a7de4b9f8d)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:02:54.708835 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f840e47f-c9d9-49d3-a9a7-cdf50c4ba150 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:02:54.881272 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-f840e47f-c9d9-49d3-a9a7-cdf50c4ba150 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '529d410167574507a8a292a7de4b9f8d', 'request_id': 'req-f840e47f-c9d9-49d3-a9a7-cdf50c4ba150'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:02:54.888550 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-f840e47f-c9d9-49d3-a9a7-cdf50c4ba150 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '529d410167574507a8a292a7de4b9f8d', 'request_id': 'req-f840e47f-c9d9-49d3-a9a7-cdf50c4ba150'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:02:54.987337 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-f840e47f-c9d9-49d3-a9a7-cdf50c4ba150 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '529d410167574507a8a292a7de4b9f8d', 'request_id': 'req-f840e47f-c9d9-49d3-a9a7-cdf50c4ba150'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:02:55.000331 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-f840e47f-c9d9-49d3-a9a7-cdf50c4ba150 admin admin] The token cache is being invalidate because project 529d410167574507a8a292a7de4b9f8d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 10:02:55.000624 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-f840e47f-c9d9-49d3-a9a7-cdf50c4ba150 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:02:55.001277 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-f840e47f-c9d9-49d3-a9a7-cdf50c4ba150 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:02:55.002846 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1187/2379] 10.222.0.65 () {58 vars in 1233 bytes} [Thu Oct 27 10:02:54 2022] DELETE /identity/v3/projects/529d410167574507a8a292a7de4b9f8d => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 10:02:55.007592 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efd691a-6d30-4795-9ce4-401ee3f6f9ca None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:02:55.008063 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efd691a-6d30-4795-9ce4-401ee3f6f9ca None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:02:55.008186 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efd691a-6d30-4795-9ce4-401ee3f6f9ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:02:55.029345 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-1efd691a-6d30-4795-9ce4-401ee3f6f9ca None None] MFA Rules not processed for user `b5065084bf664b99bdeac46067cb0f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 10:02:55.030591 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-1efd691a-6d30-4795-9ce4-401ee3f6f9ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 10:02:55.091973 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1193/2380] 10.222.0.65 () {58 vars in 958 bytes} [Thu Oct 27 10:02:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 10:02:55.099791 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5237491f-ad46-4900-a48b-01a3e7c154de None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:02:55.100160 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5237491f-ad46-4900-a48b-01a3e7c154de None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:02:55.100432 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5237491f-ad46-4900-a48b-01a3e7c154de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:02:55.120521 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-5237491f-ad46-4900-a48b-01a3e7c154de None None] MFA Rules not processed for user `b5065084bf664b99bdeac46067cb0f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 10:02:55.122151 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-5237491f-ad46-4900-a48b-01a3e7c154de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 10:02:55.131300 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1188/2381] 10.222.0.65 () {58 vars in 958 bytes} [Thu Oct 27 10:02:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 10:02:55.135529 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efd691a-6d30-4795-9ce4-401ee3f6f9ca None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:02:55.148336 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efd691a-6d30-4795-9ce4-401ee3f6f9ca None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:02:55.153653 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f219e6-a1a2-4c0e-8f20-917b340af151 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:02:55.154484 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f219e6-a1a2-4c0e-8f20-917b340af151 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:02:55.154661 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f219e6-a1a2-4c0e-8f20-917b340af151 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:02:55.154946 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f219e6-a1a2-4c0e-8f20-917b340af151 admin admin] PATH_INFO: `/v3/domains` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:02:55.155725 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f219e6-a1a2-4c0e-8f20-917b340af151 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 10:02:55.156034 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f219e6-a1a2-4c0e-8f20-917b340af151 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:02:55.157714 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f219e6-a1a2-4c0e-8f20-917b340af151 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:02:55.171672 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1194/2382] 10.222.0.65 () {58 vars in 1153 bytes} [Thu Oct 27 10:02:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 10:02:55.175890 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5237491f-ad46-4900-a48b-01a3e7c154de None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:02:55.182012 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:02:55.186826 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5237491f-ad46-4900-a48b-01a3e7c154de None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:02:55.192266 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5dd51ea-fcd8-43b9-a999-caa37c04d4fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:02:55.192874 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dd51ea-fcd8-43b9-a999-caa37c04d4fb admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:02:55.193150 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dd51ea-fcd8-43b9-a999-caa37c04d4fb admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:02:55.193419 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dd51ea-fcd8-43b9-a999-caa37c04d4fb admin admin] PATH_INFO: `/v3/projects` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:02:55.194053 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5dd51ea-fcd8-43b9-a999-caa37c04d4fb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:02:55.195991 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5dd51ea-fcd8-43b9-a999-caa37c04d4fb admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:02:55.245780 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0865d084-07ed-4fa3-9a2c-1738443e5a4e None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:02:55.246097 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0865d084-07ed-4fa3-9a2c-1738443e5a4e None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:02:55.247031 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0865d084-07ed-4fa3-9a2c-1738443e5a4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:02:55.279588 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-0865d084-07ed-4fa3-9a2c-1738443e5a4e None None] MFA Rules not processed for user `7344ab63bb0c410fad6725d97fabcc38`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 10:02:55.280816 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-0865d084-07ed-4fa3-9a2c-1738443e5a4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 10:02:55.327258 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1189/2383] 10.222.0.65 () {60 vars in 1153 bytes} [Thu Oct 27 10:02:55 2022] POST /identity/v3/projects => generated 383 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 10:02:55.328672 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5dd51ea-fcd8-43b9-a999-caa37c04d4fb admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:02:55.358175 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1195/2384] 10.222.0.65 () {58 vars in 958 bytes} [Thu Oct 27 10:02:55 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 10:02:55.401990 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5dd51ea-fcd8-43b9-a999-caa37c04d4fb admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:02:55.407583 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db31494f-6528-4c5e-9820-007c5ac0e91a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:02:55.408204 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db31494f-6528-4c5e-9820-007c5ac0e91a admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:02:55.408484 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db31494f-6528-4c5e-9820-007c5ac0e91a admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:02:55.408749 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db31494f-6528-4c5e-9820-007c5ac0e91a admin admin] PATH_INFO: `/v3/users` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:02:55.409551 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db31494f-6528-4c5e-9820-007c5ac0e91a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:02:55.411541 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db31494f-6528-4c5e-9820-007c5ac0e91a admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:02:55.553769 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1190/2385] 10.222.0.65 () {60 vars in 1144 bytes} [Thu Oct 27 10:02:55 2022] POST /identity/v3/users => generated 292 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 10:02:55.558004 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0865d084-07ed-4fa3-9a2c-1738443e5a4e None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:02:55.569278 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0865d084-07ed-4fa3-9a2c-1738443e5a4e None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:02:55.574012 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68769c41-2d90-425a-b26a-fc4f39eeef61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:02:55.574662 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68769c41-2d90-425a-b26a-fc4f39eeef61 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:02:55.587139 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68769c41-2d90-425a-b26a-fc4f39eeef61 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:02:55.587139 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68769c41-2d90-425a-b26a-fc4f39eeef61 admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:02:55.587139 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68769c41-2d90-425a-b26a-fc4f39eeef61 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:02:55.587139 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68769c41-2d90-425a-b26a-fc4f39eeef61 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:02:55.589386 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1196/2386] 10.222.0.65 () {58 vars in 1122 bytes} [Thu Oct 27 10:02:55 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 10:02:55.594361 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db31494f-6528-4c5e-9820-007c5ac0e91a admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:02:55.604432 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db31494f-6528-4c5e-9820-007c5ac0e91a admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:02:55.609222 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718519b5-b8a2-4fe6-ae47-3b140bfa4576 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:02:55.609816 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718519b5-b8a2-4fe6-ae47-3b140bfa4576 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:02:55.610094 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718519b5-b8a2-4fe6-ae47-3b140bfa4576 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:02:55.610399 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718519b5-b8a2-4fe6-ae47-3b140bfa4576 admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:02:55.611100 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718519b5-b8a2-4fe6-ae47-3b140bfa4576 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:02:55.612688 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718519b5-b8a2-4fe6-ae47-3b140bfa4576 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:02:55.622748 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1191/2387] 10.222.0.65 () {58 vars in 1122 bytes} [Thu Oct 27 10:02:55 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 10:02:55.627339 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68769c41-2d90-425a-b26a-fc4f39eeef61 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:02:55.637564 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68769c41-2d90-425a-b26a-fc4f39eeef61 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:02:55.643425 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43727bcd-4b4d-411e-b7ac-e3c5cfb3ac4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:02:55.644110 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43727bcd-4b4d-411e-b7ac-e3c5cfb3ac4f admin admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:02:55.644505 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43727bcd-4b4d-411e-b7ac-e3c5cfb3ac4f admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:02:55.644734 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43727bcd-4b4d-411e-b7ac-e3c5cfb3ac4f admin admin] PATH_INFO: `/v3/projects/4730bad9e551457ba5e6c8f11555fe8a/users/7b7c7ff0054941378569d7138d597bd4/roles/43543ce1450245af9661cb017bac17bd` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:02:55.662096 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43727bcd-4b4d-411e-b7ac-e3c5cfb3ac4f admin admin] RBAC: Authorizing `identity:create_grant(project_id=4730bad9e551457ba5e6c8f11555fe8a, user_id=7b7c7ff0054941378569d7138d597bd4, role_id=43543ce1450245af9661cb017bac17bd)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:02:55.665025 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43727bcd-4b4d-411e-b7ac-e3c5cfb3ac4f admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:02:55.759541 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1197/2388] 10.222.0.65 () {60 vars in 1483 bytes} [Thu Oct 27 10:02:55 2022] PUT /identity/v3/projects/4730bad9e551457ba5e6c8f11555fe8a/users/7b7c7ff0054941378569d7138d597bd4/roles/43543ce1450245af9661cb017bac17bd => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 10:02:55.830442 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f039b87d-7b59-471b-95b4-45ad59c014f6 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:02:55.831055 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f039b87d-7b59-471b-95b4-45ad59c014f6 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:02:55.831055 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f039b87d-7b59-471b-95b4-45ad59c014f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:02:55.866387 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-f039b87d-7b59-471b-95b4-45ad59c014f6 None None] MFA Rules not processed for user `7b7c7ff0054941378569d7138d597bd4`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 10:02:55.868062 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-f039b87d-7b59-471b-95b4-45ad59c014f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 10:02:55.953037 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1192/2389] 10.222.0.65 () {58 vars in 958 bytes} [Thu Oct 27 10:02:55 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 10:02:55.964860 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43727bcd-4b4d-411e-b7ac-e3c5cfb3ac4f admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:02:55.967871 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-43727bcd-4b4d-411e-b7ac-e3c5cfb3ac4f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 10:02:55.991301 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:02:56.039936 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43727bcd-4b4d-411e-b7ac-e3c5cfb3ac4f admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:02:56.044402 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070dd127-a6cf-44a3-920b-217fe8b9c6f5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8e5d5f04c4741bb86ca4a0f667d4ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc2e3a7a1bcc480891c0b433291c00b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:02:56.045289 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070dd127-a6cf-44a3-920b-217fe8b9c6f5 service cinder] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:02:56.045835 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070dd127-a6cf-44a3-920b-217fe8b9c6f5 service cinder] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:02:56.046145 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070dd127-a6cf-44a3-920b-217fe8b9c6f5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:02:56.057683 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070dd127-a6cf-44a3-920b-217fe8b9c6f5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:02:56.059155 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070dd127-a6cf-44a3-920b-217fe8b9c6f5 service cinder] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:02:56.070337 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1198/2390] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Oct 27 10:02:55 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 10:02:57.012731 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f039b87d-7b59-471b-95b4-45ad59c014f6 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:02:57.015211 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-f039b87d-7b59-471b-95b4-45ad59c014f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 10:02:57.093906 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:02:57.110996 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f039b87d-7b59-471b-95b4-45ad59c014f6 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:02:57.117194 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797c3b32-e54e-42fc-8449-a47361bd1c48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:02:57.118013 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797c3b32-e54e-42fc-8449-a47361bd1c48 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:02:57.118398 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797c3b32-e54e-42fc-8449-a47361bd1c48 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:02:57.118946 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797c3b32-e54e-42fc-8449-a47361bd1c48 admin admin] PATH_INFO: `/v3/users/b123bf9799244e6aa9b83796c6024113` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:02:57.120630 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797c3b32-e54e-42fc-8449-a47361bd1c48 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b123bf9799244e6aa9b83796c6024113)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:02:57.123052 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797c3b32-e54e-42fc-8449-a47361bd1c48 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:02:57.349913 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-797c3b32-e54e-42fc-8449-a47361bd1c48 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b123bf9799244e6aa9b83796c6024113'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:02:57.350503 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-797c3b32-e54e-42fc-8449-a47361bd1c48 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b123bf9799244e6aa9b83796c6024113'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:02:57.357834 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-797c3b32-e54e-42fc-8449-a47361bd1c48 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b123bf9799244e6aa9b83796c6024113'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:02:57.358493 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-797c3b32-e54e-42fc-8449-a47361bd1c48 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b123bf9799244e6aa9b83796c6024113'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:02:57.371408 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-797c3b32-e54e-42fc-8449-a47361bd1c48 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b123bf9799244e6aa9b83796c6024113'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:02:57.457464 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1193/2391] 10.222.0.65 () {58 vars in 1224 bytes} [Thu Oct 27 10:02:57 2022] DELETE /identity/v3/users/b123bf9799244e6aa9b83796c6024113 => generated 0 bytes in 446 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 10:02:57.692905 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070dd127-a6cf-44a3-920b-217fe8b9c6f5 service cinder] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:02:57.705690 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070dd127-a6cf-44a3-920b-217fe8b9c6f5 service cinder] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:02:57.767249 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334f8d4c-4f55-492b-9308-90f01b4934c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:02:57.767880 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334f8d4c-4f55-492b-9308-90f01b4934c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:02:57.768159 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334f8d4c-4f55-492b-9308-90f01b4934c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:02:57.768434 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334f8d4c-4f55-492b-9308-90f01b4934c3 admin admin] PATH_INFO: `/v3/projects/e0140596ef41445a96600088af79ed7e` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:02:57.769590 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334f8d4c-4f55-492b-9308-90f01b4934c3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e0140596ef41445a96600088af79ed7e)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:02:57.771600 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334f8d4c-4f55-492b-9308-90f01b4934c3 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:02:57.903201 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-334f8d4c-4f55-492b-9308-90f01b4934c3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e0140596ef41445a96600088af79ed7e', 'request_id': 'req-334f8d4c-4f55-492b-9308-90f01b4934c3'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:02:57.975865 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-334f8d4c-4f55-492b-9308-90f01b4934c3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e0140596ef41445a96600088af79ed7e', 'request_id': 'req-334f8d4c-4f55-492b-9308-90f01b4934c3'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:02:57.983141 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-334f8d4c-4f55-492b-9308-90f01b4934c3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e0140596ef41445a96600088af79ed7e', 'request_id': 'req-334f8d4c-4f55-492b-9308-90f01b4934c3'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:02:57.995118 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-334f8d4c-4f55-492b-9308-90f01b4934c3 admin admin] The token cache is being invalidate because project e0140596ef41445a96600088af79ed7e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 10:02:57.995411 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-334f8d4c-4f55-492b-9308-90f01b4934c3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:02:57.996209 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-334f8d4c-4f55-492b-9308-90f01b4934c3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:02:57.998423 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1199/2392] 10.222.0.65 () {58 vars in 1233 bytes} [Thu Oct 27 10:02:57 2022] DELETE /identity/v3/projects/e0140596ef41445a96600088af79ed7e => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 10:02:58.002754 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797c3b32-e54e-42fc-8449-a47361bd1c48 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:02:58.004297 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-797c3b32-e54e-42fc-8449-a47361bd1c48 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 10:02:58.019910 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797c3b32-e54e-42fc-8449-a47361bd1c48 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:02:58.085324 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3dd8fb-4c14-4780-ae84-b3ef36fb02d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:02:58.085952 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3dd8fb-4c14-4780-ae84-b3ef36fb02d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:02:58.086232 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3dd8fb-4c14-4780-ae84-b3ef36fb02d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:02:58.086501 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3dd8fb-4c14-4780-ae84-b3ef36fb02d0 admin admin] PATH_INFO: `/v3/users/7344ab63bb0c410fad6725d97fabcc38` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:02:58.087644 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3dd8fb-4c14-4780-ae84-b3ef36fb02d0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7344ab63bb0c410fad6725d97fabcc38)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:02:58.089659 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3dd8fb-4c14-4780-ae84-b3ef36fb02d0 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:02:58.273501 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-eb3dd8fb-4c14-4780-ae84-b3ef36fb02d0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7344ab63bb0c410fad6725d97fabcc38'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:02:58.274219 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-eb3dd8fb-4c14-4780-ae84-b3ef36fb02d0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7344ab63bb0c410fad6725d97fabcc38'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:02:58.285756 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-eb3dd8fb-4c14-4780-ae84-b3ef36fb02d0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7344ab63bb0c410fad6725d97fabcc38'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:02:58.286611 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-eb3dd8fb-4c14-4780-ae84-b3ef36fb02d0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7344ab63bb0c410fad6725d97fabcc38'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:02:58.302854 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=80,keystone:DELETE=19,keystone:INSERT=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:02:58.305662 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-eb3dd8fb-4c14-4780-ae84-b3ef36fb02d0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7344ab63bb0c410fad6725d97fabcc38'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:02:58.410881 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1194/2393] 10.222.0.65 () {58 vars in 1224 bytes} [Thu Oct 27 10:02:58 2022] DELETE /identity/v3/users/7344ab63bb0c410fad6725d97fabcc38 => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 10:02:58.710148 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334f8d4c-4f55-492b-9308-90f01b4934c3 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:02:58.711702 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-334f8d4c-4f55-492b-9308-90f01b4934c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 10:02:58.725769 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334f8d4c-4f55-492b-9308-90f01b4934c3 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:02:58.777190 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:02:58.788033 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf039c6-9de2-4c57-80e0-6154667a2e27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:02:58.788908 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf039c6-9de2-4c57-80e0-6154667a2e27 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:02:58.789280 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf039c6-9de2-4c57-80e0-6154667a2e27 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:02:58.789636 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf039c6-9de2-4c57-80e0-6154667a2e27 admin admin] PATH_INFO: `/v3/projects/5824291cd14949b3a5a5d488cd7febef` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:02:58.790949 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf039c6-9de2-4c57-80e0-6154667a2e27 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5824291cd14949b3a5a5d488cd7febef)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:02:58.793631 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf039c6-9de2-4c57-80e0-6154667a2e27 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:02:58.919718 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-fbf039c6-9de2-4c57-80e0-6154667a2e27 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5824291cd14949b3a5a5d488cd7febef', 'request_id': 'req-fbf039c6-9de2-4c57-80e0-6154667a2e27'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:02:58.999776 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-fbf039c6-9de2-4c57-80e0-6154667a2e27 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5824291cd14949b3a5a5d488cd7febef', 'request_id': 'req-fbf039c6-9de2-4c57-80e0-6154667a2e27'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:02:59.009521 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-fbf039c6-9de2-4c57-80e0-6154667a2e27 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5824291cd14949b3a5a5d488cd7febef', 'request_id': 'req-fbf039c6-9de2-4c57-80e0-6154667a2e27'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:02:59.023795 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-fbf039c6-9de2-4c57-80e0-6154667a2e27 admin admin] The token cache is being invalidate because project 5824291cd14949b3a5a5d488cd7febef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 10:02:59.024091 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-fbf039c6-9de2-4c57-80e0-6154667a2e27 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:02:59.024836 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-fbf039c6-9de2-4c57-80e0-6154667a2e27 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:02:59.026387 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1200/2394] 10.222.0.65 () {58 vars in 1233 bytes} [Thu Oct 27 10:02:58 2022] DELETE /identity/v3/projects/5824291cd14949b3a5a5d488cd7febef => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 10:02:59.031669 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f630e9-280d-4848-97de-8094a3f5280c None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:02:59.032157 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f630e9-280d-4848-97de-8094a3f5280c None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:02:59.032246 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f630e9-280d-4848-97de-8094a3f5280c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:02:59.052847 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-77f630e9-280d-4848-97de-8094a3f5280c None None] MFA Rules not processed for user `b5065084bf664b99bdeac46067cb0f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 10:02:59.054115 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-77f630e9-280d-4848-97de-8094a3f5280c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 10:02:59.117810 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1195/2395] 10.222.0.65 () {58 vars in 958 bytes} [Thu Oct 27 10:02:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 10:02:59.126437 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc75f5c5-45e1-43e9-85fc-cc11937edda1 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:02:59.126757 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc75f5c5-45e1-43e9-85fc-cc11937edda1 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:02:59.127035 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc75f5c5-45e1-43e9-85fc-cc11937edda1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:02:59.148226 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-fc75f5c5-45e1-43e9-85fc-cc11937edda1 None None] MFA Rules not processed for user `b5065084bf664b99bdeac46067cb0f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 10:02:59.149447 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-fc75f5c5-45e1-43e9-85fc-cc11937edda1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 10:02:59.157522 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1201/2396] 10.222.0.65 () {58 vars in 958 bytes} [Thu Oct 27 10:02:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 10:02:59.161915 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f630e9-280d-4848-97de-8094a3f5280c None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:02:59.172345 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f630e9-280d-4848-97de-8094a3f5280c None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:02:59.177337 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7092018-e4c9-473c-ace9-de17420b0426 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:02:59.177936 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7092018-e4c9-473c-ace9-de17420b0426 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:02:59.178220 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7092018-e4c9-473c-ace9-de17420b0426 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:02:59.178493 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7092018-e4c9-473c-ace9-de17420b0426 admin admin] PATH_INFO: `/v3/domains` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:02:59.179177 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7092018-e4c9-473c-ace9-de17420b0426 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 10:02:59.179476 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7092018-e4c9-473c-ace9-de17420b0426 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:02:59.181135 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7092018-e4c9-473c-ace9-de17420b0426 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:02:59.194186 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1196/2397] 10.222.0.65 () {58 vars in 1153 bytes} [Thu Oct 27 10:02:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 10:02:59.198623 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc75f5c5-45e1-43e9-85fc-cc11937edda1 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:02:59.208507 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc75f5c5-45e1-43e9-85fc-cc11937edda1 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:02:59.213286 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06973dbc-cf02-4a28-a837-59578b5f3add admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:02:59.213885 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06973dbc-cf02-4a28-a837-59578b5f3add admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:02:59.214167 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06973dbc-cf02-4a28-a837-59578b5f3add admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:02:59.214481 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06973dbc-cf02-4a28-a837-59578b5f3add admin admin] PATH_INFO: `/v3/projects` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:02:59.215124 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06973dbc-cf02-4a28-a837-59578b5f3add admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:02:59.217171 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06973dbc-cf02-4a28-a837-59578b5f3add admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:02:59.361926 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1202/2398] 10.222.0.65 () {60 vars in 1153 bytes} [Thu Oct 27 10:02:59 2022] POST /identity/v3/projects => generated 385 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 10:02:59.366506 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7092018-e4c9-473c-ace9-de17420b0426 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:02:59.377432 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7092018-e4c9-473c-ace9-de17420b0426 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:02:59.436413 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a03ff2-c096-41ff-8031-179ef8eb3978 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:02:59.437017 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a03ff2-c096-41ff-8031-179ef8eb3978 admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:02:59.437300 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a03ff2-c096-41ff-8031-179ef8eb3978 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:02:59.437574 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a03ff2-c096-41ff-8031-179ef8eb3978 admin admin] PATH_INFO: `/v3/users` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:02:59.438285 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a03ff2-c096-41ff-8031-179ef8eb3978 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:02:59.440233 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a03ff2-c096-41ff-8031-179ef8eb3978 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:02:59.534981 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1197/2399] 10.222.0.65 () {60 vars in 1144 bytes} [Thu Oct 27 10:02:59 2022] POST /identity/v3/users => generated 293 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 10:02:59.536436 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06973dbc-cf02-4a28-a837-59578b5f3add admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:02:59.548233 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06973dbc-cf02-4a28-a837-59578b5f3add admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:02:59.553405 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00a9d58-5aa5-48e3-94e4-d18809ed8715 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:02:59.554109 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00a9d58-5aa5-48e3-94e4-d18809ed8715 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:02:59.554467 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00a9d58-5aa5-48e3-94e4-d18809ed8715 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:02:59.554846 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00a9d58-5aa5-48e3-94e4-d18809ed8715 admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:02:59.555569 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00a9d58-5aa5-48e3-94e4-d18809ed8715 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:02:59.557372 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00a9d58-5aa5-48e3-94e4-d18809ed8715 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:02:59.570984 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1203/2400] 10.222.0.65 () {58 vars in 1122 bytes} [Thu Oct 27 10:02:59 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 10:02:59.572553 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a03ff2-c096-41ff-8031-179ef8eb3978 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:02:59.588901 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a03ff2-c096-41ff-8031-179ef8eb3978 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:02:59.593709 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accf71e9-3d38-437c-b79e-c31fecff7427 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:02:59.594298 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accf71e9-3d38-437c-b79e-c31fecff7427 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:02:59.594617 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accf71e9-3d38-437c-b79e-c31fecff7427 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:02:59.594894 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accf71e9-3d38-437c-b79e-c31fecff7427 admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:02:59.595541 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-accf71e9-3d38-437c-b79e-c31fecff7427 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:02:59.597232 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-accf71e9-3d38-437c-b79e-c31fecff7427 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:02:59.614897 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1198/2401] 10.222.0.65 () {58 vars in 1122 bytes} [Thu Oct 27 10:02:59 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 10:02:59.618336 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00a9d58-5aa5-48e3-94e4-d18809ed8715 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:02:59.630799 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00a9d58-5aa5-48e3-94e4-d18809ed8715 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:02:59.635828 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2597cc9a-cb90-4b87-b4c8-c1e8cd36310f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:02:59.636500 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2597cc9a-cb90-4b87-b4c8-c1e8cd36310f admin admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:02:59.636810 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2597cc9a-cb90-4b87-b4c8-c1e8cd36310f admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:02:59.637043 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2597cc9a-cb90-4b87-b4c8-c1e8cd36310f admin admin] PATH_INFO: `/v3/projects/80238431e0ed4c39b414f9bfb375e359/users/e4e32ce373664a8596db16a7be6e3119/roles/43543ce1450245af9661cb017bac17bd` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:02:59.665068 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2597cc9a-cb90-4b87-b4c8-c1e8cd36310f admin admin] RBAC: Authorizing `identity:create_grant(project_id=80238431e0ed4c39b414f9bfb375e359, user_id=e4e32ce373664a8596db16a7be6e3119, role_id=43543ce1450245af9661cb017bac17bd)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:02:59.667859 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2597cc9a-cb90-4b87-b4c8-c1e8cd36310f admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:02:59.901804 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1204/2402] 10.222.0.65 () {60 vars in 1483 bytes} [Thu Oct 27 10:02:59 2022] PUT /identity/v3/projects/80238431e0ed4c39b414f9bfb375e359/users/e4e32ce373664a8596db16a7be6e3119/roles/43543ce1450245af9661cb017bac17bd => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 10:02:59.913759 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02989dc0-e6b7-4d32-91f5-155b9c88ddfa None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:02:59.914046 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02989dc0-e6b7-4d32-91f5-155b9c88ddfa None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:02:59.914328 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02989dc0-e6b7-4d32-91f5-155b9c88ddfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:02:59.945529 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-02989dc0-e6b7-4d32-91f5-155b9c88ddfa None None] MFA Rules not processed for user `e4e32ce373664a8596db16a7be6e3119`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 10:02:59.946788 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-02989dc0-e6b7-4d32-91f5-155b9c88ddfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 10:02:59.993624 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:03:00.014529 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1199/2403] 10.222.0.65 () {58 vars in 958 bytes} [Thu Oct 27 10:02:59 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 10:03:00.019271 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2597cc9a-cb90-4b87-b4c8-c1e8cd36310f admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:03:00.083522 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2597cc9a-cb90-4b87-b4c8-c1e8cd36310f admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:03:00.088226 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231224ab-2c5a-45b0-8ecb-641ce4da4662 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:03:00.088840 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231224ab-2c5a-45b0-8ecb-641ce4da4662 admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:03:00.089122 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231224ab-2c5a-45b0-8ecb-641ce4da4662 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:03:00.089397 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231224ab-2c5a-45b0-8ecb-641ce4da4662 admin admin] PATH_INFO: `/v3/projects` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:03:00.090038 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231224ab-2c5a-45b0-8ecb-641ce4da4662 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:03:00.091999 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231224ab-2c5a-45b0-8ecb-641ce4da4662 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:03:00.299402 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1205/2404] 10.222.0.65 () {60 vars in 1153 bytes} [Thu Oct 27 10:03:00 2022] POST /identity/v3/projects => generated 385 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 10:03:00.303513 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02989dc0-e6b7-4d32-91f5-155b9c88ddfa None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:03:00.315894 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02989dc0-e6b7-4d32-91f5-155b9c88ddfa None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:03:00.383800 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506db16c-a6a4-460c-a502-5d8d25f2b7b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:03:00.384745 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506db16c-a6a4-460c-a502-5d8d25f2b7b7 admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:03:00.385193 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506db16c-a6a4-460c-a502-5d8d25f2b7b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:03:00.385652 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506db16c-a6a4-460c-a502-5d8d25f2b7b7 admin admin] PATH_INFO: `/v3/users` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:03:00.386406 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506db16c-a6a4-460c-a502-5d8d25f2b7b7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:03:00.388760 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506db16c-a6a4-460c-a502-5d8d25f2b7b7 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:03:00.500985 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231224ab-2c5a-45b0-8ecb-641ce4da4662 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:03:00.505260 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1200/2405] 10.222.0.65 () {60 vars in 1144 bytes} [Thu Oct 27 10:03:00 2022] POST /identity/v3/users => generated 299 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 10:03:00.507148 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:03:00.513625 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231224ab-2c5a-45b0-8ecb-641ce4da4662 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:03:00.518603 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed47bc8-a6c2-40c3-b371-d27786b08634 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:03:00.519425 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed47bc8-a6c2-40c3-b371-d27786b08634 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:03:00.519910 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed47bc8-a6c2-40c3-b371-d27786b08634 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:03:00.520872 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed47bc8-a6c2-40c3-b371-d27786b08634 admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:03:00.521036 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed47bc8-a6c2-40c3-b371-d27786b08634 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:03:00.523055 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed47bc8-a6c2-40c3-b371-d27786b08634 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:03:00.536214 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1206/2406] 10.222.0.65 () {58 vars in 1122 bytes} [Thu Oct 27 10:03:00 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 10:03:00.540888 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506db16c-a6a4-460c-a502-5d8d25f2b7b7 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:03:00.552562 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506db16c-a6a4-460c-a502-5d8d25f2b7b7 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:03:00.557359 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00908f74-cb4c-4fe7-8429-1634d9b33b25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:03:00.558113 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00908f74-cb4c-4fe7-8429-1634d9b33b25 admin admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:03:00.558494 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00908f74-cb4c-4fe7-8429-1634d9b33b25 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:03:00.558854 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00908f74-cb4c-4fe7-8429-1634d9b33b25 admin admin] PATH_INFO: `/v3/projects/75f7bbda3eb04a1fa638483017584c6d/users/7d608d3bef784e9aaae7994f1eaa63f4/roles/6ad17b9f9dea4b66ab2da3677d7e715d` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:03:00.574978 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00908f74-cb4c-4fe7-8429-1634d9b33b25 admin admin] RBAC: Authorizing `identity:create_grant(project_id=75f7bbda3eb04a1fa638483017584c6d, user_id=7d608d3bef784e9aaae7994f1eaa63f4, role_id=6ad17b9f9dea4b66ab2da3677d7e715d)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:03:00.577780 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00908f74-cb4c-4fe7-8429-1634d9b33b25 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:03:00.698640 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1201/2407] 10.222.0.65 () {60 vars in 1483 bytes} [Thu Oct 27 10:03:00 2022] PUT /identity/v3/projects/75f7bbda3eb04a1fa638483017584c6d/users/7d608d3bef784e9aaae7994f1eaa63f4/roles/6ad17b9f9dea4b66ab2da3677d7e715d => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 10:03:00.703906 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed47bc8-a6c2-40c3-b371-d27786b08634 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:03:00.714635 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed47bc8-a6c2-40c3-b371-d27786b08634 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:03:00.784771 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206e1662-f088-4382-a086-5910e8aacdb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:03:00.785544 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206e1662-f088-4382-a086-5910e8aacdb3 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:03:00.785834 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206e1662-f088-4382-a086-5910e8aacdb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:03:00.786135 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206e1662-f088-4382-a086-5910e8aacdb3 admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:03:00.786865 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206e1662-f088-4382-a086-5910e8aacdb3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:03:00.788480 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206e1662-f088-4382-a086-5910e8aacdb3 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:03:00.801649 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1207/2408] 10.222.0.65 () {58 vars in 1122 bytes} [Thu Oct 27 10:03:00 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 10:03:00.805957 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00908f74-cb4c-4fe7-8429-1634d9b33b25 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:03:00.816804 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00908f74-cb4c-4fe7-8429-1634d9b33b25 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:03:00.823493 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225eba0f-d941-403d-8158-5f8ab185952a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:03:00.824304 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225eba0f-d941-403d-8158-5f8ab185952a admin admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:03:00.824655 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225eba0f-d941-403d-8158-5f8ab185952a admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:03:00.825029 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225eba0f-d941-403d-8158-5f8ab185952a admin admin] PATH_INFO: `/v3/projects/75f7bbda3eb04a1fa638483017584c6d/users/7d608d3bef784e9aaae7994f1eaa63f4/roles/6ad17b9f9dea4b66ab2da3677d7e715d` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:03:00.835086 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225eba0f-d941-403d-8158-5f8ab185952a admin admin] RBAC: Authorizing `identity:create_grant(project_id=75f7bbda3eb04a1fa638483017584c6d, user_id=7d608d3bef784e9aaae7994f1eaa63f4, role_id=6ad17b9f9dea4b66ab2da3677d7e715d)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:03:00.837949 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225eba0f-d941-403d-8158-5f8ab185952a admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:03:00.862142 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1202/2409] 10.222.0.65 () {60 vars in 1483 bytes} [Thu Oct 27 10:03:00 2022] PUT /identity/v3/projects/75f7bbda3eb04a1fa638483017584c6d/users/7d608d3bef784e9aaae7994f1eaa63f4/roles/6ad17b9f9dea4b66ab2da3677d7e715d => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 10:03:00.873109 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a38210f-3d3f-4f38-a97d-4ff8a0148eab None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:03:00.873389 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a38210f-3d3f-4f38-a97d-4ff8a0148eab None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:03:00.873672 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a38210f-3d3f-4f38-a97d-4ff8a0148eab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:03:00.905311 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-4a38210f-3d3f-4f38-a97d-4ff8a0148eab None None] MFA Rules not processed for user `7d608d3bef784e9aaae7994f1eaa63f4`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 10:03:00.906586 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-4a38210f-3d3f-4f38-a97d-4ff8a0148eab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 10:03:00.979139 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1208/2410] 10.222.0.65 () {58 vars in 958 bytes} [Thu Oct 27 10:03:00 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 10:03:00.990945 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225eba0f-d941-403d-8158-5f8ab185952a admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:03:00.992731 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-225eba0f-d941-403d-8158-5f8ab185952a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 10:03:01.067841 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225eba0f-d941-403d-8158-5f8ab185952a admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:03:01.067841 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e923bb-b173-44d5-a4f6-5baadceebbc3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8e5d5f04c4741bb86ca4a0f667d4ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc2e3a7a1bcc480891c0b433291c00b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:03:01.067841 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e923bb-b173-44d5-a4f6-5baadceebbc3 service cinder] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:03:01.067841 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e923bb-b173-44d5-a4f6-5baadceebbc3 service cinder] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:03:01.068346 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e923bb-b173-44d5-a4f6-5baadceebbc3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:03:01.075894 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e923bb-b173-44d5-a4f6-5baadceebbc3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:03:01.077682 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e923bb-b173-44d5-a4f6-5baadceebbc3 service cinder] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:03:01.087944 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1203/2411] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Oct 27 10:03:00 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 10:03:01.119482 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a38210f-3d3f-4f38-a97d-4ff8a0148eab None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:03:01.184278 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a38210f-3d3f-4f38-a97d-4ff8a0148eab None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:03:01.190912 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336bf5b5-4ac8-4115-a5dc-d86a402ce1fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:03:01.191698 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336bf5b5-4ac8-4115-a5dc-d86a402ce1fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:03:01.191965 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336bf5b5-4ac8-4115-a5dc-d86a402ce1fe admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:03:01.192105 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336bf5b5-4ac8-4115-a5dc-d86a402ce1fe admin admin] PATH_INFO: `/v3/users/e4e32ce373664a8596db16a7be6e3119` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:03:01.193264 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336bf5b5-4ac8-4115-a5dc-d86a402ce1fe admin admin] RBAC: Authorizing `identity:delete_user(user_id=e4e32ce373664a8596db16a7be6e3119)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:03:01.195246 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336bf5b5-4ac8-4115-a5dc-d86a402ce1fe admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:03:01.391937 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-336bf5b5-4ac8-4115-a5dc-d86a402ce1fe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e4e32ce373664a8596db16a7be6e3119'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:03:01.404330 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-336bf5b5-4ac8-4115-a5dc-d86a402ce1fe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e4e32ce373664a8596db16a7be6e3119'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:03:01.405044 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-336bf5b5-4ac8-4115-a5dc-d86a402ce1fe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e4e32ce373664a8596db16a7be6e3119'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:03:01.418484 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-336bf5b5-4ac8-4115-a5dc-d86a402ce1fe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e4e32ce373664a8596db16a7be6e3119'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:03:01.507626 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-336bf5b5-4ac8-4115-a5dc-d86a402ce1fe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e4e32ce373664a8596db16a7be6e3119'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:03:01.515482 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1209/2412] 10.222.0.65 () {58 vars in 1224 bytes} [Thu Oct 27 10:03:01 2022] DELETE /identity/v3/users/e4e32ce373664a8596db16a7be6e3119 => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 10:03:01.519705 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249b4c46-e20d-46d3-9f0c-e6c3daa5395c None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:03:01.520176 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249b4c46-e20d-46d3-9f0c-e6c3daa5395c None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:03:01.520310 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249b4c46-e20d-46d3-9f0c-e6c3daa5395c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:03:01.540604 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-249b4c46-e20d-46d3-9f0c-e6c3daa5395c None None] MFA Rules not processed for user `b5065084bf664b99bdeac46067cb0f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 10:03:01.541836 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-249b4c46-e20d-46d3-9f0c-e6c3daa5395c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 10:03:01.601196 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1204/2413] 10.222.0.65 () {58 vars in 958 bytes} [Thu Oct 27 10:03:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 10:03:01.611295 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336bf5b5-4ac8-4115-a5dc-d86a402ce1fe admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:03:01.612709 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-336bf5b5-4ac8-4115-a5dc-d86a402ce1fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 10:03:01.672300 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336bf5b5-4ac8-4115-a5dc-d86a402ce1fe admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:03:01.677997 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f262046-8fb7-49dc-a2ac-559a387842e8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6191cc41efa74f46b49022cf387f7a4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc2e3a7a1bcc480891c0b433291c00b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:03:01.677997 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f262046-8fb7-49dc-a2ac-559a387842e8 service neutron] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:03:01.677997 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f262046-8fb7-49dc-a2ac-559a387842e8 service neutron] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:03:01.677997 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f262046-8fb7-49dc-a2ac-559a387842e8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:03:01.686677 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f262046-8fb7-49dc-a2ac-559a387842e8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:03:01.688100 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f262046-8fb7-49dc-a2ac-559a387842e8 service neutron] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:03:01.697928 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1210/2414] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Oct 27 10:03:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 10:03:01.793816 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:03:02.127395 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249b4c46-e20d-46d3-9f0c-e6c3daa5395c None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:03:02.129929 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-249b4c46-e20d-46d3-9f0c-e6c3daa5395c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 10:03:02.157094 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249b4c46-e20d-46d3-9f0c-e6c3daa5395c None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:03:02.166098 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f1d050-aa07-4042-946d-f4800b9db780 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:03:02.166098 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f1d050-aa07-4042-946d-f4800b9db780 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:03:02.166098 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f1d050-aa07-4042-946d-f4800b9db780 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:03:02.166098 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f1d050-aa07-4042-946d-f4800b9db780 admin admin] PATH_INFO: `/v3/projects/80238431e0ed4c39b414f9bfb375e359` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:03:02.166995 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f1d050-aa07-4042-946d-f4800b9db780 admin admin] RBAC: Authorizing `identity:delete_project(project_id=80238431e0ed4c39b414f9bfb375e359)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:03:02.168489 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f1d050-aa07-4042-946d-f4800b9db780 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:03:02.176314 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:03:02.264069 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-53f1d050-aa07-4042-946d-f4800b9db780 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '80238431e0ed4c39b414f9bfb375e359', 'request_id': 'req-53f1d050-aa07-4042-946d-f4800b9db780'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:03:02.270940 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-53f1d050-aa07-4042-946d-f4800b9db780 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '80238431e0ed4c39b414f9bfb375e359', 'request_id': 'req-53f1d050-aa07-4042-946d-f4800b9db780'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:03:02.319021 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-53f1d050-aa07-4042-946d-f4800b9db780 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '80238431e0ed4c39b414f9bfb375e359', 'request_id': 'req-53f1d050-aa07-4042-946d-f4800b9db780'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:03:02.331078 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-53f1d050-aa07-4042-946d-f4800b9db780 admin admin] The token cache is being invalidate because project 80238431e0ed4c39b414f9bfb375e359 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 10:03:02.331365 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-53f1d050-aa07-4042-946d-f4800b9db780 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:03:02.332830 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-53f1d050-aa07-4042-946d-f4800b9db780 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:03:02.334424 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1205/2415] 10.222.0.65 () {58 vars in 1233 bytes} [Thu Oct 27 10:03:02 2022] DELETE /identity/v3/projects/80238431e0ed4c39b414f9bfb375e359 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 10:03:02.338563 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f262046-8fb7-49dc-a2ac-559a387842e8 service neutron] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:03:02.348915 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f262046-8fb7-49dc-a2ac-559a387842e8 service neutron] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:03:02.407467 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1918290-fd68-4b7d-bee1-8af36f285e22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:03:02.408109 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1918290-fd68-4b7d-bee1-8af36f285e22 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:03:02.408395 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1918290-fd68-4b7d-bee1-8af36f285e22 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:03:02.408676 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1918290-fd68-4b7d-bee1-8af36f285e22 admin admin] PATH_INFO: `/v3/users/7d608d3bef784e9aaae7994f1eaa63f4` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:03:02.410308 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1918290-fd68-4b7d-bee1-8af36f285e22 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7d608d3bef784e9aaae7994f1eaa63f4)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:03:02.413037 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1918290-fd68-4b7d-bee1-8af36f285e22 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:03:02.704958 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-a1918290-fd68-4b7d-bee1-8af36f285e22 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7d608d3bef784e9aaae7994f1eaa63f4'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:03:02.719368 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-a1918290-fd68-4b7d-bee1-8af36f285e22 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7d608d3bef784e9aaae7994f1eaa63f4'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:03:02.720302 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-a1918290-fd68-4b7d-bee1-8af36f285e22 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7d608d3bef784e9aaae7994f1eaa63f4'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:03:02.728022 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-a1918290-fd68-4b7d-bee1-8af36f285e22 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7d608d3bef784e9aaae7994f1eaa63f4'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:03:02.776396 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:03:02.793111 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-a1918290-fd68-4b7d-bee1-8af36f285e22 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7d608d3bef784e9aaae7994f1eaa63f4'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:03:02.803061 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1211/2416] 10.222.0.65 () {58 vars in 1224 bytes} [Thu Oct 27 10:03:02 2022] DELETE /identity/v3/users/7d608d3bef784e9aaae7994f1eaa63f4 => generated 0 bytes in 465 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 10:03:03.257704 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f1d050-aa07-4042-946d-f4800b9db780 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:03:03.259128 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-53f1d050-aa07-4042-946d-f4800b9db780 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 10:03:03.275024 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f1d050-aa07-4042-946d-f4800b9db780 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:03:03.337089 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31944f48-23d8-47d2-b9b9-88ce8081cf34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:03:03.337711 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31944f48-23d8-47d2-b9b9-88ce8081cf34 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:03:03.337992 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31944f48-23d8-47d2-b9b9-88ce8081cf34 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:03:03.338258 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31944f48-23d8-47d2-b9b9-88ce8081cf34 admin admin] PATH_INFO: `/v3/projects/75f7bbda3eb04a1fa638483017584c6d` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:03:03.339434 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31944f48-23d8-47d2-b9b9-88ce8081cf34 admin admin] RBAC: Authorizing `identity:delete_project(project_id=75f7bbda3eb04a1fa638483017584c6d)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:03:03.341879 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31944f48-23d8-47d2-b9b9-88ce8081cf34 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:03:03.458421 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-31944f48-23d8-47d2-b9b9-88ce8081cf34 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '75f7bbda3eb04a1fa638483017584c6d', 'request_id': 'req-31944f48-23d8-47d2-b9b9-88ce8081cf34'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:03:03.464905 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-31944f48-23d8-47d2-b9b9-88ce8081cf34 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '75f7bbda3eb04a1fa638483017584c6d', 'request_id': 'req-31944f48-23d8-47d2-b9b9-88ce8081cf34'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:03:03.536704 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-31944f48-23d8-47d2-b9b9-88ce8081cf34 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '75f7bbda3eb04a1fa638483017584c6d', 'request_id': 'req-31944f48-23d8-47d2-b9b9-88ce8081cf34'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:03:03.541236 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:03:03.549459 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-31944f48-23d8-47d2-b9b9-88ce8081cf34 admin admin] The token cache is being invalidate because project 75f7bbda3eb04a1fa638483017584c6d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 10:03:03.551258 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-31944f48-23d8-47d2-b9b9-88ce8081cf34 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:03:03.551678 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-31944f48-23d8-47d2-b9b9-88ce8081cf34 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:03:03.553856 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1206/2417] 10.222.0.65 () {58 vars in 1233 bytes} [Thu Oct 27 10:03:03 2022] DELETE /identity/v3/projects/75f7bbda3eb04a1fa638483017584c6d => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 10:03:03.558977 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3b6406-bb9f-4238-9f30-65c483ff5e9f None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:03:03.559465 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3b6406-bb9f-4238-9f30-65c483ff5e9f None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:03:03.559561 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3b6406-bb9f-4238-9f30-65c483ff5e9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:03:03.580137 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-4a3b6406-bb9f-4238-9f30-65c483ff5e9f None None] MFA Rules not processed for user `b5065084bf664b99bdeac46067cb0f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 10:03:03.581359 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-4a3b6406-bb9f-4238-9f30-65c483ff5e9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 10:03:03.646314 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1212/2418] 10.222.0.65 () {58 vars in 958 bytes} [Thu Oct 27 10:03:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 10:03:03.655892 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f8d8d7-3d25-4db3-bdf5-c7afa9cfb849 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:03:03.656180 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f8d8d7-3d25-4db3-bdf5-c7afa9cfb849 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:03:03.656454 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f8d8d7-3d25-4db3-bdf5-c7afa9cfb849 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:03:03.676690 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-75f8d8d7-3d25-4db3-bdf5-c7afa9cfb849 None None] MFA Rules not processed for user `b5065084bf664b99bdeac46067cb0f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 10:03:03.677939 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-75f8d8d7-3d25-4db3-bdf5-c7afa9cfb849 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 10:03:03.686278 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1207/2419] 10.222.0.65 () {58 vars in 958 bytes} [Thu Oct 27 10:03:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 10:03:03.690658 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3b6406-bb9f-4238-9f30-65c483ff5e9f None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:03:03.701089 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3b6406-bb9f-4238-9f30-65c483ff5e9f None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:03:03.706012 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2d8557-bb0e-464a-b586-a6a878b1f334 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:03:03.706746 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2d8557-bb0e-464a-b586-a6a878b1f334 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:03:03.707050 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2d8557-bb0e-464a-b586-a6a878b1f334 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:03:03.707330 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2d8557-bb0e-464a-b586-a6a878b1f334 admin admin] PATH_INFO: `/v3/domains` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:03:03.707981 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2d8557-bb0e-464a-b586-a6a878b1f334 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 10:03:03.708288 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2d8557-bb0e-464a-b586-a6a878b1f334 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:03:03.709879 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2d8557-bb0e-464a-b586-a6a878b1f334 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:03:03.724737 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1213/2420] 10.222.0.65 () {58 vars in 1153 bytes} [Thu Oct 27 10:03:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 10:03:03.729099 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f8d8d7-3d25-4db3-bdf5-c7afa9cfb849 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:03:03.738579 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f8d8d7-3d25-4db3-bdf5-c7afa9cfb849 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:03:03.743416 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af41be12-eacf-4fa9-b601-1b0012674eb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:03:03.743956 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af41be12-eacf-4fa9-b601-1b0012674eb4 admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:03:03.744235 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af41be12-eacf-4fa9-b601-1b0012674eb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:03:03.744507 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af41be12-eacf-4fa9-b601-1b0012674eb4 admin admin] PATH_INFO: `/v3/projects` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:03:03.745135 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af41be12-eacf-4fa9-b601-1b0012674eb4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:03:03.747098 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af41be12-eacf-4fa9-b601-1b0012674eb4 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:03:03.859115 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1208/2421] 10.222.0.65 () {60 vars in 1153 bytes} [Thu Oct 27 10:03:03 2022] POST /identity/v3/projects => generated 393 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 10:03:03.863531 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2d8557-bb0e-464a-b586-a6a878b1f334 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:03:03.874056 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2d8557-bb0e-464a-b586-a6a878b1f334 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:03:03.892755 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af41be12-eacf-4fa9-b601-1b0012674eb4 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:03:03.894485 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-af41be12-eacf-4fa9-b601-1b0012674eb4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 10:03:03.935798 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a284d1c-1887-45ea-aa93-6022ef10965b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:03:03.936429 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a284d1c-1887-45ea-aa93-6022ef10965b admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:03:03.936733 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a284d1c-1887-45ea-aa93-6022ef10965b admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:03:03.937016 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a284d1c-1887-45ea-aa93-6022ef10965b admin admin] PATH_INFO: `/v3/users` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:03:03.937645 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a284d1c-1887-45ea-aa93-6022ef10965b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:03:03.939657 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a284d1c-1887-45ea-aa93-6022ef10965b admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:03:03.964576 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af41be12-eacf-4fa9-b601-1b0012674eb4 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:03:03.970289 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acca6e18-a2dc-4159-8830-4f1879e7e4ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:03:03.970975 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acca6e18-a2dc-4159-8830-4f1879e7e4ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:03:03.971253 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acca6e18-a2dc-4159-8830-4f1879e7e4ad admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:03:03.971557 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acca6e18-a2dc-4159-8830-4f1879e7e4ad admin admin] PATH_INFO: `/v3/users/7b7c7ff0054941378569d7138d597bd4` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:03:03.972792 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acca6e18-a2dc-4159-8830-4f1879e7e4ad admin admin] RBAC: Authorizing `identity:delete_user(user_id=7b7c7ff0054941378569d7138d597bd4)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:03:03.974679 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acca6e18-a2dc-4159-8830-4f1879e7e4ad admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:03:04.035802 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1214/2422] 10.222.0.65 () {60 vars in 1144 bytes} [Thu Oct 27 10:03:03 2022] POST /identity/v3/users => generated 297 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 10:03:04.039239 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a284d1c-1887-45ea-aa93-6022ef10965b admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:03:04.049265 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a284d1c-1887-45ea-aa93-6022ef10965b admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:03:04.053991 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef79672-5b77-434d-b366-7b6d611cc31a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:03:04.054667 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef79672-5b77-434d-b366-7b6d611cc31a admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:03:04.054898 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef79672-5b77-434d-b366-7b6d611cc31a admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:03:04.055172 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef79672-5b77-434d-b366-7b6d611cc31a admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:03:04.055801 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef79672-5b77-434d-b366-7b6d611cc31a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:03:04.057393 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef79672-5b77-434d-b366-7b6d611cc31a admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:03:04.068794 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1215/2423] 10.222.0.65 () {58 vars in 1122 bytes} [Thu Oct 27 10:03:04 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 10:03:04.072785 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef79672-5b77-434d-b366-7b6d611cc31a admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:03:04.083668 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef79672-5b77-434d-b366-7b6d611cc31a admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:03:04.088608 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee370e9-1698-42c0-8e5b-06b2b70f3634 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:03:04.089205 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee370e9-1698-42c0-8e5b-06b2b70f3634 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:03:04.089494 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee370e9-1698-42c0-8e5b-06b2b70f3634 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:03:04.089773 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee370e9-1698-42c0-8e5b-06b2b70f3634 admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:03:04.090417 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee370e9-1698-42c0-8e5b-06b2b70f3634 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:03:04.092134 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee370e9-1698-42c0-8e5b-06b2b70f3634 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:03:04.109476 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1216/2424] 10.222.0.65 () {58 vars in 1122 bytes} [Thu Oct 27 10:03:04 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 10:03:04.116909 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee370e9-1698-42c0-8e5b-06b2b70f3634 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:03:04.121452 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-acca6e18-a2dc-4159-8830-4f1879e7e4ad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7b7c7ff0054941378569d7138d597bd4'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:03:04.122851 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-acca6e18-a2dc-4159-8830-4f1879e7e4ad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7b7c7ff0054941378569d7138d597bd4'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:03:04.131126 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee370e9-1698-42c0-8e5b-06b2b70f3634 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:03:04.133913 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-acca6e18-a2dc-4159-8830-4f1879e7e4ad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7b7c7ff0054941378569d7138d597bd4'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:03:04.134968 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-acca6e18-a2dc-4159-8830-4f1879e7e4ad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7b7c7ff0054941378569d7138d597bd4'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:03:04.137556 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67703849-504e-42aa-884a-2112ded7ded6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:03:04.139680 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67703849-504e-42aa-884a-2112ded7ded6 admin admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:03:04.140088 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67703849-504e-42aa-884a-2112ded7ded6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:03:04.140925 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67703849-504e-42aa-884a-2112ded7ded6 admin admin] PATH_INFO: `/v3/projects/67622797e69d4af68f3de20dad2ca2f8/users/dee8947b079c43429596a75ac70e72c4/roles/43543ce1450245af9661cb017bac17bd` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:03:04.144582 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:03:04.155715 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-acca6e18-a2dc-4159-8830-4f1879e7e4ad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7b7c7ff0054941378569d7138d597bd4'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:03:04.161081 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67703849-504e-42aa-884a-2112ded7ded6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=67622797e69d4af68f3de20dad2ca2f8, user_id=dee8947b079c43429596a75ac70e72c4, role_id=43543ce1450245af9661cb017bac17bd)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:03:04.164064 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67703849-504e-42aa-884a-2112ded7ded6 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:03:04.245609 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1217/2425] 10.222.0.65 () {60 vars in 1483 bytes} [Thu Oct 27 10:03:04 2022] PUT /identity/v3/projects/67622797e69d4af68f3de20dad2ca2f8/users/dee8947b079c43429596a75ac70e72c4/roles/43543ce1450245af9661cb017bac17bd => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 10:03:04.245892 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1209/2426] 10.222.0.65 () {58 vars in 1224 bytes} [Thu Oct 27 10:03:03 2022] DELETE /identity/v3/users/7b7c7ff0054941378569d7138d597bd4 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 10:03:04.251370 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e14470-5bc2-4f9f-8d81-8b59dee72b88 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:03:04.251654 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e14470-5bc2-4f9f-8d81-8b59dee72b88 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:03:04.251931 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e14470-5bc2-4f9f-8d81-8b59dee72b88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:03:04.257510 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59eb17f1-1fc4-4995-8612-2a6211630fc4 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:03:04.257860 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59eb17f1-1fc4-4995-8612-2a6211630fc4 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:03:04.258406 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59eb17f1-1fc4-4995-8612-2a6211630fc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:03:04.272051 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-b1e14470-5bc2-4f9f-8d81-8b59dee72b88 None None] MFA Rules not processed for user `b5065084bf664b99bdeac46067cb0f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 10:03:04.273323 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-b1e14470-5bc2-4f9f-8d81-8b59dee72b88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 10:03:04.289280 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-59eb17f1-1fc4-4995-8612-2a6211630fc4 None None] MFA Rules not processed for user `dee8947b079c43429596a75ac70e72c4`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 10:03:04.290491 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-59eb17f1-1fc4-4995-8612-2a6211630fc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 10:03:04.331321 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:DELETE=11,keystone:SELECT=87,keystone:INSERT=2 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:03:04.339675 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1218/2427] 10.222.0.65 () {58 vars in 958 bytes} [Thu Oct 27 10:03:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 10:03:04.349927 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e14470-5bc2-4f9f-8d81-8b59dee72b88 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:03:04.351379 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-b1e14470-5bc2-4f9f-8d81-8b59dee72b88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 10:03:04.370366 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1210/2428] 10.222.0.65 () {58 vars in 958 bytes} [Thu Oct 27 10:03:04 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 10:03:04.376458 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59eb17f1-1fc4-4995-8612-2a6211630fc4 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:03:04.377786 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-59eb17f1-1fc4-4995-8612-2a6211630fc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 10:03:04.392180 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59eb17f1-1fc4-4995-8612-2a6211630fc4 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:03:04.397053 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47988eb4-a36a-4658-93b2-fe5225d6c2bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:03:04.397846 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47988eb4-a36a-4658-93b2-fe5225d6c2bf admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:03:04.404061 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47988eb4-a36a-4658-93b2-fe5225d6c2bf admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:03:04.404061 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47988eb4-a36a-4658-93b2-fe5225d6c2bf admin admin] PATH_INFO: `/v3/projects` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:03:04.404061 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47988eb4-a36a-4658-93b2-fe5225d6c2bf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:03:04.404061 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47988eb4-a36a-4658-93b2-fe5225d6c2bf admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:03:04.417568 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e14470-5bc2-4f9f-8d81-8b59dee72b88 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:03:04.422084 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23f1fc4-86d2-4d35-8197-c361ef503ee4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6191cc41efa74f46b49022cf387f7a4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc2e3a7a1bcc480891c0b433291c00b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:03:04.422729 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23f1fc4-86d2-4d35-8197-c361ef503ee4 service neutron] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:03:04.423011 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23f1fc4-86d2-4d35-8197-c361ef503ee4 service neutron] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:03:04.423286 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23f1fc4-86d2-4d35-8197-c361ef503ee4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:03:04.433289 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23f1fc4-86d2-4d35-8197-c361ef503ee4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:03:04.434826 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23f1fc4-86d2-4d35-8197-c361ef503ee4 service neutron] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:03:04.446667 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1219/2429] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Oct 27 10:03:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 10:03:04.526667 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1211/2430] 10.222.0.65 () {60 vars in 1153 bytes} [Thu Oct 27 10:03:04 2022] POST /identity/v3/projects => generated 393 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 10:03:04.531617 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23f1fc4-86d2-4d35-8197-c361ef503ee4 service neutron] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:03:04.541267 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23f1fc4-86d2-4d35-8197-c361ef503ee4 service neutron] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:03:04.603603 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044a2d14-2c7b-4f8e-af1f-3d52e6fce8c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:03:04.604262 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044a2d14-2c7b-4f8e-af1f-3d52e6fce8c2 admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:03:04.604601 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044a2d14-2c7b-4f8e-af1f-3d52e6fce8c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:03:04.604882 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044a2d14-2c7b-4f8e-af1f-3d52e6fce8c2 admin admin] PATH_INFO: `/v3/users` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:03:04.605516 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044a2d14-2c7b-4f8e-af1f-3d52e6fce8c2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:03:04.608496 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044a2d14-2c7b-4f8e-af1f-3d52e6fce8c2 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:03:04.695531 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1220/2431] 10.222.0.65 () {60 vars in 1144 bytes} [Thu Oct 27 10:03:04 2022] POST /identity/v3/users => generated 303 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 10:03:04.696776 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47988eb4-a36a-4658-93b2-fe5225d6c2bf admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:03:04.708276 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47988eb4-a36a-4658-93b2-fe5225d6c2bf admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:03:04.713252 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d12890-e63f-4991-b666-9053a06871fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:03:04.713855 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d12890-e63f-4991-b666-9053a06871fc admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:03:04.714137 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d12890-e63f-4991-b666-9053a06871fc admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:03:04.714411 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d12890-e63f-4991-b666-9053a06871fc admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:03:04.715131 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d12890-e63f-4991-b666-9053a06871fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:03:04.717018 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d12890-e63f-4991-b666-9053a06871fc admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:03:04.730673 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1212/2432] 10.222.0.65 () {58 vars in 1122 bytes} [Thu Oct 27 10:03:04 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 10:03:04.733024 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044a2d14-2c7b-4f8e-af1f-3d52e6fce8c2 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:03:04.744266 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044a2d14-2c7b-4f8e-af1f-3d52e6fce8c2 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:03:04.750099 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344c3098-dd16-4680-be54-f08fb87a0287 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:03:04.750902 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344c3098-dd16-4680-be54-f08fb87a0287 admin admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:03:04.751200 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344c3098-dd16-4680-be54-f08fb87a0287 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:03:04.751373 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344c3098-dd16-4680-be54-f08fb87a0287 admin admin] PATH_INFO: `/v3/projects/50d50e5a810c434eaaa25e406417e213/users/68a44317382a450f91f108fda5e22f43/roles/6ad17b9f9dea4b66ab2da3677d7e715d` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:03:04.767908 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344c3098-dd16-4680-be54-f08fb87a0287 admin admin] RBAC: Authorizing `identity:create_grant(project_id=50d50e5a810c434eaaa25e406417e213, user_id=68a44317382a450f91f108fda5e22f43, role_id=6ad17b9f9dea4b66ab2da3677d7e715d)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:03:04.770651 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344c3098-dd16-4680-be54-f08fb87a0287 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:03:04.772972 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:03:04.863777 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1221/2433] 10.222.0.65 () {60 vars in 1483 bytes} [Thu Oct 27 10:03:04 2022] PUT /identity/v3/projects/50d50e5a810c434eaaa25e406417e213/users/68a44317382a450f91f108fda5e22f43/roles/6ad17b9f9dea4b66ab2da3677d7e715d => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 10:03:04.868008 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d12890-e63f-4991-b666-9053a06871fc admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:03:04.878754 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d12890-e63f-4991-b666-9053a06871fc admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:03:04.923913 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344c3098-dd16-4680-be54-f08fb87a0287 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:03:04.926140 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-344c3098-dd16-4680-be54-f08fb87a0287 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 10:03:04.949239 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212d1192-08d4-47cf-816e-ea23226421e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:03:04.949945 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212d1192-08d4-47cf-816e-ea23226421e9 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:03:04.950932 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212d1192-08d4-47cf-816e-ea23226421e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:03:04.951742 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212d1192-08d4-47cf-816e-ea23226421e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:03:04.952366 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212d1192-08d4-47cf-816e-ea23226421e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:03:04.954063 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212d1192-08d4-47cf-816e-ea23226421e9 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:03:04.965993 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1213/2434] 10.222.0.65 () {58 vars in 1122 bytes} [Thu Oct 27 10:03:04 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 10:03:04.974877 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212d1192-08d4-47cf-816e-ea23226421e9 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:03:04.987284 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212d1192-08d4-47cf-816e-ea23226421e9 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:03:04.992269 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558e7a80-2a43-446e-bbf4-36e6f26b7138 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:03:04.992929 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558e7a80-2a43-446e-bbf4-36e6f26b7138 admin admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:03:04.993213 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558e7a80-2a43-446e-bbf4-36e6f26b7138 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:03:04.993487 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558e7a80-2a43-446e-bbf4-36e6f26b7138 admin admin] PATH_INFO: `/v3/projects/50d50e5a810c434eaaa25e406417e213/users/68a44317382a450f91f108fda5e22f43/roles/6ad17b9f9dea4b66ab2da3677d7e715d` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:03:04.995525 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558e7a80-2a43-446e-bbf4-36e6f26b7138 admin admin] RBAC: Authorizing `identity:create_grant(project_id=50d50e5a810c434eaaa25e406417e213, user_id=68a44317382a450f91f108fda5e22f43, role_id=6ad17b9f9dea4b66ab2da3677d7e715d)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:03:04.998271 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558e7a80-2a43-446e-bbf4-36e6f26b7138 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:03:05.010262 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1214/2435] 10.222.0.65 () {60 vars in 1483 bytes} [Thu Oct 27 10:03:04 2022] PUT /identity/v3/projects/50d50e5a810c434eaaa25e406417e213/users/68a44317382a450f91f108fda5e22f43/roles/6ad17b9f9dea4b66ab2da3677d7e715d => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 10:03:05.018257 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344c3098-dd16-4680-be54-f08fb87a0287 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:03:05.026264 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fcc3fe-2206-4f7c-886b-eb5ae2499dfd None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:03:05.026803 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fcc3fe-2206-4f7c-886b-eb5ae2499dfd None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:03:05.027192 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fcc3fe-2206-4f7c-886b-eb5ae2499dfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:03:05.062496 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-87fcc3fe-2206-4f7c-886b-eb5ae2499dfd None None] MFA Rules not processed for user `68a44317382a450f91f108fda5e22f43`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 10:03:05.063862 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-87fcc3fe-2206-4f7c-886b-eb5ae2499dfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 10:03:05.087815 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5340f84e-8625-436f-8e6e-f532c4fc61a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:03:05.088621 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5340f84e-8625-436f-8e6e-f532c4fc61a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:03:05.088907 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5340f84e-8625-436f-8e6e-f532c4fc61a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:03:05.089191 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5340f84e-8625-436f-8e6e-f532c4fc61a9 admin admin] PATH_INFO: `/v3/projects/4730bad9e551457ba5e6c8f11555fe8a` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:03:05.090342 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5340f84e-8625-436f-8e6e-f532c4fc61a9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4730bad9e551457ba5e6c8f11555fe8a)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:03:05.093278 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5340f84e-8625-436f-8e6e-f532c4fc61a9 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:03:05.137408 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1215/2436] 10.222.0.65 () {58 vars in 958 bytes} [Thu Oct 27 10:03:05 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 10:03:05.148887 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fcc3fe-2206-4f7c-886b-eb5ae2499dfd None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:03:05.151157 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-87fcc3fe-2206-4f7c-886b-eb5ae2499dfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 10:03:05.161813 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:03:05.228510 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fcc3fe-2206-4f7c-886b-eb5ae2499dfd None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:03:05.228737 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-5340f84e-8625-436f-8e6e-f532c4fc61a9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4730bad9e551457ba5e6c8f11555fe8a', 'request_id': 'req-5340f84e-8625-436f-8e6e-f532c4fc61a9'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:03:05.279368 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c72dbdc-50a3-436d-89aa-202b42b49c9f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8e5d5f04c4741bb86ca4a0f667d4ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc2e3a7a1bcc480891c0b433291c00b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:03:05.280150 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c72dbdc-50a3-436d-89aa-202b42b49c9f service cinder] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:03:05.280427 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c72dbdc-50a3-436d-89aa-202b42b49c9f service cinder] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:03:05.280696 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c72dbdc-50a3-436d-89aa-202b42b49c9f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:03:05.313405 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-5340f84e-8625-436f-8e6e-f532c4fc61a9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4730bad9e551457ba5e6c8f11555fe8a', 'request_id': 'req-5340f84e-8625-436f-8e6e-f532c4fc61a9'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:03:05.319599 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-5340f84e-8625-436f-8e6e-f532c4fc61a9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4730bad9e551457ba5e6c8f11555fe8a', 'request_id': 'req-5340f84e-8625-436f-8e6e-f532c4fc61a9'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:03:05.332220 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-5340f84e-8625-436f-8e6e-f532c4fc61a9 admin admin] The token cache is being invalidate because project 4730bad9e551457ba5e6c8f11555fe8a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 10:03:05.332516 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-5340f84e-8625-436f-8e6e-f532c4fc61a9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:03:05.333225 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-5340f84e-8625-436f-8e6e-f532c4fc61a9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:03:05.334887 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1222/2437] 10.222.0.65 () {58 vars in 1233 bytes} [Thu Oct 27 10:03:04 2022] DELETE /identity/v3/projects/4730bad9e551457ba5e6c8f11555fe8a => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 10:03:05.339993 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ed1580-b409-496d-aaa8-9000b0377a5a None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:03:05.340284 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ed1580-b409-496d-aaa8-9000b0377a5a None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:03:05.340588 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ed1580-b409-496d-aaa8-9000b0377a5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:03:05.345275 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c72dbdc-50a3-436d-89aa-202b42b49c9f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:03:05.347272 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c72dbdc-50a3-436d-89aa-202b42b49c9f service cinder] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:03:05.358129 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1216/2438] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Oct 27 10:03:05 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 10:03:05.363241 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-80ed1580-b409-496d-aaa8-9000b0377a5a None None] MFA Rules not processed for user `b5065084bf664b99bdeac46067cb0f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 10:03:05.364484 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-80ed1580-b409-496d-aaa8-9000b0377a5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 10:03:05.395053 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:INSERT=2,keystone:SELECT=91,keystone:DELETE=7 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:03:05.432501 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1223/2439] 10.222.0.65 () {58 vars in 958 bytes} [Thu Oct 27 10:03:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 10:03:05.432867 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c72dbdc-50a3-436d-89aa-202b42b49c9f service cinder] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:03:05.439885 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c669c87f-ef51-44cf-a87b-fdcf58a8e527 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:03:05.440312 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c669c87f-ef51-44cf-a87b-fdcf58a8e527 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:03:05.440598 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c669c87f-ef51-44cf-a87b-fdcf58a8e527 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:03:05.442831 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c72dbdc-50a3-436d-89aa-202b42b49c9f service cinder] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:03:05.446690 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84afec46-103e-42f9-b36a-19309a7e8b2f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8e5d5f04c4741bb86ca4a0f667d4ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc2e3a7a1bcc480891c0b433291c00b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:03:05.447325 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84afec46-103e-42f9-b36a-19309a7e8b2f service cinder] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:03:05.447607 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84afec46-103e-42f9-b36a-19309a7e8b2f service cinder] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:03:05.447882 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84afec46-103e-42f9-b36a-19309a7e8b2f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:03:05.449836 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-84afec46-103e-42f9-b36a-19309a7e8b2f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 10:03:05.461043 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-c669c87f-ef51-44cf-a87b-fdcf58a8e527 None None] MFA Rules not processed for user `b5065084bf664b99bdeac46067cb0f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 10:03:05.462234 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-c669c87f-ef51-44cf-a87b-fdcf58a8e527 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 10:03:05.470947 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1224/2440] 10.222.0.65 () {58 vars in 958 bytes} [Thu Oct 27 10:03:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 10:03:05.475137 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c669c87f-ef51-44cf-a87b-fdcf58a8e527 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:03:05.484317 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c669c87f-ef51-44cf-a87b-fdcf58a8e527 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:03:05.489066 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920644bb-89f8-4f61-8d25-ef4f32748984 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:03:05.489664 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920644bb-89f8-4f61-8d25-ef4f32748984 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:03:05.489943 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920644bb-89f8-4f61-8d25-ef4f32748984 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:03:05.490220 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920644bb-89f8-4f61-8d25-ef4f32748984 admin admin] PATH_INFO: `/v3/domains` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:03:05.490932 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920644bb-89f8-4f61-8d25-ef4f32748984 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 10:03:05.494977 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920644bb-89f8-4f61-8d25-ef4f32748984 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:03:05.494977 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920644bb-89f8-4f61-8d25-ef4f32748984 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:03:05.505191 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1225/2441] 10.222.0.65 () {58 vars in 1153 bytes} [Thu Oct 27 10:03:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 10:03:05.509737 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920644bb-89f8-4f61-8d25-ef4f32748984 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:03:05.518173 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84afec46-103e-42f9-b36a-19309a7e8b2f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:03:05.519661 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84afec46-103e-42f9-b36a-19309a7e8b2f service cinder] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:03:05.520899 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920644bb-89f8-4f61-8d25-ef4f32748984 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:03:05.525907 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81067bc-7196-4fc2-b9ab-cef9df721cd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:03:05.526512 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81067bc-7196-4fc2-b9ab-cef9df721cd3 admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:03:05.526825 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81067bc-7196-4fc2-b9ab-cef9df721cd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:03:05.527105 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81067bc-7196-4fc2-b9ab-cef9df721cd3 admin admin] PATH_INFO: `/v3/projects` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:03:05.527732 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81067bc-7196-4fc2-b9ab-cef9df721cd3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:03:05.529825 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1217/2442] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Oct 27 10:03:05 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 10:03:05.531167 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81067bc-7196-4fc2-b9ab-cef9df721cd3 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:03:05.635120 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1226/2443] 10.222.0.65 () {60 vars in 1153 bytes} [Thu Oct 27 10:03:05 2022] POST /identity/v3/projects => generated 371 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 10:03:05.640009 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84afec46-103e-42f9-b36a-19309a7e8b2f service cinder] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:03:05.650880 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84afec46-103e-42f9-b36a-19309a7e8b2f service cinder] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:03:05.665359 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:03:05.717655 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706b2f9c-2d4b-45d3-9e9c-1809e270f748 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:03:05.717655 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706b2f9c-2d4b-45d3-9e9c-1809e270f748 admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:03:05.717655 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706b2f9c-2d4b-45d3-9e9c-1809e270f748 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:03:05.717655 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706b2f9c-2d4b-45d3-9e9c-1809e270f748 admin admin] PATH_INFO: `/v3/users` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:03:05.718106 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706b2f9c-2d4b-45d3-9e9c-1809e270f748 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:03:05.719264 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706b2f9c-2d4b-45d3-9e9c-1809e270f748 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:03:05.798333 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81067bc-7196-4fc2-b9ab-cef9df721cd3 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:03:05.803063 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-a81067bc-7196-4fc2-b9ab-cef9df721cd3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 10:03:05.803202 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1218/2444] 10.222.0.65 () {60 vars in 1144 bytes} [Thu Oct 27 10:03:05 2022] POST /identity/v3/users => generated 286 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 10:03:05.805660 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706b2f9c-2d4b-45d3-9e9c-1809e270f748 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:03:05.816185 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706b2f9c-2d4b-45d3-9e9c-1809e270f748 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:03:05.823190 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314c04a6-dec0-4524-ab39-88907df84adf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:03:05.823832 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314c04a6-dec0-4524-ab39-88907df84adf admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:03:05.824112 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314c04a6-dec0-4524-ab39-88907df84adf admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:03:05.824384 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314c04a6-dec0-4524-ab39-88907df84adf admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:03:05.825061 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314c04a6-dec0-4524-ab39-88907df84adf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:03:05.827629 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314c04a6-dec0-4524-ab39-88907df84adf admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:03:05.839161 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1219/2445] 10.222.0.65 () {58 vars in 1122 bytes} [Thu Oct 27 10:03:05 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 10:03:05.844283 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314c04a6-dec0-4524-ab39-88907df84adf admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:03:05.859333 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314c04a6-dec0-4524-ab39-88907df84adf admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:03:05.864439 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427590a8-c3c9-45db-bca2-4524a1b66995 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:03:05.865041 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427590a8-c3c9-45db-bca2-4524a1b66995 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:03:05.865321 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427590a8-c3c9-45db-bca2-4524a1b66995 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:03:05.865595 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427590a8-c3c9-45db-bca2-4524a1b66995 admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:03:05.866240 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427590a8-c3c9-45db-bca2-4524a1b66995 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:03:05.867935 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427590a8-c3c9-45db-bca2-4524a1b66995 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:03:05.873355 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81067bc-7196-4fc2-b9ab-cef9df721cd3 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:03:05.877251 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc614fc7-f364-495b-9ade-ba5879295def service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8e5d5f04c4741bb86ca4a0f667d4ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc2e3a7a1bcc480891c0b433291c00b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:03:05.877770 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc614fc7-f364-495b-9ade-ba5879295def service cinder] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:03:05.878047 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc614fc7-f364-495b-9ade-ba5879295def service cinder] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:03:05.878318 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc614fc7-f364-495b-9ade-ba5879295def service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:03:05.880088 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-fc614fc7-f364-495b-9ade-ba5879295def service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 10:03:05.884005 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1220/2446] 10.222.0.65 () {58 vars in 1122 bytes} [Thu Oct 27 10:03:05 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 10:03:05.885168 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427590a8-c3c9-45db-bca2-4524a1b66995 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:03:05.896302 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427590a8-c3c9-45db-bca2-4524a1b66995 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:03:05.901352 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f38e5a-dd11-4312-b4ef-0f4a46c53ee6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:03:05.901961 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f38e5a-dd11-4312-b4ef-0f4a46c53ee6 admin admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:03:05.902238 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f38e5a-dd11-4312-b4ef-0f4a46c53ee6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:03:05.902509 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f38e5a-dd11-4312-b4ef-0f4a46c53ee6 admin admin] PATH_INFO: `/v3/projects/f563450981094b63bbb2155f98be29cb/users/4047735dcddf4daabf634fdcb459bfb2/roles/43543ce1450245af9661cb017bac17bd` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:03:05.926092 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f38e5a-dd11-4312-b4ef-0f4a46c53ee6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f563450981094b63bbb2155f98be29cb, user_id=4047735dcddf4daabf634fdcb459bfb2, role_id=43543ce1450245af9661cb017bac17bd)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:03:05.929485 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f38e5a-dd11-4312-b4ef-0f4a46c53ee6 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:03:05.951866 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc614fc7-f364-495b-9ade-ba5879295def service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:03:05.953314 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc614fc7-f364-495b-9ade-ba5879295def service cinder] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:03:05.963476 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1227/2447] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Oct 27 10:03:05 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 10:03:06.000662 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1221/2448] 10.222.0.65 () {60 vars in 1483 bytes} [Thu Oct 27 10:03:05 2022] PUT /identity/v3/projects/f563450981094b63bbb2155f98be29cb/users/4047735dcddf4daabf634fdcb459bfb2/roles/43543ce1450245af9661cb017bac17bd => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 10:03:06.012604 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16c98cb-81bd-43ab-b38d-15ea0068a52a None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:03:06.013087 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16c98cb-81bd-43ab-b38d-15ea0068a52a None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:03:06.013382 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16c98cb-81bd-43ab-b38d-15ea0068a52a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:03:06.042382 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-e16c98cb-81bd-43ab-b38d-15ea0068a52a None None] MFA Rules not processed for user `4047735dcddf4daabf634fdcb459bfb2`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 10:03:06.049436 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-e16c98cb-81bd-43ab-b38d-15ea0068a52a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 10:03:06.074117 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:03:06.117666 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1228/2449] 10.222.0.65 () {58 vars in 958 bytes} [Thu Oct 27 10:03:06 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 10:03:06.130827 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f38e5a-dd11-4312-b4ef-0f4a46c53ee6 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:03:06.133470 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-a2f38e5a-dd11-4312-b4ef-0f4a46c53ee6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 10:03:06.207712 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f38e5a-dd11-4312-b4ef-0f4a46c53ee6 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:03:06.217273 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c18ca1-17d6-4c62-9e67-b63a7da44b1b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8e5d5f04c4741bb86ca4a0f667d4ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc2e3a7a1bcc480891c0b433291c00b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:03:06.217273 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c18ca1-17d6-4c62-9e67-b63a7da44b1b service cinder] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:03:06.217273 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c18ca1-17d6-4c62-9e67-b63a7da44b1b service cinder] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:03:06.217273 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c18ca1-17d6-4c62-9e67-b63a7da44b1b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:03:06.223299 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c18ca1-17d6-4c62-9e67-b63a7da44b1b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:03:06.224722 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c18ca1-17d6-4c62-9e67-b63a7da44b1b service cinder] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:03:06.234912 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1222/2450] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Oct 27 10:03:06 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 10:03:06.266193 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16c98cb-81bd-43ab-b38d-15ea0068a52a None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:03:06.338508 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16c98cb-81bd-43ab-b38d-15ea0068a52a None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:03:06.343851 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b509f3a0-541e-446a-92da-33ca0fd45915 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:03:06.344483 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b509f3a0-541e-446a-92da-33ca0fd45915 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:03:06.344765 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b509f3a0-541e-446a-92da-33ca0fd45915 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:03:06.345040 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b509f3a0-541e-446a-92da-33ca0fd45915 admin admin] PATH_INFO: `/v3/users/4047735dcddf4daabf634fdcb459bfb2` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:03:06.346195 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b509f3a0-541e-446a-92da-33ca0fd45915 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4047735dcddf4daabf634fdcb459bfb2)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:03:06.348282 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b509f3a0-541e-446a-92da-33ca0fd45915 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:03:06.637191 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-b509f3a0-541e-446a-92da-33ca0fd45915 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4047735dcddf4daabf634fdcb459bfb2'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:03:06.651187 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-b509f3a0-541e-446a-92da-33ca0fd45915 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4047735dcddf4daabf634fdcb459bfb2'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:03:06.651983 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-b509f3a0-541e-446a-92da-33ca0fd45915 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4047735dcddf4daabf634fdcb459bfb2'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:03:06.660479 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-b509f3a0-541e-446a-92da-33ca0fd45915 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4047735dcddf4daabf634fdcb459bfb2'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:03:06.713494 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-b509f3a0-541e-446a-92da-33ca0fd45915 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4047735dcddf4daabf634fdcb459bfb2'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:03:06.721444 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1229/2451] 10.222.0.65 () {58 vars in 1224 bytes} [Thu Oct 27 10:03:06 2022] DELETE /identity/v3/users/4047735dcddf4daabf634fdcb459bfb2 => generated 0 bytes in 456 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 10:03:06.726206 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b61d086-a990-4da8-bac2-f0304349e77d None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:03:06.726757 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b61d086-a990-4da8-bac2-f0304349e77d None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:03:06.726757 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b61d086-a990-4da8-bac2-f0304349e77d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:03:06.746337 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-8b61d086-a990-4da8-bac2-f0304349e77d None None] MFA Rules not processed for user `b5065084bf664b99bdeac46067cb0f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 10:03:06.748106 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-8b61d086-a990-4da8-bac2-f0304349e77d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 10:03:06.805229 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:03:06.816947 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1223/2452] 10.222.0.65 () {58 vars in 958 bytes} [Thu Oct 27 10:03:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 10:03:06.824255 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b509f3a0-541e-446a-92da-33ca0fd45915 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:03:06.826332 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-b509f3a0-541e-446a-92da-33ca0fd45915 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 10:03:06.892070 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:03:06.896525 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b509f3a0-541e-446a-92da-33ca0fd45915 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:03:06.900551 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09d18ab-3103-42e9-807b-3adf56e95484 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6191cc41efa74f46b49022cf387f7a4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc2e3a7a1bcc480891c0b433291c00b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:03:06.900991 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09d18ab-3103-42e9-807b-3adf56e95484 service neutron] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:03:06.901285 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09d18ab-3103-42e9-807b-3adf56e95484 service neutron] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:03:06.901538 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09d18ab-3103-42e9-807b-3adf56e95484 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:03:06.911669 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09d18ab-3103-42e9-807b-3adf56e95484 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:03:06.913099 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09d18ab-3103-42e9-807b-3adf56e95484 service neutron] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:03:06.923001 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1230/2453] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Oct 27 10:03:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 10:03:07.460114 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b61d086-a990-4da8-bac2-f0304349e77d None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:03:07.461667 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-8b61d086-a990-4da8-bac2-f0304349e77d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 10:03:07.474583 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b61d086-a990-4da8-bac2-f0304349e77d None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:03:07.479640 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3badfcb3-54c7-4923-bc49-d1f91b398f9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:03:07.480272 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3badfcb3-54c7-4923-bc49-d1f91b398f9a admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:03:07.480554 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3badfcb3-54c7-4923-bc49-d1f91b398f9a admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:03:07.480833 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3badfcb3-54c7-4923-bc49-d1f91b398f9a admin admin] PATH_INFO: `/v3/projects/f563450981094b63bbb2155f98be29cb` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:03:07.482113 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3badfcb3-54c7-4923-bc49-d1f91b398f9a admin admin] RBAC: Authorizing `identity:delete_project(project_id=f563450981094b63bbb2155f98be29cb)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:03:07.484035 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3badfcb3-54c7-4923-bc49-d1f91b398f9a admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:03:07.585179 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-3badfcb3-54c7-4923-bc49-d1f91b398f9a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f563450981094b63bbb2155f98be29cb', 'request_id': 'req-3badfcb3-54c7-4923-bc49-d1f91b398f9a'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:03:07.592712 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-3badfcb3-54c7-4923-bc49-d1f91b398f9a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f563450981094b63bbb2155f98be29cb', 'request_id': 'req-3badfcb3-54c7-4923-bc49-d1f91b398f9a'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:03:07.711186 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-3badfcb3-54c7-4923-bc49-d1f91b398f9a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f563450981094b63bbb2155f98be29cb', 'request_id': 'req-3badfcb3-54c7-4923-bc49-d1f91b398f9a'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:03:07.721105 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-3badfcb3-54c7-4923-bc49-d1f91b398f9a admin admin] The token cache is being invalidate because project f563450981094b63bbb2155f98be29cb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 10:03:07.721541 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-3badfcb3-54c7-4923-bc49-d1f91b398f9a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:03:07.722074 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-3badfcb3-54c7-4923-bc49-d1f91b398f9a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:03:07.723701 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1224/2454] 10.222.0.65 () {58 vars in 1233 bytes} [Thu Oct 27 10:03:07 2022] DELETE /identity/v3/projects/f563450981094b63bbb2155f98be29cb => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 10:03:10.343061 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09d18ab-3103-42e9-807b-3adf56e95484 service neutron] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:03:10.344652 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-d09d18ab-3103-42e9-807b-3adf56e95484 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 10:03:10.360558 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09d18ab-3103-42e9-807b-3adf56e95484 service neutron] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:03:10.420926 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef60383b-779f-45e2-b62c-97c089557693 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:03:10.421561 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef60383b-779f-45e2-b62c-97c089557693 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:03:10.421840 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef60383b-779f-45e2-b62c-97c089557693 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:03:10.422118 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef60383b-779f-45e2-b62c-97c089557693 admin admin] PATH_INFO: `/v3/users/dee8947b079c43429596a75ac70e72c4` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:03:10.423293 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef60383b-779f-45e2-b62c-97c089557693 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dee8947b079c43429596a75ac70e72c4)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:03:10.425251 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef60383b-779f-45e2-b62c-97c089557693 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:03:10.573946 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-ef60383b-779f-45e2-b62c-97c089557693 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dee8947b079c43429596a75ac70e72c4'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:03:10.587508 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-ef60383b-779f-45e2-b62c-97c089557693 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dee8947b079c43429596a75ac70e72c4'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:03:10.588121 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-ef60383b-779f-45e2-b62c-97c089557693 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dee8947b079c43429596a75ac70e72c4'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:03:10.596345 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-ef60383b-779f-45e2-b62c-97c089557693 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dee8947b079c43429596a75ac70e72c4'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:03:10.639865 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-ef60383b-779f-45e2-b62c-97c089557693 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dee8947b079c43429596a75ac70e72c4'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:03:10.646788 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1231/2455] 10.222.0.65 () {58 vars in 1224 bytes} [Thu Oct 27 10:03:10 2022] DELETE /identity/v3/users/dee8947b079c43429596a75ac70e72c4 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 10:03:10.651409 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f9c19e-9693-4eec-b7d1-984602c37d03 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:03:10.651890 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f9c19e-9693-4eec-b7d1-984602c37d03 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:03:10.652062 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f9c19e-9693-4eec-b7d1-984602c37d03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:03:10.672185 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-e4f9c19e-9693-4eec-b7d1-984602c37d03 None None] MFA Rules not processed for user `b5065084bf664b99bdeac46067cb0f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 10:03:10.673390 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-e4f9c19e-9693-4eec-b7d1-984602c37d03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 10:03:10.738433 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1225/2456] 10.222.0.65 () {58 vars in 958 bytes} [Thu Oct 27 10:03:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 10:03:10.748043 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef60383b-779f-45e2-b62c-97c089557693 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:03:10.749529 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-ef60383b-779f-45e2-b62c-97c089557693 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 10:03:10.824623 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef60383b-779f-45e2-b62c-97c089557693 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:03:10.829513 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e7adc8-a2be-4607-aeab-947c928ef8ed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6191cc41efa74f46b49022cf387f7a4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc2e3a7a1bcc480891c0b433291c00b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:03:10.830124 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e7adc8-a2be-4607-aeab-947c928ef8ed service neutron] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:03:10.830408 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e7adc8-a2be-4607-aeab-947c928ef8ed service neutron] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:03:10.830789 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e7adc8-a2be-4607-aeab-947c928ef8ed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:03:10.841045 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e7adc8-a2be-4607-aeab-947c928ef8ed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:03:10.842638 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e7adc8-a2be-4607-aeab-947c928ef8ed service neutron] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:03:10.854562 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1232/2457] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Oct 27 10:03:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 10:03:11.246341 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f9c19e-9693-4eec-b7d1-984602c37d03 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:03:11.248854 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-e4f9c19e-9693-4eec-b7d1-984602c37d03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 10:03:11.261184 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f9c19e-9693-4eec-b7d1-984602c37d03 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:03:11.267021 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c4e0a0-9e8a-4dbb-b11b-5e8692059255 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:03:11.272783 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c4e0a0-9e8a-4dbb-b11b-5e8692059255 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:03:11.272783 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c4e0a0-9e8a-4dbb-b11b-5e8692059255 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:03:11.272783 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c4e0a0-9e8a-4dbb-b11b-5e8692059255 admin admin] PATH_INFO: `/v3/projects/67622797e69d4af68f3de20dad2ca2f8` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:03:11.272783 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c4e0a0-9e8a-4dbb-b11b-5e8692059255 admin admin] RBAC: Authorizing `identity:delete_project(project_id=67622797e69d4af68f3de20dad2ca2f8)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:03:11.272783 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c4e0a0-9e8a-4dbb-b11b-5e8692059255 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:03:11.403015 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-90c4e0a0-9e8a-4dbb-b11b-5e8692059255 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '67622797e69d4af68f3de20dad2ca2f8', 'request_id': 'req-90c4e0a0-9e8a-4dbb-b11b-5e8692059255'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:03:11.410261 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-90c4e0a0-9e8a-4dbb-b11b-5e8692059255 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '67622797e69d4af68f3de20dad2ca2f8', 'request_id': 'req-90c4e0a0-9e8a-4dbb-b11b-5e8692059255'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:03:11.485270 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-90c4e0a0-9e8a-4dbb-b11b-5e8692059255 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '67622797e69d4af68f3de20dad2ca2f8', 'request_id': 'req-90c4e0a0-9e8a-4dbb-b11b-5e8692059255'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:03:11.496950 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-90c4e0a0-9e8a-4dbb-b11b-5e8692059255 admin admin] The token cache is being invalidate because project 67622797e69d4af68f3de20dad2ca2f8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 10:03:11.497248 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-90c4e0a0-9e8a-4dbb-b11b-5e8692059255 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:03:11.498660 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-90c4e0a0-9e8a-4dbb-b11b-5e8692059255 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:03:11.500236 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1226/2458] 10.222.0.65 () {58 vars in 1233 bytes} [Thu Oct 27 10:03:11 2022] DELETE /identity/v3/projects/67622797e69d4af68f3de20dad2ca2f8 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 10:03:11.504277 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e7adc8-a2be-4607-aeab-947c928ef8ed service neutron] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:03:11.514567 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e7adc8-a2be-4607-aeab-947c928ef8ed service neutron] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:03:11.523735 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:03:11.573116 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81df93ec-a798-4f43-8927-e42e72ebf7f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:03:11.573756 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81df93ec-a798-4f43-8927-e42e72ebf7f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:03:11.574043 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81df93ec-a798-4f43-8927-e42e72ebf7f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:03:11.574327 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81df93ec-a798-4f43-8927-e42e72ebf7f4 admin admin] PATH_INFO: `/v3/users/68a44317382a450f91f108fda5e22f43` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:03:11.575547 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81df93ec-a798-4f43-8927-e42e72ebf7f4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=68a44317382a450f91f108fda5e22f43)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:03:11.577824 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81df93ec-a798-4f43-8927-e42e72ebf7f4 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:03:11.756176 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-81df93ec-a798-4f43-8927-e42e72ebf7f4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '68a44317382a450f91f108fda5e22f43'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:03:11.769143 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-81df93ec-a798-4f43-8927-e42e72ebf7f4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '68a44317382a450f91f108fda5e22f43'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:03:11.770015 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-81df93ec-a798-4f43-8927-e42e72ebf7f4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '68a44317382a450f91f108fda5e22f43'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:03:11.777366 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-81df93ec-a798-4f43-8927-e42e72ebf7f4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '68a44317382a450f91f108fda5e22f43'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:03:11.850814 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-81df93ec-a798-4f43-8927-e42e72ebf7f4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '68a44317382a450f91f108fda5e22f43'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:03:11.858562 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1233/2459] 10.222.0.65 () {58 vars in 1224 bytes} [Thu Oct 27 10:03:11 2022] DELETE /identity/v3/users/68a44317382a450f91f108fda5e22f43 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 10:03:12.240890 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c4e0a0-9e8a-4dbb-b11b-5e8692059255 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:03:12.242353 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-90c4e0a0-9e8a-4dbb-b11b-5e8692059255 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 10:03:12.255622 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c4e0a0-9e8a-4dbb-b11b-5e8692059255 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:03:12.259367 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:03:12.316563 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e98d06c-8765-4bc0-b877-591b645211fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:03:12.317113 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e98d06c-8765-4bc0-b877-591b645211fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:03:12.317396 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e98d06c-8765-4bc0-b877-591b645211fd admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:03:12.317665 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e98d06c-8765-4bc0-b877-591b645211fd admin admin] PATH_INFO: `/v3/projects/50d50e5a810c434eaaa25e406417e213` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:03:12.318934 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e98d06c-8765-4bc0-b877-591b645211fd admin admin] RBAC: Authorizing `identity:delete_project(project_id=50d50e5a810c434eaaa25e406417e213)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:03:12.320838 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e98d06c-8765-4bc0-b877-591b645211fd admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:03:12.421486 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-8e98d06c-8765-4bc0-b877-591b645211fd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '50d50e5a810c434eaaa25e406417e213', 'request_id': 'req-8e98d06c-8765-4bc0-b877-591b645211fd'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:03:12.431656 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-8e98d06c-8765-4bc0-b877-591b645211fd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '50d50e5a810c434eaaa25e406417e213', 'request_id': 'req-8e98d06c-8765-4bc0-b877-591b645211fd'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:03:12.542127 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-8e98d06c-8765-4bc0-b877-591b645211fd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '50d50e5a810c434eaaa25e406417e213', 'request_id': 'req-8e98d06c-8765-4bc0-b877-591b645211fd'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:03:12.554181 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-8e98d06c-8765-4bc0-b877-591b645211fd admin admin] The token cache is being invalidate because project 50d50e5a810c434eaaa25e406417e213 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 10:03:12.554477 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-8e98d06c-8765-4bc0-b877-591b645211fd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:03:12.555147 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-8e98d06c-8765-4bc0-b877-591b645211fd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:03:12.556818 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1227/2460] 10.222.0.65 () {58 vars in 1233 bytes} [Thu Oct 27 10:03:12 2022] DELETE /identity/v3/projects/50d50e5a810c434eaaa25e406417e213 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 10:03:12.563338 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae7a93f-6773-4fff-8b44-fa2746c24ab0 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:03:12.563850 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae7a93f-6773-4fff-8b44-fa2746c24ab0 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:03:12.563967 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae7a93f-6773-4fff-8b44-fa2746c24ab0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:03:12.588283 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-2ae7a93f-6773-4fff-8b44-fa2746c24ab0 None None] MFA Rules not processed for user `b5065084bf664b99bdeac46067cb0f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 10:03:12.589398 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-2ae7a93f-6773-4fff-8b44-fa2746c24ab0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 10:03:12.654799 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1234/2461] 10.222.0.65 () {58 vars in 958 bytes} [Thu Oct 27 10:03:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 10:03:12.666042 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8039ddae-40b7-4437-8fc2-02846a8fbacb None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:03:12.666355 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8039ddae-40b7-4437-8fc2-02846a8fbacb None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:03:12.666652 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8039ddae-40b7-4437-8fc2-02846a8fbacb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:03:12.688365 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-8039ddae-40b7-4437-8fc2-02846a8fbacb None None] MFA Rules not processed for user `b5065084bf664b99bdeac46067cb0f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 10:03:12.689699 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-8039ddae-40b7-4437-8fc2-02846a8fbacb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 10:03:12.697728 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1228/2462] 10.222.0.65 () {58 vars in 958 bytes} [Thu Oct 27 10:03:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 10:03:12.702179 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae7a93f-6773-4fff-8b44-fa2746c24ab0 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:03:12.712583 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae7a93f-6773-4fff-8b44-fa2746c24ab0 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:03:12.717216 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d3508f-3565-4d3b-bb81-dd12ffdfae83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:03:12.717813 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d3508f-3565-4d3b-bb81-dd12ffdfae83 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:03:12.718093 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d3508f-3565-4d3b-bb81-dd12ffdfae83 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:03:12.718362 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d3508f-3565-4d3b-bb81-dd12ffdfae83 admin admin] PATH_INFO: `/v3/domains` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:03:12.719068 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d3508f-3565-4d3b-bb81-dd12ffdfae83 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 10:03:12.721824 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d3508f-3565-4d3b-bb81-dd12ffdfae83 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:03:12.721824 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d3508f-3565-4d3b-bb81-dd12ffdfae83 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:03:12.734285 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1235/2463] 10.222.0.65 () {58 vars in 1153 bytes} [Thu Oct 27 10:03:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 10:03:12.738615 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8039ddae-40b7-4437-8fc2-02846a8fbacb None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:03:12.748830 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8039ddae-40b7-4437-8fc2-02846a8fbacb None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:03:12.753459 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2c8561-174c-4df7-b4e9-9ce827904b05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:03:12.754048 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2c8561-174c-4df7-b4e9-9ce827904b05 admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:03:12.754326 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2c8561-174c-4df7-b4e9-9ce827904b05 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:03:12.754624 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2c8561-174c-4df7-b4e9-9ce827904b05 admin admin] PATH_INFO: `/v3/projects` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:03:12.755248 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2c8561-174c-4df7-b4e9-9ce827904b05 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:03:12.757124 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2c8561-174c-4df7-b4e9-9ce827904b05 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:03:12.858635 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1229/2464] 10.222.0.65 () {60 vars in 1153 bytes} [Thu Oct 27 10:03:12 2022] POST /identity/v3/projects => generated 389 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 10:03:12.859644 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d3508f-3565-4d3b-bb81-dd12ffdfae83 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:03:12.870854 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d3508f-3565-4d3b-bb81-dd12ffdfae83 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:03:12.889716 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:03:12.929291 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cb15a1-c64d-49cd-b435-9005b2b52fce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:03:12.929900 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cb15a1-c64d-49cd-b435-9005b2b52fce admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:03:12.930180 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cb15a1-c64d-49cd-b435-9005b2b52fce admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:03:12.930455 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cb15a1-c64d-49cd-b435-9005b2b52fce admin admin] PATH_INFO: `/v3/users` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:03:12.931126 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3cb15a1-c64d-49cd-b435-9005b2b52fce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:03:12.933113 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3cb15a1-c64d-49cd-b435-9005b2b52fce admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:03:13.046078 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1236/2465] 10.222.0.65 () {60 vars in 1144 bytes} [Thu Oct 27 10:03:12 2022] POST /identity/v3/users => generated 295 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 10:03:13.050375 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2c8561-174c-4df7-b4e9-9ce827904b05 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:03:13.061082 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2c8561-174c-4df7-b4e9-9ce827904b05 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:03:13.066767 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5791b84-4be2-4e4e-b15b-67a3f3d82aea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:03:13.067438 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5791b84-4be2-4e4e-b15b-67a3f3d82aea admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:03:13.067730 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5791b84-4be2-4e4e-b15b-67a3f3d82aea admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:03:13.068031 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5791b84-4be2-4e4e-b15b-67a3f3d82aea admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:03:13.068667 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5791b84-4be2-4e4e-b15b-67a3f3d82aea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:03:13.070356 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5791b84-4be2-4e4e-b15b-67a3f3d82aea admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:03:13.081451 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1230/2466] 10.222.0.65 () {58 vars in 1122 bytes} [Thu Oct 27 10:03:13 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 10:03:13.086096 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cb15a1-c64d-49cd-b435-9005b2b52fce admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:03:13.096850 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cb15a1-c64d-49cd-b435-9005b2b52fce admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:03:13.101546 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c544f22-4f53-4fa2-9941-e7d44877e62e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:03:13.102133 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c544f22-4f53-4fa2-9941-e7d44877e62e admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:03:13.102410 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c544f22-4f53-4fa2-9941-e7d44877e62e admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:03:13.102744 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c544f22-4f53-4fa2-9941-e7d44877e62e admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:03:13.103380 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c544f22-4f53-4fa2-9941-e7d44877e62e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:03:13.105071 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c544f22-4f53-4fa2-9941-e7d44877e62e admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:03:13.119528 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1237/2467] 10.222.0.65 () {58 vars in 1122 bytes} [Thu Oct 27 10:03:13 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 10:03:13.127884 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5791b84-4be2-4e4e-b15b-67a3f3d82aea admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:03:13.138164 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5791b84-4be2-4e4e-b15b-67a3f3d82aea admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:03:13.143618 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9c35a7-456e-4716-b68d-d0cf8f37d895 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:03:13.144270 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9c35a7-456e-4716-b68d-d0cf8f37d895 admin admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:03:13.144554 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9c35a7-456e-4716-b68d-d0cf8f37d895 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:03:13.144848 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9c35a7-456e-4716-b68d-d0cf8f37d895 admin admin] PATH_INFO: `/v3/projects/2440e9a561cc4043b726a7828ead4ad2/users/cdb17172c9574d119ea0515d3cb65539/roles/43543ce1450245af9661cb017bac17bd` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:03:13.160902 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9c35a7-456e-4716-b68d-d0cf8f37d895 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2440e9a561cc4043b726a7828ead4ad2, user_id=cdb17172c9574d119ea0515d3cb65539, role_id=43543ce1450245af9661cb017bac17bd)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:03:13.163782 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9c35a7-456e-4716-b68d-d0cf8f37d895 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:03:13.256904 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1231/2468] 10.222.0.65 () {60 vars in 1483 bytes} [Thu Oct 27 10:03:13 2022] PUT /identity/v3/projects/2440e9a561cc4043b726a7828ead4ad2/users/cdb17172c9574d119ea0515d3cb65539/roles/43543ce1450245af9661cb017bac17bd => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 10:03:13.267468 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998e3c62-93b3-463a-a78f-a0cea074a281 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:03:13.267748 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998e3c62-93b3-463a-a78f-a0cea074a281 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:03:13.268008 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998e3c62-93b3-463a-a78f-a0cea074a281 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:03:13.297917 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-998e3c62-93b3-463a-a78f-a0cea074a281 None None] MFA Rules not processed for user `cdb17172c9574d119ea0515d3cb65539`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 10:03:13.299161 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-998e3c62-93b3-463a-a78f-a0cea074a281 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 10:03:13.366730 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1238/2469] 10.222.0.65 () {58 vars in 958 bytes} [Thu Oct 27 10:03:13 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 10:03:13.371149 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9c35a7-456e-4716-b68d-d0cf8f37d895 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:03:13.408027 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:03:13.437366 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9c35a7-456e-4716-b68d-d0cf8f37d895 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:03:13.442000 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297f4aa7-cdea-4864-9edd-b516707d0ef8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:03:13.442625 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297f4aa7-cdea-4864-9edd-b516707d0ef8 admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:03:13.442969 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297f4aa7-cdea-4864-9edd-b516707d0ef8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:03:13.443316 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297f4aa7-cdea-4864-9edd-b516707d0ef8 admin admin] PATH_INFO: `/v3/projects` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:03:13.443880 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297f4aa7-cdea-4864-9edd-b516707d0ef8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:03:13.445768 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297f4aa7-cdea-4864-9edd-b516707d0ef8 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:03:13.543264 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1232/2470] 10.222.0.65 () {60 vars in 1153 bytes} [Thu Oct 27 10:03:13 2022] POST /identity/v3/projects => generated 389 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 10:03:13.547546 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998e3c62-93b3-463a-a78f-a0cea074a281 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:03:13.558668 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998e3c62-93b3-463a-a78f-a0cea074a281 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:03:13.617708 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0121b2b-afbb-4041-af62-6da04a14e10c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:03:13.618382 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0121b2b-afbb-4041-af62-6da04a14e10c admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:03:13.618488 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0121b2b-afbb-4041-af62-6da04a14e10c admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:03:13.618796 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0121b2b-afbb-4041-af62-6da04a14e10c admin admin] PATH_INFO: `/v3/users` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:03:13.619429 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0121b2b-afbb-4041-af62-6da04a14e10c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:03:13.621336 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0121b2b-afbb-4041-af62-6da04a14e10c admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:03:13.748290 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1239/2471] 10.222.0.65 () {60 vars in 1144 bytes} [Thu Oct 27 10:03:13 2022] POST /identity/v3/users => generated 301 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 10:03:13.752295 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297f4aa7-cdea-4864-9edd-b516707d0ef8 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:03:13.762727 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297f4aa7-cdea-4864-9edd-b516707d0ef8 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:03:13.768279 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c4ce7c-4556-498f-8960-0afe0c786628 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:03:13.768912 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c4ce7c-4556-498f-8960-0afe0c786628 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:03:13.769196 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c4ce7c-4556-498f-8960-0afe0c786628 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:03:13.769472 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c4ce7c-4556-498f-8960-0afe0c786628 admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:03:13.770114 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c4ce7c-4556-498f-8960-0afe0c786628 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:03:13.771763 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c4ce7c-4556-498f-8960-0afe0c786628 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:03:13.782877 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1233/2472] 10.222.0.65 () {58 vars in 1122 bytes} [Thu Oct 27 10:03:13 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 10:03:13.787108 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0121b2b-afbb-4041-af62-6da04a14e10c admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:03:13.797748 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0121b2b-afbb-4041-af62-6da04a14e10c admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:03:13.811628 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc9ea67-4255-4818-858d-59be35fc95e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:03:13.812293 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc9ea67-4255-4818-858d-59be35fc95e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:03:13.812575 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc9ea67-4255-4818-858d-59be35fc95e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:03:13.812846 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc9ea67-4255-4818-858d-59be35fc95e0 admin admin] PATH_INFO: `/v3/projects/a3d9b86391804c878d49e827dddfc2da/users/dff7cefe0d624d60947547680c9f672e/roles/6ad17b9f9dea4b66ab2da3677d7e715d` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:03:13.828610 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc9ea67-4255-4818-858d-59be35fc95e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a3d9b86391804c878d49e827dddfc2da, user_id=dff7cefe0d624d60947547680c9f672e, role_id=6ad17b9f9dea4b66ab2da3677d7e715d)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:03:13.831288 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc9ea67-4255-4818-858d-59be35fc95e0 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:03:13.833688 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:03:13.905576 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1240/2473] 10.222.0.65 () {60 vars in 1483 bytes} [Thu Oct 27 10:03:13 2022] PUT /identity/v3/projects/a3d9b86391804c878d49e827dddfc2da/users/dff7cefe0d624d60947547680c9f672e/roles/6ad17b9f9dea4b66ab2da3677d7e715d => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 10:03:13.908133 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c4ce7c-4556-498f-8960-0afe0c786628 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:03:13.920889 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c4ce7c-4556-498f-8960-0afe0c786628 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:03:13.980400 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89414d7-a291-4947-b522-931b1180f650 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:03:13.981010 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89414d7-a291-4947-b522-931b1180f650 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:03:13.981289 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89414d7-a291-4947-b522-931b1180f650 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:03:13.981588 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89414d7-a291-4947-b522-931b1180f650 admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:03:13.982227 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89414d7-a291-4947-b522-931b1180f650 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:03:13.984015 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89414d7-a291-4947-b522-931b1180f650 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:03:13.998136 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1234/2474] 10.222.0.65 () {58 vars in 1122 bytes} [Thu Oct 27 10:03:13 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 10:03:14.000265 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc9ea67-4255-4818-858d-59be35fc95e0 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:03:14.012332 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc9ea67-4255-4818-858d-59be35fc95e0 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:03:14.017861 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9076d1-97e2-4504-877b-2e6b923c36b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:03:14.018523 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9076d1-97e2-4504-877b-2e6b923c36b3 admin admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:03:14.018828 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9076d1-97e2-4504-877b-2e6b923c36b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:03:14.019162 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9076d1-97e2-4504-877b-2e6b923c36b3 admin admin] PATH_INFO: `/v3/projects/a3d9b86391804c878d49e827dddfc2da/users/dff7cefe0d624d60947547680c9f672e/roles/6ad17b9f9dea4b66ab2da3677d7e715d` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:03:14.021011 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9076d1-97e2-4504-877b-2e6b923c36b3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a3d9b86391804c878d49e827dddfc2da, user_id=dff7cefe0d624d60947547680c9f672e, role_id=6ad17b9f9dea4b66ab2da3677d7e715d)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:03:14.023716 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9076d1-97e2-4504-877b-2e6b923c36b3 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:03:14.034898 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1241/2475] 10.222.0.65 () {60 vars in 1483 bytes} [Thu Oct 27 10:03:13 2022] PUT /identity/v3/projects/a3d9b86391804c878d49e827dddfc2da/users/dff7cefe0d624d60947547680c9f672e/roles/6ad17b9f9dea4b66ab2da3677d7e715d => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 10:03:14.045188 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4db0b6-465a-49cb-bc29-1e62ef41e0d7 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:03:14.045473 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4db0b6-465a-49cb-bc29-1e62ef41e0d7 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:03:14.045749 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4db0b6-465a-49cb-bc29-1e62ef41e0d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:03:14.073943 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-4f4db0b6-465a-49cb-bc29-1e62ef41e0d7 None None] MFA Rules not processed for user `dff7cefe0d624d60947547680c9f672e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 10:03:14.075187 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-4f4db0b6-465a-49cb-bc29-1e62ef41e0d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 10:03:14.147456 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1235/2476] 10.222.0.65 () {58 vars in 958 bytes} [Thu Oct 27 10:03:14 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 10:03:14.158225 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9076d1-97e2-4504-877b-2e6b923c36b3 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:03:14.163131 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-0b9076d1-97e2-4504-877b-2e6b923c36b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 10:03:14.225201 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9076d1-97e2-4504-877b-2e6b923c36b3 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:03:14.229556 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbc2328-4c15-4220-bf60-fb0037ee1b48 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8e5d5f04c4741bb86ca4a0f667d4ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc2e3a7a1bcc480891c0b433291c00b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:03:14.230202 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbc2328-4c15-4220-bf60-fb0037ee1b48 service cinder] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:03:14.230484 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbc2328-4c15-4220-bf60-fb0037ee1b48 service cinder] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:03:14.230783 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbc2328-4c15-4220-bf60-fb0037ee1b48 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:03:14.240835 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbc2328-4c15-4220-bf60-fb0037ee1b48 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:03:14.242269 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbc2328-4c15-4220-bf60-fb0037ee1b48 service cinder] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:03:14.252830 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1242/2477] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Oct 27 10:03:14 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 10:03:14.391978 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4db0b6-465a-49cb-bc29-1e62ef41e0d7 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:03:14.426553 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:03:14.459127 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4db0b6-465a-49cb-bc29-1e62ef41e0d7 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:03:14.464091 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dceaa948-e6d6-4e0e-9c05-1ed0dbeb0f8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:03:14.464723 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dceaa948-e6d6-4e0e-9c05-1ed0dbeb0f8f admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:03:14.465008 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dceaa948-e6d6-4e0e-9c05-1ed0dbeb0f8f admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:03:14.465286 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dceaa948-e6d6-4e0e-9c05-1ed0dbeb0f8f admin admin] PATH_INFO: `/v3/users/cdb17172c9574d119ea0515d3cb65539` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:03:14.467047 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dceaa948-e6d6-4e0e-9c05-1ed0dbeb0f8f admin admin] RBAC: Authorizing `identity:delete_user(user_id=cdb17172c9574d119ea0515d3cb65539)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:03:14.469021 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dceaa948-e6d6-4e0e-9c05-1ed0dbeb0f8f admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:03:14.643467 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-dceaa948-e6d6-4e0e-9c05-1ed0dbeb0f8f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cdb17172c9574d119ea0515d3cb65539'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:03:14.644133 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-dceaa948-e6d6-4e0e-9c05-1ed0dbeb0f8f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cdb17172c9574d119ea0515d3cb65539'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:03:14.652602 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-dceaa948-e6d6-4e0e-9c05-1ed0dbeb0f8f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cdb17172c9574d119ea0515d3cb65539'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:03:14.653544 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-dceaa948-e6d6-4e0e-9c05-1ed0dbeb0f8f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cdb17172c9574d119ea0515d3cb65539'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:03:14.666938 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-dceaa948-e6d6-4e0e-9c05-1ed0dbeb0f8f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cdb17172c9574d119ea0515d3cb65539'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:03:14.730540 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1236/2478] 10.222.0.65 () {58 vars in 1224 bytes} [Thu Oct 27 10:03:14 2022] DELETE /identity/v3/users/cdb17172c9574d119ea0515d3cb65539 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 10:03:14.735951 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0af25af-efac-4348-b617-667971b83cfc None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:03:14.736466 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0af25af-efac-4348-b617-667971b83cfc None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:03:14.736595 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0af25af-efac-4348-b617-667971b83cfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:03:14.756741 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-d0af25af-efac-4348-b617-667971b83cfc None None] MFA Rules not processed for user `b5065084bf664b99bdeac46067cb0f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 10:03:14.758008 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-d0af25af-efac-4348-b617-667971b83cfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 10:03:14.820054 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1243/2479] 10.222.0.65 () {58 vars in 958 bytes} [Thu Oct 27 10:03:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 10:03:14.830643 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dceaa948-e6d6-4e0e-9c05-1ed0dbeb0f8f admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:03:14.832418 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-dceaa948-e6d6-4e0e-9c05-1ed0dbeb0f8f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 10:03:14.895034 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dceaa948-e6d6-4e0e-9c05-1ed0dbeb0f8f admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:03:14.898843 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58e86d1-f72b-4541-9fb4-64d5a7fa3d1f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6191cc41efa74f46b49022cf387f7a4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc2e3a7a1bcc480891c0b433291c00b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:03:14.899454 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58e86d1-f72b-4541-9fb4-64d5a7fa3d1f service neutron] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:03:14.899733 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58e86d1-f72b-4541-9fb4-64d5a7fa3d1f service neutron] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:03:14.900046 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58e86d1-f72b-4541-9fb4-64d5a7fa3d1f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:03:14.910462 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58e86d1-f72b-4541-9fb4-64d5a7fa3d1f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:03:14.911877 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58e86d1-f72b-4541-9fb4-64d5a7fa3d1f service neutron] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:03:14.921841 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1237/2480] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Oct 27 10:03:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 10:03:15.366883 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0af25af-efac-4348-b617-667971b83cfc None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:03:15.368302 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-d0af25af-efac-4348-b617-667971b83cfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 10:03:15.381464 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0af25af-efac-4348-b617-667971b83cfc None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:03:15.386918 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8eee7cc-6890-4056-ac6b-ee0629c198f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:03:15.387450 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8eee7cc-6890-4056-ac6b-ee0629c198f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:03:15.388249 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8eee7cc-6890-4056-ac6b-ee0629c198f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:03:15.388249 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8eee7cc-6890-4056-ac6b-ee0629c198f4 admin admin] PATH_INFO: `/v3/projects/2440e9a561cc4043b726a7828ead4ad2` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:03:15.390090 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8eee7cc-6890-4056-ac6b-ee0629c198f4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2440e9a561cc4043b726a7828ead4ad2)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:03:15.392729 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8eee7cc-6890-4056-ac6b-ee0629c198f4 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:03:15.520683 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-c8eee7cc-6890-4056-ac6b-ee0629c198f4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2440e9a561cc4043b726a7828ead4ad2', 'request_id': 'req-c8eee7cc-6890-4056-ac6b-ee0629c198f4'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:03:15.576350 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-c8eee7cc-6890-4056-ac6b-ee0629c198f4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2440e9a561cc4043b726a7828ead4ad2', 'request_id': 'req-c8eee7cc-6890-4056-ac6b-ee0629c198f4'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:03:15.583520 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-c8eee7cc-6890-4056-ac6b-ee0629c198f4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2440e9a561cc4043b726a7828ead4ad2', 'request_id': 'req-c8eee7cc-6890-4056-ac6b-ee0629c198f4'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:03:15.594859 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-c8eee7cc-6890-4056-ac6b-ee0629c198f4 admin admin] The token cache is being invalidate because project 2440e9a561cc4043b726a7828ead4ad2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 10:03:15.595195 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-c8eee7cc-6890-4056-ac6b-ee0629c198f4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:03:15.595829 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-c8eee7cc-6890-4056-ac6b-ee0629c198f4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:03:15.597404 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1244/2481] 10.222.0.65 () {58 vars in 1233 bytes} [Thu Oct 27 10:03:15 2022] DELETE /identity/v3/projects/2440e9a561cc4043b726a7828ead4ad2 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 10:03:15.601450 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58e86d1-f72b-4541-9fb4-64d5a7fa3d1f service neutron] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:03:15.611335 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58e86d1-f72b-4541-9fb4-64d5a7fa3d1f service neutron] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:03:15.661787 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:03:15.672712 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e3038b-95ca-4646-b6ce-0c7f4f735fe7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:03:15.673116 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e3038b-95ca-4646-b6ce-0c7f4f735fe7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:03:15.673399 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e3038b-95ca-4646-b6ce-0c7f4f735fe7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:03:15.678429 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e3038b-95ca-4646-b6ce-0c7f4f735fe7 admin admin] PATH_INFO: `/v3/users/dff7cefe0d624d60947547680c9f672e` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:03:15.678429 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e3038b-95ca-4646-b6ce-0c7f4f735fe7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dff7cefe0d624d60947547680c9f672e)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:03:15.678429 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e3038b-95ca-4646-b6ce-0c7f4f735fe7 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:03:15.888637 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-30e3038b-95ca-4646-b6ce-0c7f4f735fe7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dff7cefe0d624d60947547680c9f672e'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:03:15.889731 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-30e3038b-95ca-4646-b6ce-0c7f4f735fe7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dff7cefe0d624d60947547680c9f672e'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:03:15.897461 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-30e3038b-95ca-4646-b6ce-0c7f4f735fe7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dff7cefe0d624d60947547680c9f672e'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:03:15.898108 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-30e3038b-95ca-4646-b6ce-0c7f4f735fe7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dff7cefe0d624d60947547680c9f672e'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:03:15.913413 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-30e3038b-95ca-4646-b6ce-0c7f4f735fe7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dff7cefe0d624d60947547680c9f672e'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:03:15.982120 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1238/2482] 10.222.0.65 () {58 vars in 1224 bytes} [Thu Oct 27 10:03:15 2022] DELETE /identity/v3/users/dff7cefe0d624d60947547680c9f672e => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 10:03:16.397171 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8eee7cc-6890-4056-ac6b-ee0629c198f4 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:03:16.399048 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-c8eee7cc-6890-4056-ac6b-ee0629c198f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 10:03:16.415184 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8eee7cc-6890-4056-ac6b-ee0629c198f4 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:03:16.419934 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:INSERT=3,keystone:SELECT=90,keystone:DELETE=7 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:03:16.486794 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b1ee21-e978-49b8-948b-79daa68c2d33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:03:16.487443 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b1ee21-e978-49b8-948b-79daa68c2d33 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:03:16.487727 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b1ee21-e978-49b8-948b-79daa68c2d33 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:03:16.488005 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b1ee21-e978-49b8-948b-79daa68c2d33 admin admin] PATH_INFO: `/v3/projects/a3d9b86391804c878d49e827dddfc2da` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:03:16.489183 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b1ee21-e978-49b8-948b-79daa68c2d33 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a3d9b86391804c878d49e827dddfc2da)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:03:16.491177 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b1ee21-e978-49b8-948b-79daa68c2d33 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:03:16.611962 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-51b1ee21-e978-49b8-948b-79daa68c2d33 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a3d9b86391804c878d49e827dddfc2da', 'request_id': 'req-51b1ee21-e978-49b8-948b-79daa68c2d33'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:03:16.667572 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-51b1ee21-e978-49b8-948b-79daa68c2d33 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a3d9b86391804c878d49e827dddfc2da', 'request_id': 'req-51b1ee21-e978-49b8-948b-79daa68c2d33'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:03:16.673937 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-51b1ee21-e978-49b8-948b-79daa68c2d33 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a3d9b86391804c878d49e827dddfc2da', 'request_id': 'req-51b1ee21-e978-49b8-948b-79daa68c2d33'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:03:16.685912 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-51b1ee21-e978-49b8-948b-79daa68c2d33 admin admin] The token cache is being invalidate because project a3d9b86391804c878d49e827dddfc2da was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 10:03:16.687844 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-51b1ee21-e978-49b8-948b-79daa68c2d33 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:03:16.687844 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-51b1ee21-e978-49b8-948b-79daa68c2d33 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:03:16.688803 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1245/2483] 10.222.0.65 () {58 vars in 1233 bytes} [Thu Oct 27 10:03:16 2022] DELETE /identity/v3/projects/a3d9b86391804c878d49e827dddfc2da => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 10:03:16.693887 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e14328-db60-480f-b454-b7f80411f3ca None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:03:16.694382 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e14328-db60-480f-b454-b7f80411f3ca None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:03:16.694481 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e14328-db60-480f-b454-b7f80411f3ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:03:16.715440 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-21e14328-db60-480f-b454-b7f80411f3ca None None] MFA Rules not processed for user `b5065084bf664b99bdeac46067cb0f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 10:03:16.716746 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-21e14328-db60-480f-b454-b7f80411f3ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 10:03:16.786609 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1239/2484] 10.222.0.65 () {58 vars in 958 bytes} [Thu Oct 27 10:03:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 10:03:16.795481 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabe7353-7eff-4a94-b2cf-6fc183037e66 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:03:16.795768 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabe7353-7eff-4a94-b2cf-6fc183037e66 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:03:16.796045 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabe7353-7eff-4a94-b2cf-6fc183037e66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:03:16.816754 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-eabe7353-7eff-4a94-b2cf-6fc183037e66 None None] MFA Rules not processed for user `b5065084bf664b99bdeac46067cb0f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 10:03:16.817975 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-eabe7353-7eff-4a94-b2cf-6fc183037e66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 10:03:16.826094 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1246/2485] 10.222.0.65 () {58 vars in 958 bytes} [Thu Oct 27 10:03:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 10:03:16.832460 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e14328-db60-480f-b454-b7f80411f3ca None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:03:16.842319 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e14328-db60-480f-b454-b7f80411f3ca None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:03:16.847808 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67ccfbb-9316-4d3f-aa9d-b8a07a1b0e0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:03:16.848418 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67ccfbb-9316-4d3f-aa9d-b8a07a1b0e0e admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:03:16.848700 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67ccfbb-9316-4d3f-aa9d-b8a07a1b0e0e admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:03:16.849036 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67ccfbb-9316-4d3f-aa9d-b8a07a1b0e0e admin admin] PATH_INFO: `/v3/domains` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:03:16.849689 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67ccfbb-9316-4d3f-aa9d-b8a07a1b0e0e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 10:03:16.849998 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67ccfbb-9316-4d3f-aa9d-b8a07a1b0e0e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:03:16.851685 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67ccfbb-9316-4d3f-aa9d-b8a07a1b0e0e admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:03:16.865830 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1240/2486] 10.222.0.65 () {58 vars in 1153 bytes} [Thu Oct 27 10:03:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 10:03:16.870168 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabe7353-7eff-4a94-b2cf-6fc183037e66 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:03:16.881014 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabe7353-7eff-4a94-b2cf-6fc183037e66 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:03:16.886173 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eab4c16-6413-453d-8592-029b7e820e0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:03:16.886882 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eab4c16-6413-453d-8592-029b7e820e0e admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:03:16.887170 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eab4c16-6413-453d-8592-029b7e820e0e admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:03:16.887480 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eab4c16-6413-453d-8592-029b7e820e0e admin admin] PATH_INFO: `/v3/projects` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:03:16.888210 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eab4c16-6413-453d-8592-029b7e820e0e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:03:16.891072 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eab4c16-6413-453d-8592-029b7e820e0e admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:03:17.019215 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1247/2487] 10.222.0.65 () {60 vars in 1153 bytes} [Thu Oct 27 10:03:16 2022] POST /identity/v3/projects => generated 377 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 10:03:17.023676 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67ccfbb-9316-4d3f-aa9d-b8a07a1b0e0e admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:03:17.034280 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67ccfbb-9316-4d3f-aa9d-b8a07a1b0e0e admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:03:17.086737 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:03:17.093232 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4dd0fbc-5f74-4d55-847c-d3bc0bd81544 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:03:17.093846 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dd0fbc-5f74-4d55-847c-d3bc0bd81544 admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:03:17.094132 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dd0fbc-5f74-4d55-847c-d3bc0bd81544 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:03:17.094412 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dd0fbc-5f74-4d55-847c-d3bc0bd81544 admin admin] PATH_INFO: `/v3/users` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:03:17.095157 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4dd0fbc-5f74-4d55-847c-d3bc0bd81544 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:03:17.097129 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4dd0fbc-5f74-4d55-847c-d3bc0bd81544 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:03:17.182749 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1241/2488] 10.222.0.65 () {60 vars in 1144 bytes} [Thu Oct 27 10:03:17 2022] POST /identity/v3/users => generated 289 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 10:03:17.190830 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eab4c16-6413-453d-8592-029b7e820e0e admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:03:17.202071 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eab4c16-6413-453d-8592-029b7e820e0e admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:03:17.207279 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bccc958-be66-4f55-b283-1bad70fd14d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:03:17.207889 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bccc958-be66-4f55-b283-1bad70fd14d9 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:03:17.208210 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bccc958-be66-4f55-b283-1bad70fd14d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:03:17.208455 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bccc958-be66-4f55-b283-1bad70fd14d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:03:17.209099 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bccc958-be66-4f55-b283-1bad70fd14d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:03:17.210716 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bccc958-be66-4f55-b283-1bad70fd14d9 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:03:17.221948 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1248/2489] 10.222.0.65 () {58 vars in 1122 bytes} [Thu Oct 27 10:03:17 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 10:03:17.226191 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4dd0fbc-5f74-4d55-847c-d3bc0bd81544 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:03:17.237141 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4dd0fbc-5f74-4d55-847c-d3bc0bd81544 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:03:17.241999 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877e61a9-84f0-4d26-aad5-4833d9044ef7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:03:17.242638 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877e61a9-84f0-4d26-aad5-4833d9044ef7 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:03:17.242923 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877e61a9-84f0-4d26-aad5-4833d9044ef7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:03:17.243194 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877e61a9-84f0-4d26-aad5-4833d9044ef7 admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:03:17.243847 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877e61a9-84f0-4d26-aad5-4833d9044ef7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:03:17.246082 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877e61a9-84f0-4d26-aad5-4833d9044ef7 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:03:17.259269 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1242/2490] 10.222.0.65 () {58 vars in 1122 bytes} [Thu Oct 27 10:03:17 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 10:03:17.263405 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bccc958-be66-4f55-b283-1bad70fd14d9 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:03:17.274398 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bccc958-be66-4f55-b283-1bad70fd14d9 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:03:17.279837 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbacf35c-e4b9-4452-9379-dd9d403496a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:03:17.280506 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbacf35c-e4b9-4452-9379-dd9d403496a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:03:17.280794 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbacf35c-e4b9-4452-9379-dd9d403496a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:03:17.281076 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbacf35c-e4b9-4452-9379-dd9d403496a5 admin admin] PATH_INFO: `/v3/projects/3edea26fb1374063a8554b3584b4aa1c/users/b135f00ca40d4a09b797fe5664cdf7df/roles/43543ce1450245af9661cb017bac17bd` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:03:17.297029 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbacf35c-e4b9-4452-9379-dd9d403496a5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3edea26fb1374063a8554b3584b4aa1c, user_id=b135f00ca40d4a09b797fe5664cdf7df, role_id=43543ce1450245af9661cb017bac17bd)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:03:17.299745 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbacf35c-e4b9-4452-9379-dd9d403496a5 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:03:17.423779 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1249/2491] 10.222.0.65 () {60 vars in 1483 bytes} [Thu Oct 27 10:03:17 2022] PUT /identity/v3/projects/3edea26fb1374063a8554b3584b4aa1c/users/b135f00ca40d4a09b797fe5664cdf7df/roles/43543ce1450245af9661cb017bac17bd => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 10:03:17.434170 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32f23cb-457a-478b-ab44-a01a1079435a None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:03:17.434459 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32f23cb-457a-478b-ab44-a01a1079435a None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:03:17.434770 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32f23cb-457a-478b-ab44-a01a1079435a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:03:17.464852 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-c32f23cb-457a-478b-ab44-a01a1079435a None None] MFA Rules not processed for user `b135f00ca40d4a09b797fe5664cdf7df`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 10:03:17.466111 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-c32f23cb-457a-478b-ab44-a01a1079435a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 10:03:17.534696 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1243/2492] 10.222.0.65 () {58 vars in 958 bytes} [Thu Oct 27 10:03:17 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 10:03:17.539102 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbacf35c-e4b9-4452-9379-dd9d403496a5 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:03:17.577063 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:03:17.605717 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbacf35c-e4b9-4452-9379-dd9d403496a5 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:03:17.611976 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7a390e-3955-4a95-a982-8d8d11df7ee4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:03:17.612592 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7a390e-3955-4a95-a982-8d8d11df7ee4 admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:03:17.612874 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7a390e-3955-4a95-a982-8d8d11df7ee4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:03:17.613152 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7a390e-3955-4a95-a982-8d8d11df7ee4 admin admin] PATH_INFO: `/v3/projects` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:03:17.613800 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7a390e-3955-4a95-a982-8d8d11df7ee4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:03:17.615811 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7a390e-3955-4a95-a982-8d8d11df7ee4 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:03:17.692840 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1250/2493] 10.222.0.65 () {60 vars in 1153 bytes} [Thu Oct 27 10:03:17 2022] POST /identity/v3/projects => generated 379 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 10:03:17.697293 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32f23cb-457a-478b-ab44-a01a1079435a None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:03:17.708439 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32f23cb-457a-478b-ab44-a01a1079435a None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:03:17.771381 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f84735-9774-466d-8902-ac8a22846dea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:03:17.772002 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f84735-9774-466d-8902-ac8a22846dea admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:03:17.772285 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f84735-9774-466d-8902-ac8a22846dea admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:03:17.772614 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f84735-9774-466d-8902-ac8a22846dea admin admin] PATH_INFO: `/v3/users` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:03:17.773233 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f84735-9774-466d-8902-ac8a22846dea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:03:17.775214 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f84735-9774-466d-8902-ac8a22846dea admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:03:17.858847 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1244/2494] 10.222.0.65 () {60 vars in 1144 bytes} [Thu Oct 27 10:03:17 2022] POST /identity/v3/users => generated 290 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 10:03:17.862087 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7a390e-3955-4a95-a982-8d8d11df7ee4 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:03:17.874494 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7a390e-3955-4a95-a982-8d8d11df7ee4 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:03:17.879537 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfd0cd9-fb84-4a90-897d-65c894be1102 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:03:17.880148 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfd0cd9-fb84-4a90-897d-65c894be1102 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:03:17.880431 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfd0cd9-fb84-4a90-897d-65c894be1102 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:03:17.880716 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfd0cd9-fb84-4a90-897d-65c894be1102 admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:03:17.881368 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfd0cd9-fb84-4a90-897d-65c894be1102 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:03:17.883020 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfd0cd9-fb84-4a90-897d-65c894be1102 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:03:17.894364 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1251/2495] 10.222.0.65 () {58 vars in 1122 bytes} [Thu Oct 27 10:03:17 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 10:03:17.898711 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f84735-9774-466d-8902-ac8a22846dea admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:03:17.909514 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f84735-9774-466d-8902-ac8a22846dea admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:03:17.914150 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf992b8-f49d-4e51-b77f-74b564c3e0a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:03:17.914778 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf992b8-f49d-4e51-b77f-74b564c3e0a9 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:03:17.915114 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf992b8-f49d-4e51-b77f-74b564c3e0a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:03:17.915399 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf992b8-f49d-4e51-b77f-74b564c3e0a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:03:17.916034 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf992b8-f49d-4e51-b77f-74b564c3e0a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:03:17.917627 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf992b8-f49d-4e51-b77f-74b564c3e0a9 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:03:17.927662 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1245/2496] 10.222.0.65 () {58 vars in 1122 bytes} [Thu Oct 27 10:03:17 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 10:03:17.931810 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfd0cd9-fb84-4a90-897d-65c894be1102 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:03:17.943929 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfd0cd9-fb84-4a90-897d-65c894be1102 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:03:17.948700 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c854c34-9fd0-4346-8a74-4189af855a46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:03:17.949357 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c854c34-9fd0-4346-8a74-4189af855a46 admin admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:03:17.949641 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c854c34-9fd0-4346-8a74-4189af855a46 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:03:17.949924 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c854c34-9fd0-4346-8a74-4189af855a46 admin admin] PATH_INFO: `/v3/projects/ac26856b6cbd4a018daa5e17c4a77dea/users/c4038c1808b341f7b959566eead0ff54/roles/43543ce1450245af9661cb017bac17bd` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:03:17.966352 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c854c34-9fd0-4346-8a74-4189af855a46 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ac26856b6cbd4a018daa5e17c4a77dea, user_id=c4038c1808b341f7b959566eead0ff54, role_id=43543ce1450245af9661cb017bac17bd)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:03:17.969759 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c854c34-9fd0-4346-8a74-4189af855a46 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:03:18.073452 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1252/2497] 10.222.0.65 () {60 vars in 1483 bytes} [Thu Oct 27 10:03:17 2022] PUT /identity/v3/projects/ac26856b6cbd4a018daa5e17c4a77dea/users/c4038c1808b341f7b959566eead0ff54/roles/43543ce1450245af9661cb017bac17bd => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 10:03:18.085506 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcd6a2a-c1d8-49a6-a656-7bdb349f9bd8 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:03:18.085802 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcd6a2a-c1d8-49a6-a656-7bdb349f9bd8 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:03:18.086085 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcd6a2a-c1d8-49a6-a656-7bdb349f9bd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:03:18.115154 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-edcd6a2a-c1d8-49a6-a656-7bdb349f9bd8 None None] MFA Rules not processed for user `c4038c1808b341f7b959566eead0ff54`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 10:03:18.116376 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-edcd6a2a-c1d8-49a6-a656-7bdb349f9bd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 10:03:18.149437 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:03:18.181769 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1246/2498] 10.222.0.65 () {58 vars in 958 bytes} [Thu Oct 27 10:03:18 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 10:03:18.186370 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c854c34-9fd0-4346-8a74-4189af855a46 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:03:18.250656 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c854c34-9fd0-4346-8a74-4189af855a46 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:03:18.255399 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bac7dc-cbff-4d54-b75b-470f6af98b88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:03:18.256002 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bac7dc-cbff-4d54-b75b-470f6af98b88 admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:03:18.256286 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bac7dc-cbff-4d54-b75b-470f6af98b88 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:03:18.256563 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bac7dc-cbff-4d54-b75b-470f6af98b88 admin admin] PATH_INFO: `/v3/projects` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:03:18.257199 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56bac7dc-cbff-4d54-b75b-470f6af98b88 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:03:18.259148 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56bac7dc-cbff-4d54-b75b-470f6af98b88 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:03:18.400891 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1253/2499] 10.222.0.65 () {60 vars in 1153 bytes} [Thu Oct 27 10:03:18 2022] POST /identity/v3/projects => generated 379 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 10:03:18.405919 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcd6a2a-c1d8-49a6-a656-7bdb349f9bd8 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:03:18.417032 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcd6a2a-c1d8-49a6-a656-7bdb349f9bd8 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:03:18.476366 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b3a63d-59a2-49f0-b8de-2181d1f0d34a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:03:18.476983 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b3a63d-59a2-49f0-b8de-2181d1f0d34a admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:03:18.477267 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b3a63d-59a2-49f0-b8de-2181d1f0d34a admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:03:18.477542 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b3a63d-59a2-49f0-b8de-2181d1f0d34a admin admin] PATH_INFO: `/v3/users` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:03:18.478205 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b3a63d-59a2-49f0-b8de-2181d1f0d34a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:03:18.480182 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b3a63d-59a2-49f0-b8de-2181d1f0d34a admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:03:18.583196 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1247/2500] 10.222.0.65 () {60 vars in 1144 bytes} [Thu Oct 27 10:03:18 2022] POST /identity/v3/users => generated 296 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 10:03:18.587391 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bac7dc-cbff-4d54-b75b-470f6af98b88 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:03:18.598803 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bac7dc-cbff-4d54-b75b-470f6af98b88 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:03:18.603533 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1085f92-d6d9-4eb1-bf8f-6df484241e3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:03:18.604135 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1085f92-d6d9-4eb1-bf8f-6df484241e3b admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:03:18.614616 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1085f92-d6d9-4eb1-bf8f-6df484241e3b admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:03:18.614616 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1085f92-d6d9-4eb1-bf8f-6df484241e3b admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:03:18.614616 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1085f92-d6d9-4eb1-bf8f-6df484241e3b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:03:18.614616 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1085f92-d6d9-4eb1-bf8f-6df484241e3b admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:03:18.618803 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1254/2501] 10.222.0.65 () {58 vars in 1122 bytes} [Thu Oct 27 10:03:18 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 10:03:18.623175 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b3a63d-59a2-49f0-b8de-2181d1f0d34a admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:03:18.634180 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b3a63d-59a2-49f0-b8de-2181d1f0d34a admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:03:18.638795 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcc4d9d-ff84-4970-9556-5333119a3ad4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:03:18.640719 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcc4d9d-ff84-4970-9556-5333119a3ad4 admin admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:03:18.643977 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcc4d9d-ff84-4970-9556-5333119a3ad4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:03:18.643977 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcc4d9d-ff84-4970-9556-5333119a3ad4 admin admin] PATH_INFO: `/v3/projects/63b595a9cce544428745dc2e4d5a27d3/users/5a59659591c543a8bdf1d8850c866ac6/roles/6ad17b9f9dea4b66ab2da3677d7e715d` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:03:18.657690 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bcc4d9d-ff84-4970-9556-5333119a3ad4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=63b595a9cce544428745dc2e4d5a27d3, user_id=5a59659591c543a8bdf1d8850c866ac6, role_id=6ad17b9f9dea4b66ab2da3677d7e715d)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:03:18.660426 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bcc4d9d-ff84-4970-9556-5333119a3ad4 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:03:18.731327 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1248/2502] 10.222.0.65 () {60 vars in 1483 bytes} [Thu Oct 27 10:03:18 2022] PUT /identity/v3/projects/63b595a9cce544428745dc2e4d5a27d3/users/5a59659591c543a8bdf1d8850c866ac6/roles/6ad17b9f9dea4b66ab2da3677d7e715d => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 10:03:18.735401 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1085f92-d6d9-4eb1-bf8f-6df484241e3b admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:03:18.745836 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1085f92-d6d9-4eb1-bf8f-6df484241e3b admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:03:18.806600 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:03:18.812955 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb36f5f8-3f8f-4be2-a4c2-68c720fcb232 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:03:18.813565 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb36f5f8-3f8f-4be2-a4c2-68c720fcb232 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:03:18.813848 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb36f5f8-3f8f-4be2-a4c2-68c720fcb232 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:03:18.814122 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb36f5f8-3f8f-4be2-a4c2-68c720fcb232 admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:03:18.814795 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb36f5f8-3f8f-4be2-a4c2-68c720fcb232 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:03:18.816383 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb36f5f8-3f8f-4be2-a4c2-68c720fcb232 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:03:18.828230 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1255/2503] 10.222.0.65 () {58 vars in 1122 bytes} [Thu Oct 27 10:03:18 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 10:03:18.833024 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcc4d9d-ff84-4970-9556-5333119a3ad4 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:03:18.845085 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcc4d9d-ff84-4970-9556-5333119a3ad4 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:03:18.850066 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a172936b-f44c-4040-b271-4bf3038680a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:03:18.850815 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a172936b-f44c-4040-b271-4bf3038680a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:03:18.851105 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a172936b-f44c-4040-b271-4bf3038680a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:03:18.851411 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a172936b-f44c-4040-b271-4bf3038680a9 admin admin] PATH_INFO: `/v3/projects/63b595a9cce544428745dc2e4d5a27d3/users/5a59659591c543a8bdf1d8850c866ac6/roles/6ad17b9f9dea4b66ab2da3677d7e715d` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:03:18.853462 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a172936b-f44c-4040-b271-4bf3038680a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=63b595a9cce544428745dc2e4d5a27d3, user_id=5a59659591c543a8bdf1d8850c866ac6, role_id=6ad17b9f9dea4b66ab2da3677d7e715d)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:03:18.856137 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a172936b-f44c-4040-b271-4bf3038680a9 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:03:18.867297 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1249/2504] 10.222.0.65 () {60 vars in 1483 bytes} [Thu Oct 27 10:03:18 2022] PUT /identity/v3/projects/63b595a9cce544428745dc2e4d5a27d3/users/5a59659591c543a8bdf1d8850c866ac6/roles/6ad17b9f9dea4b66ab2da3677d7e715d => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 10:03:18.933019 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b0237d-d90c-4391-b914-5e4be7280d60 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:03:18.933222 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b0237d-d90c-4391-b914-5e4be7280d60 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:03:18.933496 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b0237d-d90c-4391-b914-5e4be7280d60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:03:18.964301 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-b3b0237d-d90c-4391-b914-5e4be7280d60 None None] MFA Rules not processed for user `5a59659591c543a8bdf1d8850c866ac6`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 10:03:18.965675 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-b3b0237d-d90c-4391-b914-5e4be7280d60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 10:03:19.043193 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1256/2505] 10.222.0.65 () {58 vars in 958 bytes} [Thu Oct 27 10:03:18 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 10:03:19.055609 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a172936b-f44c-4040-b271-4bf3038680a9 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:03:19.057308 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-a172936b-f44c-4040-b271-4bf3038680a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 10:03:19.116899 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a172936b-f44c-4040-b271-4bf3038680a9 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:03:19.120589 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cce0e07-e54f-4854-a726-988b48b92751 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8e5d5f04c4741bb86ca4a0f667d4ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc2e3a7a1bcc480891c0b433291c00b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:03:19.121187 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cce0e07-e54f-4854-a726-988b48b92751 service cinder] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:03:19.121458 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cce0e07-e54f-4854-a726-988b48b92751 service cinder] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:03:19.121726 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cce0e07-e54f-4854-a726-988b48b92751 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:03:19.134633 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cce0e07-e54f-4854-a726-988b48b92751 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:03:19.136171 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cce0e07-e54f-4854-a726-988b48b92751 service cinder] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:03:19.147160 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1250/2506] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Oct 27 10:03:19 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 10:03:19.270432 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b0237d-d90c-4391-b914-5e4be7280d60 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:03:19.282239 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b0237d-d90c-4391-b914-5e4be7280d60 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:03:19.287159 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac34afd2-1b6f-4ed5-88a3-d9e33bd02bfd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8e5d5f04c4741bb86ca4a0f667d4ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc2e3a7a1bcc480891c0b433291c00b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:03:19.290094 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac34afd2-1b6f-4ed5-88a3-d9e33bd02bfd service cinder] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:03:19.290094 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac34afd2-1b6f-4ed5-88a3-d9e33bd02bfd service cinder] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:03:19.290094 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac34afd2-1b6f-4ed5-88a3-d9e33bd02bfd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:03:19.351787 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac34afd2-1b6f-4ed5-88a3-d9e33bd02bfd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:03:19.353229 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac34afd2-1b6f-4ed5-88a3-d9e33bd02bfd service cinder] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:03:19.363502 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1257/2507] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Oct 27 10:03:19 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 10:03:23.484488 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cce0e07-e54f-4854-a726-988b48b92751 service cinder] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:03:23.525575 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:03:23.553765 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cce0e07-e54f-4854-a726-988b48b92751 service cinder] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:03:23.558352 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd5fad8-8c1b-47c4-8730-09286b91c49c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:03:23.560516 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd5fad8-8c1b-47c4-8730-09286b91c49c admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:03:23.560998 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd5fad8-8c1b-47c4-8730-09286b91c49c admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:03:23.561276 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd5fad8-8c1b-47c4-8730-09286b91c49c admin admin] PATH_INFO: `/v3/users/b135f00ca40d4a09b797fe5664cdf7df` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:03:23.563265 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd5fad8-8c1b-47c4-8730-09286b91c49c admin admin] RBAC: Authorizing `identity:delete_user(user_id=b135f00ca40d4a09b797fe5664cdf7df)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:03:23.565263 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd5fad8-8c1b-47c4-8730-09286b91c49c admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:03:23.710948 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-0dd5fad8-8c1b-47c4-8730-09286b91c49c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b135f00ca40d4a09b797fe5664cdf7df'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:03:23.711653 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-0dd5fad8-8c1b-47c4-8730-09286b91c49c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b135f00ca40d4a09b797fe5664cdf7df'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:03:23.718947 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-0dd5fad8-8c1b-47c4-8730-09286b91c49c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b135f00ca40d4a09b797fe5664cdf7df'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:03:23.719498 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-0dd5fad8-8c1b-47c4-8730-09286b91c49c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b135f00ca40d4a09b797fe5664cdf7df'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:03:23.731829 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-0dd5fad8-8c1b-47c4-8730-09286b91c49c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b135f00ca40d4a09b797fe5664cdf7df'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:03:23.810720 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1251/2508] 10.222.0.65 () {58 vars in 1224 bytes} [Thu Oct 27 10:03:23 2022] DELETE /identity/v3/users/b135f00ca40d4a09b797fe5664cdf7df => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 10:03:23.816707 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d43e2cd-6699-4e3f-bf4b-eefd461f9639 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:03:23.817239 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d43e2cd-6699-4e3f-bf4b-eefd461f9639 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:03:23.817239 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d43e2cd-6699-4e3f-bf4b-eefd461f9639 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:03:23.838039 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-2d43e2cd-6699-4e3f-bf4b-eefd461f9639 None None] MFA Rules not processed for user `b5065084bf664b99bdeac46067cb0f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 10:03:23.839325 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-2d43e2cd-6699-4e3f-bf4b-eefd461f9639 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 10:03:23.908001 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1258/2509] 10.222.0.65 () {58 vars in 958 bytes} [Thu Oct 27 10:03:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 10:03:23.918101 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd5fad8-8c1b-47c4-8730-09286b91c49c admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:03:23.919534 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-0dd5fad8-8c1b-47c4-8730-09286b91c49c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 10:03:23.978598 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd5fad8-8c1b-47c4-8730-09286b91c49c admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:03:23.983692 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69062aeb-670b-4169-89ed-5db5d5d42472 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6191cc41efa74f46b49022cf387f7a4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc2e3a7a1bcc480891c0b433291c00b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:03:23.983692 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69062aeb-670b-4169-89ed-5db5d5d42472 service neutron] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:03:23.985244 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69062aeb-670b-4169-89ed-5db5d5d42472 service neutron] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:03:23.985602 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69062aeb-670b-4169-89ed-5db5d5d42472 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:03:23.995936 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69062aeb-670b-4169-89ed-5db5d5d42472 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:03:23.997371 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69062aeb-670b-4169-89ed-5db5d5d42472 service neutron] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:03:24.008568 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1252/2510] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Oct 27 10:03:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 10:03:24.384200 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d43e2cd-6699-4e3f-bf4b-eefd461f9639 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:03:24.385731 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-2d43e2cd-6699-4e3f-bf4b-eefd461f9639 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 10:03:24.401202 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d43e2cd-6699-4e3f-bf4b-eefd461f9639 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:03:24.407301 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a380249-fc26-41af-9732-6f477fcc337e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:03:24.407993 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a380249-fc26-41af-9732-6f477fcc337e admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:03:24.408704 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a380249-fc26-41af-9732-6f477fcc337e admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:03:24.408704 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a380249-fc26-41af-9732-6f477fcc337e admin admin] PATH_INFO: `/v3/projects/3edea26fb1374063a8554b3584b4aa1c` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:03:24.412709 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a380249-fc26-41af-9732-6f477fcc337e admin admin] RBAC: Authorizing `identity:delete_project(project_id=3edea26fb1374063a8554b3584b4aa1c)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:03:24.412709 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a380249-fc26-41af-9732-6f477fcc337e admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:03:24.425064 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:03:24.538684 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-0a380249-fc26-41af-9732-6f477fcc337e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3edea26fb1374063a8554b3584b4aa1c', 'request_id': 'req-0a380249-fc26-41af-9732-6f477fcc337e'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:03:24.611136 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-0a380249-fc26-41af-9732-6f477fcc337e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3edea26fb1374063a8554b3584b4aa1c', 'request_id': 'req-0a380249-fc26-41af-9732-6f477fcc337e'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:03:24.617366 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-0a380249-fc26-41af-9732-6f477fcc337e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3edea26fb1374063a8554b3584b4aa1c', 'request_id': 'req-0a380249-fc26-41af-9732-6f477fcc337e'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:03:24.629826 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-0a380249-fc26-41af-9732-6f477fcc337e admin admin] The token cache is being invalidate because project 3edea26fb1374063a8554b3584b4aa1c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 10:03:24.630124 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-0a380249-fc26-41af-9732-6f477fcc337e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:03:24.630805 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-0a380249-fc26-41af-9732-6f477fcc337e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:03:24.632286 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1259/2511] 10.222.0.65 () {58 vars in 1233 bytes} [Thu Oct 27 10:03:24 2022] DELETE /identity/v3/projects/3edea26fb1374063a8554b3584b4aa1c => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 10:03:24.636335 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69062aeb-670b-4169-89ed-5db5d5d42472 service neutron] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:03:24.646351 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69062aeb-670b-4169-89ed-5db5d5d42472 service neutron] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:03:24.696717 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:03:24.706610 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3494e6b5-312f-45b3-9e6c-fe35a1fca92b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:03:24.707519 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3494e6b5-312f-45b3-9e6c-fe35a1fca92b admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:03:24.707786 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3494e6b5-312f-45b3-9e6c-fe35a1fca92b admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:03:24.708066 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3494e6b5-312f-45b3-9e6c-fe35a1fca92b admin admin] PATH_INFO: `/v3/users/c4038c1808b341f7b959566eead0ff54` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:03:24.709314 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3494e6b5-312f-45b3-9e6c-fe35a1fca92b admin admin] RBAC: Authorizing `identity:delete_user(user_id=c4038c1808b341f7b959566eead0ff54)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:03:24.711273 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3494e6b5-312f-45b3-9e6c-fe35a1fca92b admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:03:24.992743 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-3494e6b5-312f-45b3-9e6c-fe35a1fca92b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c4038c1808b341f7b959566eead0ff54'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:03:24.993419 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-3494e6b5-312f-45b3-9e6c-fe35a1fca92b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c4038c1808b341f7b959566eead0ff54'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:03:25.000913 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-3494e6b5-312f-45b3-9e6c-fe35a1fca92b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c4038c1808b341f7b959566eead0ff54'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:03:25.001938 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-3494e6b5-312f-45b3-9e6c-fe35a1fca92b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c4038c1808b341f7b959566eead0ff54'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:03:25.013803 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-3494e6b5-312f-45b3-9e6c-fe35a1fca92b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c4038c1808b341f7b959566eead0ff54'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:03:25.086285 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1253/2512] 10.222.0.65 () {58 vars in 1224 bytes} [Thu Oct 27 10:03:24 2022] DELETE /identity/v3/users/c4038c1808b341f7b959566eead0ff54 => generated 0 bytes in 450 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 10:03:25.476586 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a380249-fc26-41af-9732-6f477fcc337e admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:03:25.478394 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-0a380249-fc26-41af-9732-6f477fcc337e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 10:03:25.505856 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a380249-fc26-41af-9732-6f477fcc337e admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:03:25.569364 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88139961-c3d5-4afc-8ff1-98dd30f5d0bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:03:25.570118 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88139961-c3d5-4afc-8ff1-98dd30f5d0bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:03:25.570401 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88139961-c3d5-4afc-8ff1-98dd30f5d0bb admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:03:25.570718 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88139961-c3d5-4afc-8ff1-98dd30f5d0bb admin admin] PATH_INFO: `/v3/projects/ac26856b6cbd4a018daa5e17c4a77dea` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:03:25.571949 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88139961-c3d5-4afc-8ff1-98dd30f5d0bb admin admin] RBAC: Authorizing `identity:delete_project(project_id=ac26856b6cbd4a018daa5e17c4a77dea)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:03:25.573961 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88139961-c3d5-4afc-8ff1-98dd30f5d0bb admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:03:25.680550 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-88139961-c3d5-4afc-8ff1-98dd30f5d0bb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ac26856b6cbd4a018daa5e17c4a77dea', 'request_id': 'req-88139961-c3d5-4afc-8ff1-98dd30f5d0bb'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:03:25.730459 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-88139961-c3d5-4afc-8ff1-98dd30f5d0bb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ac26856b6cbd4a018daa5e17c4a77dea', 'request_id': 'req-88139961-c3d5-4afc-8ff1-98dd30f5d0bb'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:03:25.736849 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-88139961-c3d5-4afc-8ff1-98dd30f5d0bb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ac26856b6cbd4a018daa5e17c4a77dea', 'request_id': 'req-88139961-c3d5-4afc-8ff1-98dd30f5d0bb'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:03:25.748623 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-88139961-c3d5-4afc-8ff1-98dd30f5d0bb admin admin] The token cache is being invalidate because project ac26856b6cbd4a018daa5e17c4a77dea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 10:03:25.748913 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-88139961-c3d5-4afc-8ff1-98dd30f5d0bb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:03:25.750226 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-88139961-c3d5-4afc-8ff1-98dd30f5d0bb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:03:25.751968 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1260/2513] 10.222.0.65 () {58 vars in 1233 bytes} [Thu Oct 27 10:03:25 2022] DELETE /identity/v3/projects/ac26856b6cbd4a018daa5e17c4a77dea => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 10:03:25.756212 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3494e6b5-312f-45b3-9e6c-fe35a1fca92b admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:03:25.757639 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-3494e6b5-312f-45b3-9e6c-fe35a1fca92b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 10:03:25.771234 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3494e6b5-312f-45b3-9e6c-fe35a1fca92b admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:03:25.834056 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3f85f0-4e00-42b7-8eb5-1aac86b48c53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:03:25.834730 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3f85f0-4e00-42b7-8eb5-1aac86b48c53 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:03:25.835044 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3f85f0-4e00-42b7-8eb5-1aac86b48c53 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:03:25.835320 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3f85f0-4e00-42b7-8eb5-1aac86b48c53 admin admin] PATH_INFO: `/v3/users/5a59659591c543a8bdf1d8850c866ac6` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:03:25.836462 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3f85f0-4e00-42b7-8eb5-1aac86b48c53 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5a59659591c543a8bdf1d8850c866ac6)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:03:25.838385 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3f85f0-4e00-42b7-8eb5-1aac86b48c53 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:03:26.048568 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-5d3f85f0-4e00-42b7-8eb5-1aac86b48c53 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5a59659591c543a8bdf1d8850c866ac6'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:03:26.049250 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-5d3f85f0-4e00-42b7-8eb5-1aac86b48c53 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5a59659591c543a8bdf1d8850c866ac6'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:03:26.056576 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-5d3f85f0-4e00-42b7-8eb5-1aac86b48c53 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5a59659591c543a8bdf1d8850c866ac6'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:03:26.057247 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-5d3f85f0-4e00-42b7-8eb5-1aac86b48c53 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5a59659591c543a8bdf1d8850c866ac6'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:03:26.071873 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=80,keystone:DELETE=19,keystone:INSERT=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:03:26.073345 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-5d3f85f0-4e00-42b7-8eb5-1aac86b48c53 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5a59659591c543a8bdf1d8850c866ac6'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:03:26.136175 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1254/2514] 10.222.0.65 () {58 vars in 1224 bytes} [Thu Oct 27 10:03:25 2022] DELETE /identity/v3/users/5a59659591c543a8bdf1d8850c866ac6 => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 10:03:26.641027 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88139961-c3d5-4afc-8ff1-98dd30f5d0bb admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:03:26.643715 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-88139961-c3d5-4afc-8ff1-98dd30f5d0bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 10:03:26.659957 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88139961-c3d5-4afc-8ff1-98dd30f5d0bb admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:03:26.691461 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:03:26.720565 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c688d32c-c990-4e07-8dc7-e922cadb2511 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:03:26.721990 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c688d32c-c990-4e07-8dc7-e922cadb2511 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:03:26.722296 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c688d32c-c990-4e07-8dc7-e922cadb2511 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:03:26.722591 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c688d32c-c990-4e07-8dc7-e922cadb2511 admin admin] PATH_INFO: `/v3/projects/63b595a9cce544428745dc2e4d5a27d3` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:03:26.723824 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c688d32c-c990-4e07-8dc7-e922cadb2511 admin admin] RBAC: Authorizing `identity:delete_project(project_id=63b595a9cce544428745dc2e4d5a27d3)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:03:26.725785 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c688d32c-c990-4e07-8dc7-e922cadb2511 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:03:26.829507 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-c688d32c-c990-4e07-8dc7-e922cadb2511 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '63b595a9cce544428745dc2e4d5a27d3', 'request_id': 'req-c688d32c-c990-4e07-8dc7-e922cadb2511'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:03:26.896434 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-c688d32c-c990-4e07-8dc7-e922cadb2511 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '63b595a9cce544428745dc2e4d5a27d3', 'request_id': 'req-c688d32c-c990-4e07-8dc7-e922cadb2511'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:03:26.902772 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-c688d32c-c990-4e07-8dc7-e922cadb2511 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '63b595a9cce544428745dc2e4d5a27d3', 'request_id': 'req-c688d32c-c990-4e07-8dc7-e922cadb2511'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:03:26.914597 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-c688d32c-c990-4e07-8dc7-e922cadb2511 admin admin] The token cache is being invalidate because project 63b595a9cce544428745dc2e4d5a27d3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 10:03:26.914910 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-c688d32c-c990-4e07-8dc7-e922cadb2511 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:03:26.915556 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-c688d32c-c990-4e07-8dc7-e922cadb2511 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:03:26.917156 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1261/2515] 10.222.0.65 () {58 vars in 1233 bytes} [Thu Oct 27 10:03:26 2022] DELETE /identity/v3/projects/63b595a9cce544428745dc2e4d5a27d3 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 10:03:26.923358 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b398c1e-2ae0-4f26-a342-805fa50245a1 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:03:26.923863 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b398c1e-2ae0-4f26-a342-805fa50245a1 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:03:26.923985 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b398c1e-2ae0-4f26-a342-805fa50245a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:03:26.945006 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-7b398c1e-2ae0-4f26-a342-805fa50245a1 None None] MFA Rules not processed for user `b5065084bf664b99bdeac46067cb0f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 10:03:26.946210 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-7b398c1e-2ae0-4f26-a342-805fa50245a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 10:03:27.013226 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1255/2516] 10.222.0.65 () {58 vars in 958 bytes} [Thu Oct 27 10:03:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 10:03:27.023376 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d597717-33fa-4475-9441-2be59cb38de9 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:03:27.023666 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d597717-33fa-4475-9441-2be59cb38de9 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:03:27.023953 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d597717-33fa-4475-9441-2be59cb38de9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:03:27.044390 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-1d597717-33fa-4475-9441-2be59cb38de9 None None] MFA Rules not processed for user `b5065084bf664b99bdeac46067cb0f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 10:03:27.045641 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-1d597717-33fa-4475-9441-2be59cb38de9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 10:03:27.053765 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1262/2517] 10.222.0.65 () {58 vars in 958 bytes} [Thu Oct 27 10:03:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 10:03:27.057991 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b398c1e-2ae0-4f26-a342-805fa50245a1 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:03:27.068892 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b398c1e-2ae0-4f26-a342-805fa50245a1 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:03:27.073370 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bc6fd8-aa52-4779-990b-c4f700f6e215 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:03:27.073975 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bc6fd8-aa52-4779-990b-c4f700f6e215 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:03:27.074255 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bc6fd8-aa52-4779-990b-c4f700f6e215 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:03:27.074536 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bc6fd8-aa52-4779-990b-c4f700f6e215 admin admin] PATH_INFO: `/v3/domains` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:03:27.075177 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86bc6fd8-aa52-4779-990b-c4f700f6e215 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 10:03:27.075484 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86bc6fd8-aa52-4779-990b-c4f700f6e215 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:03:27.077073 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86bc6fd8-aa52-4779-990b-c4f700f6e215 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:03:27.089920 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1256/2518] 10.222.0.65 () {58 vars in 1153 bytes} [Thu Oct 27 10:03:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 10:03:27.094315 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d597717-33fa-4475-9441-2be59cb38de9 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:03:27.104025 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d597717-33fa-4475-9441-2be59cb38de9 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:03:27.108770 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08dc7113-bcb5-4ff3-8d4d-d4090e1dcbea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:03:27.109370 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dc7113-bcb5-4ff3-8d4d-d4090e1dcbea admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:03:27.109655 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dc7113-bcb5-4ff3-8d4d-d4090e1dcbea admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:03:27.109933 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dc7113-bcb5-4ff3-8d4d-d4090e1dcbea admin admin] PATH_INFO: `/v3/projects` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:03:27.110639 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08dc7113-bcb5-4ff3-8d4d-d4090e1dcbea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:03:27.112564 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08dc7113-bcb5-4ff3-8d4d-d4090e1dcbea admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:03:27.184982 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1263/2519] 10.222.0.65 () {60 vars in 1153 bytes} [Thu Oct 27 10:03:27 2022] POST /identity/v3/projects => generated 381 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 10:03:27.194116 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bc6fd8-aa52-4779-990b-c4f700f6e215 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:03:27.204916 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bc6fd8-aa52-4779-990b-c4f700f6e215 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:03:27.267127 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f71a937-ba13-4d82-be78-8b9a537bfbf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:03:27.267758 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f71a937-ba13-4d82-be78-8b9a537bfbf3 admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:03:27.268116 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f71a937-ba13-4d82-be78-8b9a537bfbf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:03:27.268392 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f71a937-ba13-4d82-be78-8b9a537bfbf3 admin admin] PATH_INFO: `/v3/users` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:03:27.269016 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f71a937-ba13-4d82-be78-8b9a537bfbf3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:03:27.270984 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f71a937-ba13-4d82-be78-8b9a537bfbf3 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:03:27.371258 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1257/2520] 10.222.0.65 () {60 vars in 1144 bytes} [Thu Oct 27 10:03:27 2022] POST /identity/v3/users => generated 291 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 10:03:27.375370 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08dc7113-bcb5-4ff3-8d4d-d4090e1dcbea admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:03:27.386410 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08dc7113-bcb5-4ff3-8d4d-d4090e1dcbea admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:03:27.392526 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16aa69bc-c4c7-4472-94f7-e65fc73831d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:03:27.392526 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16aa69bc-c4c7-4472-94f7-e65fc73831d4 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:03:27.392526 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16aa69bc-c4c7-4472-94f7-e65fc73831d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:03:27.392526 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16aa69bc-c4c7-4472-94f7-e65fc73831d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:03:27.393268 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16aa69bc-c4c7-4472-94f7-e65fc73831d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:03:27.394958 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16aa69bc-c4c7-4472-94f7-e65fc73831d4 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:03:27.405506 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1264/2521] 10.222.0.65 () {58 vars in 1122 bytes} [Thu Oct 27 10:03:27 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 10:03:27.409654 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f71a937-ba13-4d82-be78-8b9a537bfbf3 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:03:27.419935 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f71a937-ba13-4d82-be78-8b9a537bfbf3 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:03:27.425128 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a64f56-34c4-4c50-a633-30259c723c9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:03:27.425728 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a64f56-34c4-4c50-a633-30259c723c9f admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:03:27.426007 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a64f56-34c4-4c50-a633-30259c723c9f admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:03:27.426283 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a64f56-34c4-4c50-a633-30259c723c9f admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:03:27.427008 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a64f56-34c4-4c50-a633-30259c723c9f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:03:27.428639 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a64f56-34c4-4c50-a633-30259c723c9f admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:03:27.439419 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1258/2522] 10.222.0.65 () {58 vars in 1122 bytes} [Thu Oct 27 10:03:27 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 10:03:27.444632 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16aa69bc-c4c7-4472-94f7-e65fc73831d4 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:03:27.455042 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16aa69bc-c4c7-4472-94f7-e65fc73831d4 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:03:27.460405 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6a6c06-d584-4a1e-a124-23cb35e9f182 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:03:27.461051 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6a6c06-d584-4a1e-a124-23cb35e9f182 admin admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:03:27.461346 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6a6c06-d584-4a1e-a124-23cb35e9f182 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:03:27.461680 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6a6c06-d584-4a1e-a124-23cb35e9f182 admin admin] PATH_INFO: `/v3/projects/14fcdbc39d864bf498390ed68265fc5a/users/7e6ea77110dd479fa3b6d5ee22e7d39e/roles/43543ce1450245af9661cb017bac17bd` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:03:27.479475 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6a6c06-d584-4a1e-a124-23cb35e9f182 admin admin] RBAC: Authorizing `identity:create_grant(project_id=14fcdbc39d864bf498390ed68265fc5a, user_id=7e6ea77110dd479fa3b6d5ee22e7d39e, role_id=43543ce1450245af9661cb017bac17bd)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:03:27.482318 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6a6c06-d584-4a1e-a124-23cb35e9f182 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:03:27.572199 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1265/2523] 10.222.0.65 () {60 vars in 1483 bytes} [Thu Oct 27 10:03:27 2022] PUT /identity/v3/projects/14fcdbc39d864bf498390ed68265fc5a/users/7e6ea77110dd479fa3b6d5ee22e7d39e/roles/43543ce1450245af9661cb017bac17bd => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 10:03:27.585909 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e679df-83bf-4329-892a-137a80089c21 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:03:27.586193 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e679df-83bf-4329-892a-137a80089c21 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:03:27.586468 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e679df-83bf-4329-892a-137a80089c21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:03:27.616527 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-29e679df-83bf-4329-892a-137a80089c21 None None] MFA Rules not processed for user `7e6ea77110dd479fa3b6d5ee22e7d39e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 10:03:27.617890 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-29e679df-83bf-4329-892a-137a80089c21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 10:03:27.666001 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:03:27.688303 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1259/2524] 10.222.0.65 () {58 vars in 958 bytes} [Thu Oct 27 10:03:27 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 10:03:27.693489 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6a6c06-d584-4a1e-a124-23cb35e9f182 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:03:27.753604 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:03:27.757683 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6a6c06-d584-4a1e-a124-23cb35e9f182 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:03:27.762468 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f17633a-78c9-4e9c-a9da-90a7791ebaef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:03:27.763097 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f17633a-78c9-4e9c-a9da-90a7791ebaef admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:03:27.763378 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f17633a-78c9-4e9c-a9da-90a7791ebaef admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:03:27.763728 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f17633a-78c9-4e9c-a9da-90a7791ebaef admin admin] PATH_INFO: `/v3/projects` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:03:27.764310 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f17633a-78c9-4e9c-a9da-90a7791ebaef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:03:27.766199 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f17633a-78c9-4e9c-a9da-90a7791ebaef admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:03:27.862859 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1266/2525] 10.222.0.65 () {60 vars in 1153 bytes} [Thu Oct 27 10:03:27 2022] POST /identity/v3/projects => generated 377 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 10:03:27.865682 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e679df-83bf-4329-892a-137a80089c21 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:03:27.875396 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e679df-83bf-4329-892a-137a80089c21 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:03:27.935307 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a9a0e0-e44c-4889-a138-c850557fb874 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:03:27.935979 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a9a0e0-e44c-4889-a138-c850557fb874 admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:03:27.936086 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a9a0e0-e44c-4889-a138-c850557fb874 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:03:27.936357 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a9a0e0-e44c-4889-a138-c850557fb874 admin admin] PATH_INFO: `/v3/users` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:03:27.937019 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a9a0e0-e44c-4889-a138-c850557fb874 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:03:27.939042 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a9a0e0-e44c-4889-a138-c850557fb874 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:03:28.006981 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1260/2526] 10.222.0.65 () {60 vars in 1144 bytes} [Thu Oct 27 10:03:27 2022] POST /identity/v3/users => generated 295 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 10:03:28.010816 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f17633a-78c9-4e9c-a9da-90a7791ebaef admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:03:28.022791 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f17633a-78c9-4e9c-a9da-90a7791ebaef admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:03:28.027514 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206803b8-859a-4495-a81b-681bcceefa48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:03:28.028124 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206803b8-859a-4495-a81b-681bcceefa48 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:03:28.028419 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206803b8-859a-4495-a81b-681bcceefa48 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:03:28.028686 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206803b8-859a-4495-a81b-681bcceefa48 admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:03:28.029337 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206803b8-859a-4495-a81b-681bcceefa48 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:03:28.030981 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206803b8-859a-4495-a81b-681bcceefa48 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:03:28.042775 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1267/2527] 10.222.0.65 () {58 vars in 1122 bytes} [Thu Oct 27 10:03:28 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 10:03:28.046908 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a9a0e0-e44c-4889-a138-c850557fb874 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:03:28.057532 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a9a0e0-e44c-4889-a138-c850557fb874 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:03:28.062243 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad81fd5-680a-461e-b053-4422340e932c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:03:28.062939 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad81fd5-680a-461e-b053-4422340e932c admin admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:03:28.063221 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad81fd5-680a-461e-b053-4422340e932c admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:03:28.063497 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad81fd5-680a-461e-b053-4422340e932c admin admin] PATH_INFO: `/v3/projects/5e50846f0cf34669926b63109f6f434c/users/8401835b870a4834878baf375aedee7e/roles/6ad17b9f9dea4b66ab2da3677d7e715d` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:03:28.079025 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad81fd5-680a-461e-b053-4422340e932c admin admin] RBAC: Authorizing `identity:create_grant(project_id=5e50846f0cf34669926b63109f6f434c, user_id=8401835b870a4834878baf375aedee7e, role_id=6ad17b9f9dea4b66ab2da3677d7e715d)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:03:28.082754 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad81fd5-680a-461e-b053-4422340e932c admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:03:28.153621 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1261/2528] 10.222.0.65 () {60 vars in 1483 bytes} [Thu Oct 27 10:03:28 2022] PUT /identity/v3/projects/5e50846f0cf34669926b63109f6f434c/users/8401835b870a4834878baf375aedee7e/roles/6ad17b9f9dea4b66ab2da3677d7e715d => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 10:03:28.157801 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206803b8-859a-4495-a81b-681bcceefa48 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:03:28.169160 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206803b8-859a-4495-a81b-681bcceefa48 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:03:28.227952 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03858ba-2af8-497b-a5c8-0f0376a4411b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:03:28.228490 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03858ba-2af8-497b-a5c8-0f0376a4411b admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:03:28.228776 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03858ba-2af8-497b-a5c8-0f0376a4411b admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:03:28.229109 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03858ba-2af8-497b-a5c8-0f0376a4411b admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:03:28.229889 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03858ba-2af8-497b-a5c8-0f0376a4411b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:03:28.231563 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03858ba-2af8-497b-a5c8-0f0376a4411b admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:03:28.243021 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1268/2529] 10.222.0.65 () {58 vars in 1122 bytes} [Thu Oct 27 10:03:28 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 10:03:28.247275 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad81fd5-680a-461e-b053-4422340e932c admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:03:28.258723 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad81fd5-680a-461e-b053-4422340e932c admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:03:28.263378 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed93815-36a2-4550-aa10-dd8ef01c5abc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:03:28.264020 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed93815-36a2-4550-aa10-dd8ef01c5abc admin admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:03:28.264301 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed93815-36a2-4550-aa10-dd8ef01c5abc admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:03:28.264574 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed93815-36a2-4550-aa10-dd8ef01c5abc admin admin] PATH_INFO: `/v3/projects/5e50846f0cf34669926b63109f6f434c/users/8401835b870a4834878baf375aedee7e/roles/6ad17b9f9dea4b66ab2da3677d7e715d` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:03:28.266457 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed93815-36a2-4550-aa10-dd8ef01c5abc admin admin] RBAC: Authorizing `identity:create_grant(project_id=5e50846f0cf34669926b63109f6f434c, user_id=8401835b870a4834878baf375aedee7e, role_id=6ad17b9f9dea4b66ab2da3677d7e715d)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:03:28.269213 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed93815-36a2-4550-aa10-dd8ef01c5abc admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:03:28.280051 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1262/2530] 10.222.0.65 () {60 vars in 1483 bytes} [Thu Oct 27 10:03:28 2022] PUT /identity/v3/projects/5e50846f0cf34669926b63109f6f434c/users/8401835b870a4834878baf375aedee7e/roles/6ad17b9f9dea4b66ab2da3677d7e715d => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 10:03:28.290577 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d92f896-29d0-4dda-b893-c6571fa91965 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:03:28.290866 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d92f896-29d0-4dda-b893-c6571fa91965 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:03:28.291143 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d92f896-29d0-4dda-b893-c6571fa91965 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:03:28.322032 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-6d92f896-29d0-4dda-b893-c6571fa91965 None None] MFA Rules not processed for user `8401835b870a4834878baf375aedee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 10:03:28.323278 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-6d92f896-29d0-4dda-b893-c6571fa91965 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 10:03:28.398895 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1269/2531] 10.222.0.65 () {58 vars in 958 bytes} [Thu Oct 27 10:03:28 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 10:03:28.410549 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed93815-36a2-4550-aa10-dd8ef01c5abc admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:03:28.412491 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-7ed93815-36a2-4550-aa10-dd8ef01c5abc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 10:03:28.476288 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed93815-36a2-4550-aa10-dd8ef01c5abc admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:03:28.480260 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131fcdc6-b3f1-43c4-8887-f8ebbdd0e691 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8e5d5f04c4741bb86ca4a0f667d4ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc2e3a7a1bcc480891c0b433291c00b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:03:28.480806 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131fcdc6-b3f1-43c4-8887-f8ebbdd0e691 service cinder] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:03:28.481090 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131fcdc6-b3f1-43c4-8887-f8ebbdd0e691 service cinder] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:03:28.481362 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131fcdc6-b3f1-43c4-8887-f8ebbdd0e691 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:03:28.491890 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131fcdc6-b3f1-43c4-8887-f8ebbdd0e691 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:03:28.493328 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131fcdc6-b3f1-43c4-8887-f8ebbdd0e691 service cinder] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:03:28.503494 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1263/2532] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Oct 27 10:03:28 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 10:03:28.998725 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d92f896-29d0-4dda-b893-c6571fa91965 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:03:29.054182 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:03:29.067532 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d92f896-29d0-4dda-b893-c6571fa91965 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:03:29.072264 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d12102-1dd8-4e56-b625-7276a3eca7bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:03:29.072900 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d12102-1dd8-4e56-b625-7276a3eca7bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:03:29.073186 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d12102-1dd8-4e56-b625-7276a3eca7bb admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:03:29.073461 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d12102-1dd8-4e56-b625-7276a3eca7bb admin admin] PATH_INFO: `/v3/users/7e6ea77110dd479fa3b6d5ee22e7d39e` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:03:29.074625 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d12102-1dd8-4e56-b625-7276a3eca7bb admin admin] RBAC: Authorizing `identity:delete_user(user_id=7e6ea77110dd479fa3b6d5ee22e7d39e)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:03:29.076602 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d12102-1dd8-4e56-b625-7276a3eca7bb admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:03:29.239328 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-52d12102-1dd8-4e56-b625-7276a3eca7bb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7e6ea77110dd479fa3b6d5ee22e7d39e'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:03:29.252226 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-52d12102-1dd8-4e56-b625-7276a3eca7bb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7e6ea77110dd479fa3b6d5ee22e7d39e'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:03:29.253189 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-52d12102-1dd8-4e56-b625-7276a3eca7bb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7e6ea77110dd479fa3b6d5ee22e7d39e'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:03:29.260725 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-52d12102-1dd8-4e56-b625-7276a3eca7bb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7e6ea77110dd479fa3b6d5ee22e7d39e'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:03:29.354077 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-52d12102-1dd8-4e56-b625-7276a3eca7bb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7e6ea77110dd479fa3b6d5ee22e7d39e'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:03:29.361087 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1270/2533] 10.222.0.65 () {58 vars in 1224 bytes} [Thu Oct 27 10:03:28 2022] DELETE /identity/v3/users/7e6ea77110dd479fa3b6d5ee22e7d39e => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 10:03:29.366291 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda7f38d-c42e-45f1-b121-c66eb87e4578 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:03:29.366818 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda7f38d-c42e-45f1-b121-c66eb87e4578 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:03:29.366965 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda7f38d-c42e-45f1-b121-c66eb87e4578 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:03:29.386489 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-cda7f38d-c42e-45f1-b121-c66eb87e4578 None None] MFA Rules not processed for user `b5065084bf664b99bdeac46067cb0f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 10:03:29.387746 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-cda7f38d-c42e-45f1-b121-c66eb87e4578 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 10:03:29.425401 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:03:29.449965 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1264/2534] 10.222.0.65 () {58 vars in 958 bytes} [Thu Oct 27 10:03:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 10:03:29.461404 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d12102-1dd8-4e56-b625-7276a3eca7bb admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:03:29.462894 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-52d12102-1dd8-4e56-b625-7276a3eca7bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 10:03:29.525413 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d12102-1dd8-4e56-b625-7276a3eca7bb admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:03:29.529155 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f718a1-82e3-4925-bd9a-ac6763df39fe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6191cc41efa74f46b49022cf387f7a4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc2e3a7a1bcc480891c0b433291c00b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:03:29.529766 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f718a1-82e3-4925-bd9a-ac6763df39fe service neutron] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:03:29.530048 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f718a1-82e3-4925-bd9a-ac6763df39fe service neutron] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:03:29.530325 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f718a1-82e3-4925-bd9a-ac6763df39fe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:03:29.540919 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f718a1-82e3-4925-bd9a-ac6763df39fe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:03:29.542357 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f718a1-82e3-4925-bd9a-ac6763df39fe service neutron] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:03:29.552567 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1271/2535] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Oct 27 10:03:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 10:03:30.018824 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda7f38d-c42e-45f1-b121-c66eb87e4578 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:03:30.020323 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-cda7f38d-c42e-45f1-b121-c66eb87e4578 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 10:03:30.032670 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda7f38d-c42e-45f1-b121-c66eb87e4578 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:03:30.038186 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6284953b-91e6-4873-9f5b-0d95ce97c9d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:03:30.038923 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6284953b-91e6-4873-9f5b-0d95ce97c9d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:03:30.039285 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6284953b-91e6-4873-9f5b-0d95ce97c9d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:03:30.039620 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6284953b-91e6-4873-9f5b-0d95ce97c9d6 admin admin] PATH_INFO: `/v3/users/22fd943b05b34c11937acb11ceda5ba6` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:03:30.040843 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6284953b-91e6-4873-9f5b-0d95ce97c9d6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=22fd943b05b34c11937acb11ceda5ba6)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:03:30.042863 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6284953b-91e6-4873-9f5b-0d95ce97c9d6 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:03:30.150916 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f718a1-82e3-4925-bd9a-ac6763df39fe service neutron] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:03:30.152505 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-26f718a1-82e3-4925-bd9a-ac6763df39fe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 10:03:30.169538 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f718a1-82e3-4925-bd9a-ac6763df39fe service neutron] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:03:30.175876 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1d5d09-3880-4117-bd6b-fe35381a9990 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:03:30.176400 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1d5d09-3880-4117-bd6b-fe35381a9990 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:03:30.176701 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1d5d09-3880-4117-bd6b-fe35381a9990 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:03:30.176979 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1d5d09-3880-4117-bd6b-fe35381a9990 admin admin] PATH_INFO: `/v3/projects/14fcdbc39d864bf498390ed68265fc5a` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:03:30.178090 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1d5d09-3880-4117-bd6b-fe35381a9990 admin admin] RBAC: Authorizing `identity:delete_project(project_id=14fcdbc39d864bf498390ed68265fc5a)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:03:30.180043 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1d5d09-3880-4117-bd6b-fe35381a9990 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:03:30.283445 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-6284953b-91e6-4873-9f5b-0d95ce97c9d6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '22fd943b05b34c11937acb11ceda5ba6'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:03:30.284450 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-6284953b-91e6-4873-9f5b-0d95ce97c9d6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '22fd943b05b34c11937acb11ceda5ba6'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:03:30.287176 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-4a1d5d09-3880-4117-bd6b-fe35381a9990 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '14fcdbc39d864bf498390ed68265fc5a', 'request_id': 'req-4a1d5d09-3880-4117-bd6b-fe35381a9990'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:03:30.292556 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-6284953b-91e6-4873-9f5b-0d95ce97c9d6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '22fd943b05b34c11937acb11ceda5ba6'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:03:30.293259 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-6284953b-91e6-4873-9f5b-0d95ce97c9d6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '22fd943b05b34c11937acb11ceda5ba6'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:03:30.307301 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-6284953b-91e6-4873-9f5b-0d95ce97c9d6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '22fd943b05b34c11937acb11ceda5ba6'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:03:30.370862 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-4a1d5d09-3880-4117-bd6b-fe35381a9990 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '14fcdbc39d864bf498390ed68265fc5a', 'request_id': 'req-4a1d5d09-3880-4117-bd6b-fe35381a9990'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:03:30.377979 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-4a1d5d09-3880-4117-bd6b-fe35381a9990 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '14fcdbc39d864bf498390ed68265fc5a', 'request_id': 'req-4a1d5d09-3880-4117-bd6b-fe35381a9990'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:03:30.385221 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:03:30.390041 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-4a1d5d09-3880-4117-bd6b-fe35381a9990 admin admin] The token cache is being invalidate because project 14fcdbc39d864bf498390ed68265fc5a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 10:03:30.390338 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-4a1d5d09-3880-4117-bd6b-fe35381a9990 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:03:30.391038 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-4a1d5d09-3880-4117-bd6b-fe35381a9990 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:03:30.392539 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1272/2536] 10.222.0.65 () {58 vars in 1233 bytes} [Thu Oct 27 10:03:30 2022] DELETE /identity/v3/projects/14fcdbc39d864bf498390ed68265fc5a => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 10:03:30.396660 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1d5d09-3880-4117-bd6b-fe35381a9990 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:03:30.397981 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-4a1d5d09-3880-4117-bd6b-fe35381a9990 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 10:03:30.437451 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1265/2537] 10.222.0.65 () {58 vars in 1224 bytes} [Thu Oct 27 10:03:30 2022] DELETE /identity/v3/users/22fd943b05b34c11937acb11ceda5ba6 => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 10:03:30.472752 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1d5d09-3880-4117-bd6b-fe35381a9990 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:03:30.534277 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef91e4d4-53de-407f-92ae-d13814d75f79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:03:30.534277 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef91e4d4-53de-407f-92ae-d13814d75f79 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:03:30.534654 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef91e4d4-53de-407f-92ae-d13814d75f79 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:03:30.534843 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef91e4d4-53de-407f-92ae-d13814d75f79 admin admin] PATH_INFO: `/v3/users/8401835b870a4834878baf375aedee7e` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:03:30.536132 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef91e4d4-53de-407f-92ae-d13814d75f79 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8401835b870a4834878baf375aedee7e)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:03:30.538081 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef91e4d4-53de-407f-92ae-d13814d75f79 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:03:30.675959 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6284953b-91e6-4873-9f5b-0d95ce97c9d6 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:03:30.677541 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-6284953b-91e6-4873-9f5b-0d95ce97c9d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 10:03:30.691946 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6284953b-91e6-4873-9f5b-0d95ce97c9d6 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:03:30.697134 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5eb49a-ca4f-41ca-b0cd-1a36b0ce921b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:03:30.697813 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5eb49a-ca4f-41ca-b0cd-1a36b0ce921b admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:03:30.698094 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5eb49a-ca4f-41ca-b0cd-1a36b0ce921b admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:03:30.698372 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5eb49a-ca4f-41ca-b0cd-1a36b0ce921b admin admin] PATH_INFO: `/v3/projects/88b9eda8d1724429b8856ce88f274d97` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:03:30.699538 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5eb49a-ca4f-41ca-b0cd-1a36b0ce921b admin admin] RBAC: Authorizing `identity:delete_project(project_id=88b9eda8d1724429b8856ce88f274d97)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:03:30.707395 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5eb49a-ca4f-41ca-b0cd-1a36b0ce921b admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:03:30.722719 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-ef91e4d4-53de-407f-92ae-d13814d75f79 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8401835b870a4834878baf375aedee7e'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:03:30.740934 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-ef91e4d4-53de-407f-92ae-d13814d75f79 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8401835b870a4834878baf375aedee7e'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:03:30.740934 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-ef91e4d4-53de-407f-92ae-d13814d75f79 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8401835b870a4834878baf375aedee7e'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:03:30.746493 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-ef91e4d4-53de-407f-92ae-d13814d75f79 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8401835b870a4834878baf375aedee7e'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:03:30.971878 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-ef91e4d4-53de-407f-92ae-d13814d75f79 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8401835b870a4834878baf375aedee7e'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:03:30.979067 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1273/2538] 10.222.0.65 () {58 vars in 1224 bytes} [Thu Oct 27 10:03:30 2022] DELETE /identity/v3/users/8401835b870a4834878baf375aedee7e => generated 0 bytes in 583 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 10:03:30.990984 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-7e5eb49a-ca4f-41ca-b0cd-1a36b0ce921b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '88b9eda8d1724429b8856ce88f274d97', 'request_id': 'req-7e5eb49a-ca4f-41ca-b0cd-1a36b0ce921b'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:03:30.997302 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-7e5eb49a-ca4f-41ca-b0cd-1a36b0ce921b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '88b9eda8d1724429b8856ce88f274d97', 'request_id': 'req-7e5eb49a-ca4f-41ca-b0cd-1a36b0ce921b'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:03:31.097310 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-7e5eb49a-ca4f-41ca-b0cd-1a36b0ce921b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '88b9eda8d1724429b8856ce88f274d97', 'request_id': 'req-7e5eb49a-ca4f-41ca-b0cd-1a36b0ce921b'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:03:31.108484 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-7e5eb49a-ca4f-41ca-b0cd-1a36b0ce921b admin admin] The token cache is being invalidate because project 88b9eda8d1724429b8856ce88f274d97 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 10:03:31.108703 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-7e5eb49a-ca4f-41ca-b0cd-1a36b0ce921b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:03:31.109339 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-7e5eb49a-ca4f-41ca-b0cd-1a36b0ce921b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:03:31.110869 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1266/2539] 10.222.0.65 () {58 vars in 1233 bytes} [Thu Oct 27 10:03:30 2022] DELETE /identity/v3/projects/88b9eda8d1724429b8856ce88f274d97 => generated 0 bytes in 436 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 10:03:31.115107 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef91e4d4-53de-407f-92ae-d13814d75f79 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:03:31.116604 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-ef91e4d4-53de-407f-92ae-d13814d75f79 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 10:03:31.146064 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:03:31.183968 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef91e4d4-53de-407f-92ae-d13814d75f79 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:03:31.188735 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a28ae18-e102-4fd1-9d7d-8b85d909c837 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:03:31.189426 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a28ae18-e102-4fd1-9d7d-8b85d909c837 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:03:31.189746 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a28ae18-e102-4fd1-9d7d-8b85d909c837 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:03:31.190649 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a28ae18-e102-4fd1-9d7d-8b85d909c837 admin admin] PATH_INFO: `/v3/users/24f6b5941cf94f398d68aa01cbec5d7b` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:03:31.193966 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a28ae18-e102-4fd1-9d7d-8b85d909c837 admin admin] RBAC: Authorizing `identity:delete_user(user_id=24f6b5941cf94f398d68aa01cbec5d7b)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:03:31.197651 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a28ae18-e102-4fd1-9d7d-8b85d909c837 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:03:31.408321 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-6a28ae18-e102-4fd1-9d7d-8b85d909c837 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '24f6b5941cf94f398d68aa01cbec5d7b'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:03:31.420848 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-6a28ae18-e102-4fd1-9d7d-8b85d909c837 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '24f6b5941cf94f398d68aa01cbec5d7b'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:03:31.425830 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-6a28ae18-e102-4fd1-9d7d-8b85d909c837 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '24f6b5941cf94f398d68aa01cbec5d7b'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:03:31.430333 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5eb49a-ca4f-41ca-b0cd-1a36b0ce921b admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:03:31.431790 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-7e5eb49a-ca4f-41ca-b0cd-1a36b0ce921b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 10:03:31.434758 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-6a28ae18-e102-4fd1-9d7d-8b85d909c837 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '24f6b5941cf94f398d68aa01cbec5d7b'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:03:31.476317 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:03:31.500394 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5eb49a-ca4f-41ca-b0cd-1a36b0ce921b admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:03:31.505823 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c206b3f-01a1-45a5-a286-bc6980831b48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:03:31.506451 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c206b3f-01a1-45a5-a286-bc6980831b48 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:03:31.506762 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c206b3f-01a1-45a5-a286-bc6980831b48 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:03:31.507039 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c206b3f-01a1-45a5-a286-bc6980831b48 admin admin] PATH_INFO: `/v3/projects/5e50846f0cf34669926b63109f6f434c` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:03:31.508169 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c206b3f-01a1-45a5-a286-bc6980831b48 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5e50846f0cf34669926b63109f6f434c)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:03:31.510082 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c206b3f-01a1-45a5-a286-bc6980831b48 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:03:31.520289 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-6a28ae18-e102-4fd1-9d7d-8b85d909c837 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '24f6b5941cf94f398d68aa01cbec5d7b'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:03:31.526802 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1274/2540] 10.222.0.65 () {58 vars in 1224 bytes} [Thu Oct 27 10:03:31 2022] DELETE /identity/v3/users/24f6b5941cf94f398d68aa01cbec5d7b => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 10:03:31.618437 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-6c206b3f-01a1-45a5-a286-bc6980831b48 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5e50846f0cf34669926b63109f6f434c', 'request_id': 'req-6c206b3f-01a1-45a5-a286-bc6980831b48'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:03:31.625398 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-6c206b3f-01a1-45a5-a286-bc6980831b48 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5e50846f0cf34669926b63109f6f434c', 'request_id': 'req-6c206b3f-01a1-45a5-a286-bc6980831b48'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:03:31.685631 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-6c206b3f-01a1-45a5-a286-bc6980831b48 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5e50846f0cf34669926b63109f6f434c', 'request_id': 'req-6c206b3f-01a1-45a5-a286-bc6980831b48'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:03:31.697386 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-6c206b3f-01a1-45a5-a286-bc6980831b48 admin admin] The token cache is being invalidate because project 5e50846f0cf34669926b63109f6f434c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 10:03:31.697675 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-6c206b3f-01a1-45a5-a286-bc6980831b48 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:03:31.698314 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-6c206b3f-01a1-45a5-a286-bc6980831b48 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:03:31.699818 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1267/2541] 10.222.0.65 () {58 vars in 1233 bytes} [Thu Oct 27 10:03:31 2022] DELETE /identity/v3/projects/5e50846f0cf34669926b63109f6f434c => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 10:03:31.704845 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd7265f-fed6-4729-85be-f8fb4437d8ba None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:03:31.705192 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd7265f-fed6-4729-85be-f8fb4437d8ba None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:03:31.706034 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd7265f-fed6-4729-85be-f8fb4437d8ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:03:31.726871 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-8fd7265f-fed6-4729-85be-f8fb4437d8ba None None] MFA Rules not processed for user `b5065084bf664b99bdeac46067cb0f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 10:03:31.728089 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-8fd7265f-fed6-4729-85be-f8fb4437d8ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 10:03:31.780737 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c206b3f-01a1-45a5-a286-bc6980831b48 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:03:31.782647 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-6c206b3f-01a1-45a5-a286-bc6980831b48 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 10:03:31.796865 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1275/2542] 10.222.0.65 () {58 vars in 958 bytes} [Thu Oct 27 10:03:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 10:03:31.806215 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9233e6fc-b0df-4116-b43b-24ebd09940c2 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:03:31.806352 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9233e6fc-b0df-4116-b43b-24ebd09940c2 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:03:31.806672 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9233e6fc-b0df-4116-b43b-24ebd09940c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:03:31.827671 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-9233e6fc-b0df-4116-b43b-24ebd09940c2 None None] MFA Rules not processed for user `b5065084bf664b99bdeac46067cb0f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 10:03:31.828895 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-9233e6fc-b0df-4116-b43b-24ebd09940c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 10:03:31.839037 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1276/2543] 10.222.0.65 () {58 vars in 958 bytes} [Thu Oct 27 10:03:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 10:03:31.843090 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9233e6fc-b0df-4116-b43b-24ebd09940c2 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:03:31.853538 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9233e6fc-b0df-4116-b43b-24ebd09940c2 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:03:31.859227 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9196d4-317b-41f9-af81-fe0f9652d2f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:03:31.859843 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9196d4-317b-41f9-af81-fe0f9652d2f4 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:03:31.860123 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9196d4-317b-41f9-af81-fe0f9652d2f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:03:31.860456 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9196d4-317b-41f9-af81-fe0f9652d2f4 admin admin] PATH_INFO: `/v3/domains` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:03:31.861046 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9196d4-317b-41f9-af81-fe0f9652d2f4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 10:03:31.862102 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9196d4-317b-41f9-af81-fe0f9652d2f4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:03:31.863785 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9196d4-317b-41f9-af81-fe0f9652d2f4 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:03:31.879920 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c206b3f-01a1-45a5-a286-bc6980831b48 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:03:31.880285 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1277/2544] 10.222.0.65 () {58 vars in 1153 bytes} [Thu Oct 27 10:03:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 10:03:31.884832 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9196d4-317b-41f9-af81-fe0f9652d2f4 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:03:31.887648 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2f8834-3859-4d88-9823-208098ff82a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:03:31.888352 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2f8834-3859-4d88-9823-208098ff82a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:03:31.888637 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2f8834-3859-4d88-9823-208098ff82a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:03:31.888945 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2f8834-3859-4d88-9823-208098ff82a2 admin admin] PATH_INFO: `/v3/projects/8df56fffe31640ab86b2ade27187ad9b` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:03:31.890271 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2f8834-3859-4d88-9823-208098ff82a2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8df56fffe31640ab86b2ade27187ad9b)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:03:31.892308 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2f8834-3859-4d88-9823-208098ff82a2 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:03:31.895671 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9196d4-317b-41f9-af81-fe0f9652d2f4 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:03:31.900545 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97431b0e-a794-4df3-bb0d-8b4ebeffce57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:03:31.901164 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97431b0e-a794-4df3-bb0d-8b4ebeffce57 admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:03:31.901479 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97431b0e-a794-4df3-bb0d-8b4ebeffce57 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:03:31.901784 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97431b0e-a794-4df3-bb0d-8b4ebeffce57 admin admin] PATH_INFO: `/v3/projects` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:03:31.902350 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97431b0e-a794-4df3-bb0d-8b4ebeffce57 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:03:31.904288 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97431b0e-a794-4df3-bb0d-8b4ebeffce57 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:03:31.995751 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1278/2545] 10.222.0.65 () {60 vars in 1153 bytes} [Thu Oct 27 10:03:31 2022] POST /identity/v3/projects => generated 391 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 10:03:31.999885 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97431b0e-a794-4df3-bb0d-8b4ebeffce57 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:03:32.005038 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:03:32.024540 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-7b2f8834-3859-4d88-9823-208098ff82a2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8df56fffe31640ab86b2ade27187ad9b', 'request_id': 'req-7b2f8834-3859-4d88-9823-208098ff82a2'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:03:32.031175 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-7b2f8834-3859-4d88-9823-208098ff82a2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8df56fffe31640ab86b2ade27187ad9b', 'request_id': 'req-7b2f8834-3859-4d88-9823-208098ff82a2'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:03:32.063368 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97431b0e-a794-4df3-bb0d-8b4ebeffce57 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:03:32.097166 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-7b2f8834-3859-4d88-9823-208098ff82a2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8df56fffe31640ab86b2ade27187ad9b', 'request_id': 'req-7b2f8834-3859-4d88-9823-208098ff82a2'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:03:32.103264 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:03:32.109036 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-7b2f8834-3859-4d88-9823-208098ff82a2 admin admin] The token cache is being invalidate because project 8df56fffe31640ab86b2ade27187ad9b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 10:03:32.109403 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-7b2f8834-3859-4d88-9823-208098ff82a2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:03:32.110121 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-7b2f8834-3859-4d88-9823-208098ff82a2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:03:32.112444 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1268/2546] 10.222.0.65 () {58 vars in 1233 bytes} [Thu Oct 27 10:03:31 2022] DELETE /identity/v3/projects/8df56fffe31640ab86b2ade27187ad9b => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 10:03:32.117343 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ece0ec-23ce-433a-9a54-f10e4b913c3d None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:03:32.117634 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ece0ec-23ce-433a-9a54-f10e4b913c3d None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:03:32.117910 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ece0ec-23ce-433a-9a54-f10e4b913c3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:03:32.124643 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62756f21-899b-4d74-af8b-5f926ab713e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:03:32.128075 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62756f21-899b-4d74-af8b-5f926ab713e9 admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:03:32.128075 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62756f21-899b-4d74-af8b-5f926ab713e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:03:32.128075 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62756f21-899b-4d74-af8b-5f926ab713e9 admin admin] PATH_INFO: `/v3/users` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:03:32.128075 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62756f21-899b-4d74-af8b-5f926ab713e9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:03:32.128573 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62756f21-899b-4d74-af8b-5f926ab713e9 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:03:32.138803 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-61ece0ec-23ce-433a-9a54-f10e4b913c3d None None] MFA Rules not processed for user `b5065084bf664b99bdeac46067cb0f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 10:03:32.140059 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-61ece0ec-23ce-433a-9a54-f10e4b913c3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 10:03:32.148407 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1269/2547] 10.222.0.65 () {58 vars in 958 bytes} [Thu Oct 27 10:03:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 10:03:32.155752 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79589c45-21af-4d6b-baa7-b6577b62ab1d None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:03:32.156686 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79589c45-21af-4d6b-baa7-b6577b62ab1d None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:03:32.156686 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79589c45-21af-4d6b-baa7-b6577b62ab1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:03:32.177649 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-79589c45-21af-4d6b-baa7-b6577b62ab1d None None] MFA Rules not processed for user `b5065084bf664b99bdeac46067cb0f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 10:03:32.178887 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-79589c45-21af-4d6b-baa7-b6577b62ab1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 10:03:32.186871 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1270/2548] 10.222.0.65 () {58 vars in 958 bytes} [Thu Oct 27 10:03:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 10:03:32.191072 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79589c45-21af-4d6b-baa7-b6577b62ab1d None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:03:32.200097 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79589c45-21af-4d6b-baa7-b6577b62ab1d None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:03:32.204754 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da12086-337a-4fd9-bd53-8773db1db937 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:03:32.205385 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da12086-337a-4fd9-bd53-8773db1db937 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:03:32.205674 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da12086-337a-4fd9-bd53-8773db1db937 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:03:32.205953 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da12086-337a-4fd9-bd53-8773db1db937 admin admin] PATH_INFO: `/v3/domains` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:03:32.206631 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da12086-337a-4fd9-bd53-8773db1db937 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 10:03:32.206942 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da12086-337a-4fd9-bd53-8773db1db937 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:03:32.208794 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da12086-337a-4fd9-bd53-8773db1db937 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:03:32.211749 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1279/2549] 10.222.0.65 () {60 vars in 1144 bytes} [Thu Oct 27 10:03:31 2022] POST /identity/v3/users => generated 296 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 10:03:32.216981 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62756f21-899b-4d74-af8b-5f926ab713e9 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:03:32.218685 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-62756f21-899b-4d74-af8b-5f926ab713e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 10:03:32.226155 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1271/2550] 10.222.0.65 () {58 vars in 1153 bytes} [Thu Oct 27 10:03:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 10:03:32.227098 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da12086-337a-4fd9-bd53-8773db1db937 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:03:32.231515 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62756f21-899b-4d74-af8b-5f926ab713e9 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:03:32.237863 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac6657a-49b4-4de6-a0ed-540bba6eb571 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:03:32.238059 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da12086-337a-4fd9-bd53-8773db1db937 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:03:32.238468 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac6657a-49b4-4de6-a0ed-540bba6eb571 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:03:32.238784 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac6657a-49b4-4de6-a0ed-540bba6eb571 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:03:32.239056 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac6657a-49b4-4de6-a0ed-540bba6eb571 admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:03:32.239696 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac6657a-49b4-4de6-a0ed-540bba6eb571 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:03:32.241293 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac6657a-49b4-4de6-a0ed-540bba6eb571 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:03:32.243023 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7869f3-6e22-480b-8594-6bc5572ad904 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:03:32.243639 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7869f3-6e22-480b-8594-6bc5572ad904 admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:03:32.243922 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7869f3-6e22-480b-8594-6bc5572ad904 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:03:32.244199 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7869f3-6e22-480b-8594-6bc5572ad904 admin admin] PATH_INFO: `/v3/projects` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:03:32.244835 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7869f3-6e22-480b-8594-6bc5572ad904 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:03:32.246818 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7869f3-6e22-480b-8594-6bc5572ad904 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:03:32.251645 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1280/2551] 10.222.0.65 () {58 vars in 1122 bytes} [Thu Oct 27 10:03:32 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 10:03:32.255692 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac6657a-49b4-4de6-a0ed-540bba6eb571 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:03:32.265810 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac6657a-49b4-4de6-a0ed-540bba6eb571 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:03:32.270964 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7e8d3b-8d50-4c3b-ba6f-3ed9fd02f390 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:03:32.271571 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7e8d3b-8d50-4c3b-ba6f-3ed9fd02f390 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:03:32.271856 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7e8d3b-8d50-4c3b-ba6f-3ed9fd02f390 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:03:32.272134 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7e8d3b-8d50-4c3b-ba6f-3ed9fd02f390 admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:03:32.272777 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7e8d3b-8d50-4c3b-ba6f-3ed9fd02f390 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:03:32.274368 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7e8d3b-8d50-4c3b-ba6f-3ed9fd02f390 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:03:32.285849 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1281/2552] 10.222.0.65 () {58 vars in 1122 bytes} [Thu Oct 27 10:03:32 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 10:03:32.289977 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7e8d3b-8d50-4c3b-ba6f-3ed9fd02f390 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:03:32.300297 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7e8d3b-8d50-4c3b-ba6f-3ed9fd02f390 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:03:32.305004 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7609214c-517f-4cb7-9c0b-75abea41a8ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:03:32.305585 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7609214c-517f-4cb7-9c0b-75abea41a8ef admin admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:03:32.305873 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7609214c-517f-4cb7-9c0b-75abea41a8ef admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:03:32.306160 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7609214c-517f-4cb7-9c0b-75abea41a8ef admin admin] PATH_INFO: `/v3/projects/d636d77a7b0f44b1a84ccb5e9ef074f6/users/869e1945407d44c6a046a8c2472612dd/roles/43543ce1450245af9661cb017bac17bd` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:03:32.321453 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7609214c-517f-4cb7-9c0b-75abea41a8ef admin admin] RBAC: Authorizing `identity:create_grant(project_id=d636d77a7b0f44b1a84ccb5e9ef074f6, user_id=869e1945407d44c6a046a8c2472612dd, role_id=43543ce1450245af9661cb017bac17bd)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:03:32.324241 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7609214c-517f-4cb7-9c0b-75abea41a8ef admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:03:32.344366 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1272/2553] 10.222.0.65 () {60 vars in 1153 bytes} [Thu Oct 27 10:03:32 2022] POST /identity/v3/projects => generated 383 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 10:03:32.348974 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7869f3-6e22-480b-8594-6bc5572ad904 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:03:32.411019 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7869f3-6e22-480b-8594-6bc5572ad904 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:03:32.415761 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d41700d-09d3-4d21-a730-3a3bf5d4217a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:03:32.416373 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d41700d-09d3-4d21-a730-3a3bf5d4217a admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:03:32.416700 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d41700d-09d3-4d21-a730-3a3bf5d4217a admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:03:32.417063 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d41700d-09d3-4d21-a730-3a3bf5d4217a admin admin] PATH_INFO: `/v3/users` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:03:32.417698 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d41700d-09d3-4d21-a730-3a3bf5d4217a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:03:32.419666 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d41700d-09d3-4d21-a730-3a3bf5d4217a admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:03:32.423298 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1282/2554] 10.222.0.65 () {60 vars in 1483 bytes} [Thu Oct 27 10:03:32 2022] PUT /identity/v3/projects/d636d77a7b0f44b1a84ccb5e9ef074f6/users/869e1945407d44c6a046a8c2472612dd/roles/43543ce1450245af9661cb017bac17bd => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 10:03:32.436144 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfaabec2-eba7-4a37-8e1f-8ba51b197282 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:03:32.436443 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfaabec2-eba7-4a37-8e1f-8ba51b197282 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:03:32.436728 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfaabec2-eba7-4a37-8e1f-8ba51b197282 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:03:32.466440 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-cfaabec2-eba7-4a37-8e1f-8ba51b197282 None None] MFA Rules not processed for user `869e1945407d44c6a046a8c2472612dd`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 10:03:32.467754 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-cfaabec2-eba7-4a37-8e1f-8ba51b197282 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 10:03:32.506751 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1273/2555] 10.222.0.65 () {60 vars in 1144 bytes} [Thu Oct 27 10:03:32 2022] POST /identity/v3/users => generated 292 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 10:03:32.507846 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d41700d-09d3-4d21-a730-3a3bf5d4217a admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:03:32.512611 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:03:32.518383 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d41700d-09d3-4d21-a730-3a3bf5d4217a admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:03:32.538350 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1283/2556] 10.222.0.65 () {58 vars in 958 bytes} [Thu Oct 27 10:03:32 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 10:03:32.549950 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfaabec2-eba7-4a37-8e1f-8ba51b197282 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:03:32.551371 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-cfaabec2-eba7-4a37-8e1f-8ba51b197282 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 10:03:32.582594 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6ea14c-8b20-4607-bac0-12293d793e6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:03:32.583212 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6ea14c-8b20-4607-bac0-12293d793e6c admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:03:32.583501 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6ea14c-8b20-4607-bac0-12293d793e6c admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:03:32.583778 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6ea14c-8b20-4607-bac0-12293d793e6c admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:03:32.584423 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6ea14c-8b20-4607-bac0-12293d793e6c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:03:32.586029 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6ea14c-8b20-4607-bac0-12293d793e6c admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:03:32.602576 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1274/2557] 10.222.0.65 () {58 vars in 1122 bytes} [Thu Oct 27 10:03:32 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 10:03:32.603683 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6ea14c-8b20-4607-bac0-12293d793e6c admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:03:32.611385 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfaabec2-eba7-4a37-8e1f-8ba51b197282 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:03:32.614001 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6ea14c-8b20-4607-bac0-12293d793e6c admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:03:32.615963 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726b3dd1-67ab-4140-91a5-23a9a2ba3a16 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8e5d5f04c4741bb86ca4a0f667d4ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc2e3a7a1bcc480891c0b433291c00b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:03:32.616480 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726b3dd1-67ab-4140-91a5-23a9a2ba3a16 service cinder] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:03:32.616762 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726b3dd1-67ab-4140-91a5-23a9a2ba3a16 service cinder] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:03:32.617085 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726b3dd1-67ab-4140-91a5-23a9a2ba3a16 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:03:32.618746 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58306058-02b0-4203-b6f1-aa99557ed356 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:03:32.619297 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58306058-02b0-4203-b6f1-aa99557ed356 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:03:32.619580 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58306058-02b0-4203-b6f1-aa99557ed356 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:03:32.619868 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58306058-02b0-4203-b6f1-aa99557ed356 admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:03:32.620647 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58306058-02b0-4203-b6f1-aa99557ed356 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:03:32.622264 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58306058-02b0-4203-b6f1-aa99557ed356 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:03:32.625739 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726b3dd1-67ab-4140-91a5-23a9a2ba3a16 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:03:32.627825 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726b3dd1-67ab-4140-91a5-23a9a2ba3a16 service cinder] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:03:32.637617 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1275/2558] 10.222.0.65 () {58 vars in 1122 bytes} [Thu Oct 27 10:03:32 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 10:03:32.637812 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1284/2559] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Oct 27 10:03:32 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 10:03:32.639441 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58306058-02b0-4203-b6f1-aa99557ed356 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:03:32.649649 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58306058-02b0-4203-b6f1-aa99557ed356 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:03:32.654762 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec7366b-fb00-4116-8fd3-a37c684991be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:03:32.655483 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec7366b-fb00-4116-8fd3-a37c684991be admin admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:03:32.655833 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec7366b-fb00-4116-8fd3-a37c684991be admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:03:32.656202 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec7366b-fb00-4116-8fd3-a37c684991be admin admin] PATH_INFO: `/v3/projects/15ad3fa81d014a5da7d2bda8a142f88c/users/1a39f57927ad40258d03ed4efe60a63b/roles/43543ce1450245af9661cb017bac17bd` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:03:32.672065 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec7366b-fb00-4116-8fd3-a37c684991be admin admin] RBAC: Authorizing `identity:create_grant(project_id=15ad3fa81d014a5da7d2bda8a142f88c, user_id=1a39f57927ad40258d03ed4efe60a63b, role_id=43543ce1450245af9661cb017bac17bd)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:03:32.675418 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec7366b-fb00-4116-8fd3-a37c684991be admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:03:32.732374 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:03:32.738566 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1276/2560] 10.222.0.65 () {60 vars in 1483 bytes} [Thu Oct 27 10:03:32 2022] PUT /identity/v3/projects/15ad3fa81d014a5da7d2bda8a142f88c/users/1a39f57927ad40258d03ed4efe60a63b/roles/43543ce1450245af9661cb017bac17bd => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 10:03:32.753555 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14f7b70-7260-457e-a3ff-d2844c587553 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:03:32.753804 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14f7b70-7260-457e-a3ff-d2844c587553 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:03:32.754082 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14f7b70-7260-457e-a3ff-d2844c587553 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:03:32.784359 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-f14f7b70-7260-457e-a3ff-d2844c587553 None None] MFA Rules not processed for user `1a39f57927ad40258d03ed4efe60a63b`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 10:03:32.785529 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-f14f7b70-7260-457e-a3ff-d2844c587553 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 10:03:32.855581 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1285/2561] 10.222.0.65 () {58 vars in 958 bytes} [Thu Oct 27 10:03:32 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 10:03:32.867727 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec7366b-fb00-4116-8fd3-a37c684991be admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:03:32.869534 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-2ec7366b-fb00-4116-8fd3-a37c684991be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 10:03:32.929729 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec7366b-fb00-4116-8fd3-a37c684991be admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:03:32.933485 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fa2576-6eb1-4e42-b738-71a942fa5057 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8e5d5f04c4741bb86ca4a0f667d4ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc2e3a7a1bcc480891c0b433291c00b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:03:32.934089 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fa2576-6eb1-4e42-b738-71a942fa5057 service cinder] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:03:32.934370 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fa2576-6eb1-4e42-b738-71a942fa5057 service cinder] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:03:32.934754 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fa2576-6eb1-4e42-b738-71a942fa5057 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:03:32.943373 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fa2576-6eb1-4e42-b738-71a942fa5057 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:03:32.945658 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fa2576-6eb1-4e42-b738-71a942fa5057 service cinder] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:03:32.953855 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1277/2562] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Oct 27 10:03:32 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 10:03:32.975193 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14f7b70-7260-457e-a3ff-d2844c587553 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:03:33.043865 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14f7b70-7260-457e-a3ff-d2844c587553 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:03:33.048517 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16409bb3-85e2-48aa-a78b-6f4bd587fcf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:03:33.049891 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16409bb3-85e2-48aa-a78b-6f4bd587fcf6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:03:33.050355 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16409bb3-85e2-48aa-a78b-6f4bd587fcf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:03:33.050773 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16409bb3-85e2-48aa-a78b-6f4bd587fcf6 admin admin] PATH_INFO: `/v3/users/1a39f57927ad40258d03ed4efe60a63b` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:03:33.051935 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16409bb3-85e2-48aa-a78b-6f4bd587fcf6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1a39f57927ad40258d03ed4efe60a63b)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:03:33.053979 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16409bb3-85e2-48aa-a78b-6f4bd587fcf6 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:03:33.071230 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:03:33.288512 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-16409bb3-85e2-48aa-a78b-6f4bd587fcf6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1a39f57927ad40258d03ed4efe60a63b'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:03:33.301034 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-16409bb3-85e2-48aa-a78b-6f4bd587fcf6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1a39f57927ad40258d03ed4efe60a63b'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:03:33.301803 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-16409bb3-85e2-48aa-a78b-6f4bd587fcf6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1a39f57927ad40258d03ed4efe60a63b'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:03:33.311894 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-16409bb3-85e2-48aa-a78b-6f4bd587fcf6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1a39f57927ad40258d03ed4efe60a63b'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:03:33.451955 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-16409bb3-85e2-48aa-a78b-6f4bd587fcf6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1a39f57927ad40258d03ed4efe60a63b'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:03:33.459780 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1286/2563] 10.222.0.65 () {58 vars in 1224 bytes} [Thu Oct 27 10:03:32 2022] DELETE /identity/v3/users/1a39f57927ad40258d03ed4efe60a63b => generated 0 bytes in 485 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 10:03:33.464587 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39b4d8f-6105-4887-9067-074763938db7 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:03:33.464873 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39b4d8f-6105-4887-9067-074763938db7 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:03:33.465148 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39b4d8f-6105-4887-9067-074763938db7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:03:33.487761 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-f39b4d8f-6105-4887-9067-074763938db7 None None] MFA Rules not processed for user `b5065084bf664b99bdeac46067cb0f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 10:03:33.491027 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-f39b4d8f-6105-4887-9067-074763938db7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 10:03:33.552201 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1278/2564] 10.222.0.65 () {58 vars in 958 bytes} [Thu Oct 27 10:03:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 10:03:33.561981 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16409bb3-85e2-48aa-a78b-6f4bd587fcf6 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:03:33.563694 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-16409bb3-85e2-48aa-a78b-6f4bd587fcf6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 10:03:33.627033 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16409bb3-85e2-48aa-a78b-6f4bd587fcf6 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:03:33.631418 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6735fa38-c8b2-491d-a220-2ce97e31c7e2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6191cc41efa74f46b49022cf387f7a4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc2e3a7a1bcc480891c0b433291c00b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:03:33.632023 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6735fa38-c8b2-491d-a220-2ce97e31c7e2 service neutron] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:03:33.632306 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6735fa38-c8b2-491d-a220-2ce97e31c7e2 service neutron] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:03:33.632579 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6735fa38-c8b2-491d-a220-2ce97e31c7e2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:03:33.641909 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6735fa38-c8b2-491d-a220-2ce97e31c7e2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:03:33.644033 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6735fa38-c8b2-491d-a220-2ce97e31c7e2 service neutron] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:03:33.653887 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1287/2565] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Oct 27 10:03:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 10:03:34.035431 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39b4d8f-6105-4887-9067-074763938db7 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:03:34.036873 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-f39b4d8f-6105-4887-9067-074763938db7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 10:03:34.051677 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39b4d8f-6105-4887-9067-074763938db7 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:03:34.056603 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37007b68-a87b-40ff-b47d-621215160e33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:03:34.057300 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37007b68-a87b-40ff-b47d-621215160e33 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:03:34.058110 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37007b68-a87b-40ff-b47d-621215160e33 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:03:34.058467 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37007b68-a87b-40ff-b47d-621215160e33 admin admin] PATH_INFO: `/v3/projects/15ad3fa81d014a5da7d2bda8a142f88c` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:03:34.059823 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37007b68-a87b-40ff-b47d-621215160e33 admin admin] RBAC: Authorizing `identity:delete_project(project_id=15ad3fa81d014a5da7d2bda8a142f88c)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:03:34.061770 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37007b68-a87b-40ff-b47d-621215160e33 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:03:34.165473 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-37007b68-a87b-40ff-b47d-621215160e33 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '15ad3fa81d014a5da7d2bda8a142f88c', 'request_id': 'req-37007b68-a87b-40ff-b47d-621215160e33'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:03:34.171715 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-37007b68-a87b-40ff-b47d-621215160e33 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '15ad3fa81d014a5da7d2bda8a142f88c', 'request_id': 'req-37007b68-a87b-40ff-b47d-621215160e33'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:03:34.250942 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-37007b68-a87b-40ff-b47d-621215160e33 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '15ad3fa81d014a5da7d2bda8a142f88c', 'request_id': 'req-37007b68-a87b-40ff-b47d-621215160e33'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:03:34.263291 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-37007b68-a87b-40ff-b47d-621215160e33 admin admin] The token cache is being invalidate because project 15ad3fa81d014a5da7d2bda8a142f88c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 10:03:34.263584 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-37007b68-a87b-40ff-b47d-621215160e33 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:03:34.264214 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-37007b68-a87b-40ff-b47d-621215160e33 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:03:34.265752 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1279/2566] 10.222.0.65 () {58 vars in 1233 bytes} [Thu Oct 27 10:03:34 2022] DELETE /identity/v3/projects/15ad3fa81d014a5da7d2bda8a142f88c => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 10:03:34.271319 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0759464d-ec78-4e8e-aa6f-66d82a624473 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:03:34.271600 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0759464d-ec78-4e8e-aa6f-66d82a624473 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:03:34.271880 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0759464d-ec78-4e8e-aa6f-66d82a624473 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:03:34.292023 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-0759464d-ec78-4e8e-aa6f-66d82a624473 None None] MFA Rules not processed for user `b5065084bf664b99bdeac46067cb0f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 10:03:34.293233 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-0759464d-ec78-4e8e-aa6f-66d82a624473 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 10:03:34.355659 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1288/2567] 10.222.0.65 () {58 vars in 958 bytes} [Thu Oct 27 10:03:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 10:03:34.364436 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685abc27-fb26-4345-9315-0cf5e0357c38 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:03:34.365758 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685abc27-fb26-4345-9315-0cf5e0357c38 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:03:34.365758 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685abc27-fb26-4345-9315-0cf5e0357c38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:03:34.385807 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-685abc27-fb26-4345-9315-0cf5e0357c38 None None] MFA Rules not processed for user `b5065084bf664b99bdeac46067cb0f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 10:03:34.387063 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-685abc27-fb26-4345-9315-0cf5e0357c38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 10:03:34.396021 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1280/2568] 10.222.0.65 () {58 vars in 958 bytes} [Thu Oct 27 10:03:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 10:03:34.400348 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0759464d-ec78-4e8e-aa6f-66d82a624473 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:03:34.415179 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0759464d-ec78-4e8e-aa6f-66d82a624473 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:03:34.417654 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e3805c-ee1c-4c0b-bc26-88bdef889135 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:03:34.418220 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e3805c-ee1c-4c0b-bc26-88bdef889135 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:03:34.418549 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e3805c-ee1c-4c0b-bc26-88bdef889135 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:03:34.418858 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e3805c-ee1c-4c0b-bc26-88bdef889135 admin admin] PATH_INFO: `/v3/domains` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:03:34.419546 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e3805c-ee1c-4c0b-bc26-88bdef889135 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 10:03:34.419856 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e3805c-ee1c-4c0b-bc26-88bdef889135 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:03:34.421520 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e3805c-ee1c-4c0b-bc26-88bdef889135 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:03:34.442988 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1289/2569] 10.222.0.65 () {58 vars in 1153 bytes} [Thu Oct 27 10:03:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 10:03:34.447639 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685abc27-fb26-4345-9315-0cf5e0357c38 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:03:34.458987 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685abc27-fb26-4345-9315-0cf5e0357c38 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:03:34.464133 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96704055-39e2-4598-b496-0c6896317c08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:03:34.464813 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96704055-39e2-4598-b496-0c6896317c08 admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:03:34.465164 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96704055-39e2-4598-b496-0c6896317c08 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:03:34.465504 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96704055-39e2-4598-b496-0c6896317c08 admin admin] PATH_INFO: `/v3/projects` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:03:34.466250 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96704055-39e2-4598-b496-0c6896317c08 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:03:34.468284 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96704055-39e2-4598-b496-0c6896317c08 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:03:34.485991 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:03:34.556829 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1281/2570] 10.222.0.65 () {60 vars in 1153 bytes} [Thu Oct 27 10:03:34 2022] POST /identity/v3/projects => generated 381 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 10:03:34.561070 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e3805c-ee1c-4c0b-bc26-88bdef889135 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:03:34.571642 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e3805c-ee1c-4c0b-bc26-88bdef889135 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:03:34.592985 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:03:34.630933 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba319444-0972-473d-ac64-7ed007fa6f22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:03:34.631536 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba319444-0972-473d-ac64-7ed007fa6f22 admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:03:34.631815 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba319444-0972-473d-ac64-7ed007fa6f22 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:03:34.632093 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba319444-0972-473d-ac64-7ed007fa6f22 admin admin] PATH_INFO: `/v3/users` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:03:34.632725 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba319444-0972-473d-ac64-7ed007fa6f22 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:03:34.634644 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba319444-0972-473d-ac64-7ed007fa6f22 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:03:34.720449 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1290/2571] 10.222.0.65 () {60 vars in 1144 bytes} [Thu Oct 27 10:03:34 2022] POST /identity/v3/users => generated 291 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 10:03:34.725585 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96704055-39e2-4598-b496-0c6896317c08 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:03:34.736177 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96704055-39e2-4598-b496-0c6896317c08 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:03:34.741607 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9366352-2f7a-414c-9f21-d6ad1468bcd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:03:34.742211 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9366352-2f7a-414c-9f21-d6ad1468bcd0 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:03:34.742493 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9366352-2f7a-414c-9f21-d6ad1468bcd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:03:34.742937 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9366352-2f7a-414c-9f21-d6ad1468bcd0 admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:03:34.743591 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9366352-2f7a-414c-9f21-d6ad1468bcd0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:03:34.745197 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9366352-2f7a-414c-9f21-d6ad1468bcd0 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:03:34.755923 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1282/2572] 10.222.0.65 () {58 vars in 1122 bytes} [Thu Oct 27 10:03:34 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 10:03:34.761703 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba319444-0972-473d-ac64-7ed007fa6f22 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:03:34.772634 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba319444-0972-473d-ac64-7ed007fa6f22 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:03:34.777432 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72edc1d1-fd07-4218-8580-6bf493f79fef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:03:34.778026 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72edc1d1-fd07-4218-8580-6bf493f79fef admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:03:34.778305 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72edc1d1-fd07-4218-8580-6bf493f79fef admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:03:34.778607 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72edc1d1-fd07-4218-8580-6bf493f79fef admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:03:34.779243 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72edc1d1-fd07-4218-8580-6bf493f79fef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:03:34.780869 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72edc1d1-fd07-4218-8580-6bf493f79fef admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:03:34.793724 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1291/2573] 10.222.0.65 () {58 vars in 1122 bytes} [Thu Oct 27 10:03:34 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 10:03:34.795941 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9366352-2f7a-414c-9f21-d6ad1468bcd0 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:03:34.806901 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9366352-2f7a-414c-9f21-d6ad1468bcd0 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:03:34.811931 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec818ff3-d6b0-4f5a-ae71-b78d55b74f01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:03:34.812585 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec818ff3-d6b0-4f5a-ae71-b78d55b74f01 admin admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:03:34.812868 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec818ff3-d6b0-4f5a-ae71-b78d55b74f01 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:03:34.813147 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec818ff3-d6b0-4f5a-ae71-b78d55b74f01 admin admin] PATH_INFO: `/v3/projects/594c861cc8664a9db28fba3c51aa9c0a/users/f0bf245ab7b9431291c42a56993c85ea/roles/43543ce1450245af9661cb017bac17bd` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:03:34.828741 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec818ff3-d6b0-4f5a-ae71-b78d55b74f01 admin admin] RBAC: Authorizing `identity:create_grant(project_id=594c861cc8664a9db28fba3c51aa9c0a, user_id=f0bf245ab7b9431291c42a56993c85ea, role_id=43543ce1450245af9661cb017bac17bd)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:03:34.832903 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec818ff3-d6b0-4f5a-ae71-b78d55b74f01 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:03:34.918296 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1283/2574] 10.222.0.65 () {60 vars in 1483 bytes} [Thu Oct 27 10:03:34 2022] PUT /identity/v3/projects/594c861cc8664a9db28fba3c51aa9c0a/users/f0bf245ab7b9431291c42a56993c85ea/roles/43543ce1450245af9661cb017bac17bd => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 10:03:34.923478 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc981c36-f9b4-4823-86bd-2e71dee22edd None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:03:34.923879 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc981c36-f9b4-4823-86bd-2e71dee22edd None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:03:34.924187 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc981c36-f9b4-4823-86bd-2e71dee22edd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:03:34.944434 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-cc981c36-f9b4-4823-86bd-2e71dee22edd None None] MFA Rules not processed for user `b5065084bf664b99bdeac46067cb0f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 10:03:34.945672 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-cc981c36-f9b4-4823-86bd-2e71dee22edd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 10:03:35.010424 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1292/2575] 10.222.0.65 () {58 vars in 958 bytes} [Thu Oct 27 10:03:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 10:03:35.021328 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec818ff3-d6b0-4f5a-ae71-b78d55b74f01 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:03:35.023295 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-ec818ff3-d6b0-4f5a-ae71-b78d55b74f01 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 10:03:35.083461 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec818ff3-d6b0-4f5a-ae71-b78d55b74f01 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:03:35.087187 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b32836-a990-49d3-bdf7-de7666919572 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6191cc41efa74f46b49022cf387f7a4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc2e3a7a1bcc480891c0b433291c00b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:03:35.087793 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b32836-a990-49d3-bdf7-de7666919572 service neutron] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:03:35.088077 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b32836-a990-49d3-bdf7-de7666919572 service neutron] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:03:35.088352 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b32836-a990-49d3-bdf7-de7666919572 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:03:35.097810 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b32836-a990-49d3-bdf7-de7666919572 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:03:35.099299 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b32836-a990-49d3-bdf7-de7666919572 service neutron] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:03:35.109010 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1284/2576] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Oct 27 10:03:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 10:03:36.350915 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26ed79b-7db4-4a7b-9c4c-9b57ca3716f0 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:03:36.351451 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26ed79b-7db4-4a7b-9c4c-9b57ca3716f0 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:03:36.351451 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26ed79b-7db4-4a7b-9c4c-9b57ca3716f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:03:36.393930 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-c26ed79b-7db4-4a7b-9c4c-9b57ca3716f0 None None] MFA Rules not processed for user `f0bf245ab7b9431291c42a56993c85ea`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 10:03:36.395977 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-c26ed79b-7db4-4a7b-9c4c-9b57ca3716f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 10:03:36.470969 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1293/2577] 10.222.0.65 () {58 vars in 958 bytes} [Thu Oct 27 10:03:36 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 10:03:36.482651 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b32836-a990-49d3-bdf7-de7666919572 service neutron] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:03:36.484154 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-b8b32836-a990-49d3-bdf7-de7666919572 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 10:03:36.545611 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b32836-a990-49d3-bdf7-de7666919572 service neutron] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:03:36.549508 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f833a482-64d4-4352-9973-89155c3512ea service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8e5d5f04c4741bb86ca4a0f667d4ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc2e3a7a1bcc480891c0b433291c00b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:03:36.550104 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f833a482-64d4-4352-9973-89155c3512ea service cinder] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:03:36.550387 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f833a482-64d4-4352-9973-89155c3512ea service cinder] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:03:36.552434 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f833a482-64d4-4352-9973-89155c3512ea service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:03:36.559381 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f833a482-64d4-4352-9973-89155c3512ea service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:03:36.560763 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f833a482-64d4-4352-9973-89155c3512ea service cinder] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:03:36.570122 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1285/2578] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Oct 27 10:03:36 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 10:03:38.370257 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9636fd-c618-458d-9abf-1620093521d1 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:03:38.370869 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9636fd-c618-458d-9abf-1620093521d1 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:03:38.370986 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9636fd-c618-458d-9abf-1620093521d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:03:38.390149 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-9b9636fd-c618-458d-9abf-1620093521d1 None None] MFA Rules not processed for user `f0bf245ab7b9431291c42a56993c85ea`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 10:03:38.391404 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-9b9636fd-c618-458d-9abf-1620093521d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 10:03:38.398422 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1294/2579] 10.222.0.65 () {58 vars in 958 bytes} [Thu Oct 27 10:03:38 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 10:03:39.113010 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f833a482-64d4-4352-9973-89155c3512ea service cinder] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:03:39.114674 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-f833a482-64d4-4352-9973-89155c3512ea service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 10:03:39.194889 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f833a482-64d4-4352-9973-89155c3512ea service cinder] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:03:39.199929 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f31a51a-4366-407b-b3ea-7499a5cfe5ab service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8c47ff5d72943f6bab09b5df6198d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc2e3a7a1bcc480891c0b433291c00b1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:03:39.200567 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f31a51a-4366-407b-b3ea-7499a5cfe5ab service placement] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:03:39.200841 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f31a51a-4366-407b-b3ea-7499a5cfe5ab service placement] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:03:39.201112 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f31a51a-4366-407b-b3ea-7499a5cfe5ab service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:03:39.202876 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-7f31a51a-4366-407b-b3ea-7499a5cfe5ab service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 10:03:39.212840 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:03:39.215592 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f31a51a-4366-407b-b3ea-7499a5cfe5ab service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:03:39.217167 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f31a51a-4366-407b-b3ea-7499a5cfe5ab service placement] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:03:39.227432 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1286/2580] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Oct 27 10:03:39 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 10:03:42.375866 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9636fd-c618-458d-9abf-1620093521d1 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:03:42.377465 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-9b9636fd-c618-458d-9abf-1620093521d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 10:03:42.391947 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9636fd-c618-458d-9abf-1620093521d1 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:03:42.396538 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4c5e08-45fd-45e4-a216-06ceedb83e29 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6191cc41efa74f46b49022cf387f7a4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc2e3a7a1bcc480891c0b433291c00b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:03:42.408273 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4c5e08-45fd-45e4-a216-06ceedb83e29 service neutron] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:03:42.408273 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4c5e08-45fd-45e4-a216-06ceedb83e29 service neutron] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:03:42.408273 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4c5e08-45fd-45e4-a216-06ceedb83e29 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:03:42.408273 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-fb4c5e08-45fd-45e4-a216-06ceedb83e29 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 10:03:42.411103 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4c5e08-45fd-45e4-a216-06ceedb83e29 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:03:42.412608 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4c5e08-45fd-45e4-a216-06ceedb83e29 service neutron] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:03:42.421580 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1295/2581] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Oct 27 10:03:42 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 10:03:43.263908 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f31a51a-4366-407b-b3ea-7499a5cfe5ab service placement] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:03:43.265510 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-7f31a51a-4366-407b-b3ea-7499a5cfe5ab service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 10:03:43.349688 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f31a51a-4366-407b-b3ea-7499a5cfe5ab service placement] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:03:43.355935 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8fca1d-2a7c-4add-b63f-da1a81bc4e06 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd0d23ef039d4f1591a589d302ef165f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc2e3a7a1bcc480891c0b433291c00b1', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:03:43.356551 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8fca1d-2a7c-4add-b63f-da1a81bc4e06 service nova] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:03:43.356828 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8fca1d-2a7c-4add-b63f-da1a81bc4e06 service nova] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:03:43.361774 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8fca1d-2a7c-4add-b63f-da1a81bc4e06 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:03:43.361774 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-1f8fca1d-2a7c-4add-b63f-da1a81bc4e06 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 10:03:43.372526 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8fca1d-2a7c-4add-b63f-da1a81bc4e06 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:03:43.374315 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8fca1d-2a7c-4add-b63f-da1a81bc4e06 service nova] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:03:43.386718 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1287/2582] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Oct 27 10:03:43 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 10:03:44.281416 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4c5e08-45fd-45e4-a216-06ceedb83e29 service neutron] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:03:44.282876 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-fb4c5e08-45fd-45e4-a216-06ceedb83e29 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 10:03:44.296765 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4c5e08-45fd-45e4-a216-06ceedb83e29 service neutron] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:03:44.301471 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9396096e-f174-4bd6-b9c4-f7be8e6aeed2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:03:44.302089 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9396096e-f174-4bd6-b9c4-f7be8e6aeed2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:03:44.302361 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9396096e-f174-4bd6-b9c4-f7be8e6aeed2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:03:44.302675 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9396096e-f174-4bd6-b9c4-f7be8e6aeed2 admin admin] PATH_INFO: `/v3/users/869e1945407d44c6a046a8c2472612dd` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:03:44.303793 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9396096e-f174-4bd6-b9c4-f7be8e6aeed2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=869e1945407d44c6a046a8c2472612dd)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:03:44.305694 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9396096e-f174-4bd6-b9c4-f7be8e6aeed2 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:03:44.311531 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:03:44.518137 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-9396096e-f174-4bd6-b9c4-f7be8e6aeed2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '869e1945407d44c6a046a8c2472612dd'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:03:44.530216 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-9396096e-f174-4bd6-b9c4-f7be8e6aeed2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '869e1945407d44c6a046a8c2472612dd'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:03:44.532725 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-9396096e-f174-4bd6-b9c4-f7be8e6aeed2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '869e1945407d44c6a046a8c2472612dd'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:03:44.538302 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-9396096e-f174-4bd6-b9c4-f7be8e6aeed2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '869e1945407d44c6a046a8c2472612dd'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:03:44.588396 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-9396096e-f174-4bd6-b9c4-f7be8e6aeed2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '869e1945407d44c6a046a8c2472612dd'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:03:44.594816 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1296/2583] 10.222.0.65 () {58 vars in 1224 bytes} [Thu Oct 27 10:03:44 2022] DELETE /identity/v3/users/869e1945407d44c6a046a8c2472612dd => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 10:03:44.599641 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a712e4-ad18-4e36-b399-8050e860e9b8 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:03:44.600169 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a712e4-ad18-4e36-b399-8050e860e9b8 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:03:44.604632 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a712e4-ad18-4e36-b399-8050e860e9b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:03:44.623794 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-01a712e4-ad18-4e36-b399-8050e860e9b8 None None] MFA Rules not processed for user `b5065084bf664b99bdeac46067cb0f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 10:03:44.625046 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-01a712e4-ad18-4e36-b399-8050e860e9b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 10:03:44.685628 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1288/2584] 10.222.0.65 () {58 vars in 958 bytes} [Thu Oct 27 10:03:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 10:03:44.696013 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9396096e-f174-4bd6-b9c4-f7be8e6aeed2 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:03:44.697405 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-9396096e-f174-4bd6-b9c4-f7be8e6aeed2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 10:03:44.755203 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9396096e-f174-4bd6-b9c4-f7be8e6aeed2 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:03:44.758810 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826a96e2-55f9-4b0e-b530-42c79fb1fa41 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6191cc41efa74f46b49022cf387f7a4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc2e3a7a1bcc480891c0b433291c00b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:03:44.759410 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826a96e2-55f9-4b0e-b530-42c79fb1fa41 service neutron] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:03:44.759687 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826a96e2-55f9-4b0e-b530-42c79fb1fa41 service neutron] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:03:44.759957 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826a96e2-55f9-4b0e-b530-42c79fb1fa41 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:03:44.768820 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826a96e2-55f9-4b0e-b530-42c79fb1fa41 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:03:44.770358 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826a96e2-55f9-4b0e-b530-42c79fb1fa41 service neutron] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:03:44.779727 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1297/2585] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Oct 27 10:03:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 10:03:45.209087 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a712e4-ad18-4e36-b399-8050e860e9b8 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:03:45.210693 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-01a712e4-ad18-4e36-b399-8050e860e9b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 10:03:45.223438 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a712e4-ad18-4e36-b399-8050e860e9b8 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:03:45.228560 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14510dac-d610-4c15-aa12-a4178ac97b74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:03:45.229231 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14510dac-d610-4c15-aa12-a4178ac97b74 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:03:45.229514 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14510dac-d610-4c15-aa12-a4178ac97b74 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:03:45.229787 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14510dac-d610-4c15-aa12-a4178ac97b74 admin admin] PATH_INFO: `/v3/projects/d636d77a7b0f44b1a84ccb5e9ef074f6` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:03:45.230982 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14510dac-d610-4c15-aa12-a4178ac97b74 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d636d77a7b0f44b1a84ccb5e9ef074f6)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:03:45.233029 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14510dac-d610-4c15-aa12-a4178ac97b74 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:03:45.332713 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-14510dac-d610-4c15-aa12-a4178ac97b74 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd636d77a7b0f44b1a84ccb5e9ef074f6', 'request_id': 'req-14510dac-d610-4c15-aa12-a4178ac97b74'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:03:45.338788 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-14510dac-d610-4c15-aa12-a4178ac97b74 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd636d77a7b0f44b1a84ccb5e9ef074f6', 'request_id': 'req-14510dac-d610-4c15-aa12-a4178ac97b74'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:03:45.433872 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-14510dac-d610-4c15-aa12-a4178ac97b74 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd636d77a7b0f44b1a84ccb5e9ef074f6', 'request_id': 'req-14510dac-d610-4c15-aa12-a4178ac97b74'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:03:45.446861 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-14510dac-d610-4c15-aa12-a4178ac97b74 admin admin] The token cache is being invalidate because project d636d77a7b0f44b1a84ccb5e9ef074f6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 10:03:45.447155 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-14510dac-d610-4c15-aa12-a4178ac97b74 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:03:45.447811 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-14510dac-d610-4c15-aa12-a4178ac97b74 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:03:45.449438 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1289/2586] 10.222.0.65 () {58 vars in 1233 bytes} [Thu Oct 27 10:03:45 2022] DELETE /identity/v3/projects/d636d77a7b0f44b1a84ccb5e9ef074f6 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 10:03:54.775614 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=49,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:03:55.443642 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:04:14.011032 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c6513c-1cc8-442b-8a00-597941e1c51e None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:04:14.011665 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c6513c-1cc8-442b-8a00-597941e1c51e None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:04:14.011665 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c6513c-1cc8-442b-8a00-597941e1c51e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:04:14.032654 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-55c6513c-1cc8-442b-8a00-597941e1c51e None None] MFA Rules not processed for user `b5065084bf664b99bdeac46067cb0f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 10:04:14.033860 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-55c6513c-1cc8-442b-8a00-597941e1c51e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 10:04:14.092754 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1298/2587] 10.222.0.74 () {58 vars in 1016 bytes} [Thu Oct 27 10:04:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 10:04:14.110832 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14510dac-d610-4c15-aa12-a4178ac97b74 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:04:14.112243 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-14510dac-d610-4c15-aa12-a4178ac97b74 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 10:04:14.194428 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14510dac-d610-4c15-aa12-a4178ac97b74 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:04:14.199937 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c96e3ed-f336-4d4c-a7cc-315aada178dd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd0d23ef039d4f1591a589d302ef165f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc2e3a7a1bcc480891c0b433291c00b1', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:04:14.200534 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c96e3ed-f336-4d4c-a7cc-315aada178dd service nova] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:04:14.200810 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c96e3ed-f336-4d4c-a7cc-315aada178dd service nova] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:04:14.201086 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c96e3ed-f336-4d4c-a7cc-315aada178dd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:04:14.209535 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c96e3ed-f336-4d4c-a7cc-315aada178dd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:04:14.211131 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c96e3ed-f336-4d4c-a7cc-315aada178dd service nova] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:04:14.220996 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1290/2588] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Oct 27 10:04:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 10:04:21.434001 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061a29e1-e933-4f1c-9779-cf6614325b4a None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:04:21.434582 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061a29e1-e933-4f1c-9779-cf6614325b4a None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:04:21.434582 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061a29e1-e933-4f1c-9779-cf6614325b4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:04:21.455331 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-061a29e1-e933-4f1c-9779-cf6614325b4a None None] MFA Rules not processed for user `b5065084bf664b99bdeac46067cb0f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 10:04:21.456662 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-061a29e1-e933-4f1c-9779-cf6614325b4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 10:04:21.464785 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1299/2589] 10.222.0.74 () {58 vars in 1016 bytes} [Thu Oct 27 10:04:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 10:04:21.480816 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c96e3ed-f336-4d4c-a7cc-315aada178dd service nova] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:04:21.482314 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-4c96e3ed-f336-4d4c-a7cc-315aada178dd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 10:04:21.502213 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c96e3ed-f336-4d4c-a7cc-315aada178dd service nova] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:04:21.509307 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f32a1f-7880-47c7-9693-40b9994bf384 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd0d23ef039d4f1591a589d302ef165f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc2e3a7a1bcc480891c0b433291c00b1', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:04:21.509910 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f32a1f-7880-47c7-9693-40b9994bf384 service nova] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:04:21.510180 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f32a1f-7880-47c7-9693-40b9994bf384 service nova] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:04:21.510449 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f32a1f-7880-47c7-9693-40b9994bf384 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:04:21.519838 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f32a1f-7880-47c7-9693-40b9994bf384 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:04:21.521415 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f32a1f-7880-47c7-9693-40b9994bf384 service nova] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:04:21.531025 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1291/2590] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Oct 27 10:04:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 10:04:24.940763 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f89b408-6c06-42fc-822a-dd69ca8ecbbb None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:04:24.943569 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f89b408-6c06-42fc-822a-dd69ca8ecbbb None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:04:24.943569 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f89b408-6c06-42fc-822a-dd69ca8ecbbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:04:24.961606 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-9f89b408-6c06-42fc-822a-dd69ca8ecbbb None None] MFA Rules not processed for user `b5065084bf664b99bdeac46067cb0f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 10:04:24.962842 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-9f89b408-6c06-42fc-822a-dd69ca8ecbbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 10:04:24.971543 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1300/2591] 10.222.0.74 () {58 vars in 1016 bytes} [Thu Oct 27 10:04:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 10:04:24.989542 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f32a1f-7880-47c7-9693-40b9994bf384 service nova] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:04:25.002432 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f32a1f-7880-47c7-9693-40b9994bf384 service nova] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:04:25.008239 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6306b2-9aab-48b9-9d78-853eaf444922 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd0d23ef039d4f1591a589d302ef165f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc2e3a7a1bcc480891c0b433291c00b1', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:04:25.008836 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6306b2-9aab-48b9-9d78-853eaf444922 service nova] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:04:25.009117 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6306b2-9aab-48b9-9d78-853eaf444922 service nova] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:04:25.009392 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6306b2-9aab-48b9-9d78-853eaf444922 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:04:25.020582 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6306b2-9aab-48b9-9d78-853eaf444922 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:04:25.020582 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6306b2-9aab-48b9-9d78-853eaf444922 service nova] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:04:25.029778 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1292/2592] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Oct 27 10:04:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 10:04:27.870460 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9738d93d-4bbf-4f09-936f-c3fc12465191 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:04:27.870992 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9738d93d-4bbf-4f09-936f-c3fc12465191 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:04:27.871109 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9738d93d-4bbf-4f09-936f-c3fc12465191 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:04:27.891180 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-9738d93d-4bbf-4f09-936f-c3fc12465191 None None] MFA Rules not processed for user `b5065084bf664b99bdeac46067cb0f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 10:04:27.892386 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-9738d93d-4bbf-4f09-936f-c3fc12465191 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 10:04:27.900473 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1301/2593] 10.222.0.74 () {58 vars in 1016 bytes} [Thu Oct 27 10:04:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 10:04:27.916149 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6306b2-9aab-48b9-9d78-853eaf444922 service nova] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:04:27.928219 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6306b2-9aab-48b9-9d78-853eaf444922 service nova] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:04:27.934576 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554b143a-f275-48f3-919a-728811c2e87b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd0d23ef039d4f1591a589d302ef165f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc2e3a7a1bcc480891c0b433291c00b1', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:04:27.935176 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554b143a-f275-48f3-919a-728811c2e87b service nova] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:04:27.935460 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554b143a-f275-48f3-919a-728811c2e87b service nova] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:04:27.935767 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554b143a-f275-48f3-919a-728811c2e87b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:04:27.944500 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554b143a-f275-48f3-919a-728811c2e87b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:04:27.946130 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554b143a-f275-48f3-919a-728811c2e87b service nova] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:04:27.956076 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1293/2594] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Oct 27 10:04:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 10:04:32.145529 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc48f85-52d0-479a-aed8-39434b627be9 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:04:32.146064 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc48f85-52d0-479a-aed8-39434b627be9 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:04:32.146064 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc48f85-52d0-479a-aed8-39434b627be9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:04:32.166208 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-2dc48f85-52d0-479a-aed8-39434b627be9 None None] MFA Rules not processed for user `b5065084bf664b99bdeac46067cb0f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 10:04:32.167469 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-2dc48f85-52d0-479a-aed8-39434b627be9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 10:04:32.175442 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1302/2595] 10.222.0.74 () {58 vars in 1016 bytes} [Thu Oct 27 10:04:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 10:04:32.191247 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554b143a-f275-48f3-919a-728811c2e87b service nova] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:04:32.202851 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554b143a-f275-48f3-919a-728811c2e87b service nova] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:04:32.209462 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28544a2-fa72-4dae-a708-0f32e40dbb95 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd0d23ef039d4f1591a589d302ef165f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc2e3a7a1bcc480891c0b433291c00b1', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:04:32.210268 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28544a2-fa72-4dae-a708-0f32e40dbb95 service nova] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:04:32.210797 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28544a2-fa72-4dae-a708-0f32e40dbb95 service nova] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:04:32.211273 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28544a2-fa72-4dae-a708-0f32e40dbb95 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:04:32.221815 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28544a2-fa72-4dae-a708-0f32e40dbb95 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:04:32.224644 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28544a2-fa72-4dae-a708-0f32e40dbb95 service nova] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:04:32.234470 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1294/2596] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Oct 27 10:04:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 10:04:36.414294 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9f2f84-b8d2-4a21-aa5e-f105233854f8 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:04:36.414294 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9f2f84-b8d2-4a21-aa5e-f105233854f8 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:04:36.414830 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9f2f84-b8d2-4a21-aa5e-f105233854f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:04:36.427798 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=40 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:04:36.436943 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-6e9f2f84-b8d2-4a21-aa5e-f105233854f8 None None] MFA Rules not processed for user `b5065084bf664b99bdeac46067cb0f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 10:04:36.438204 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-6e9f2f84-b8d2-4a21-aa5e-f105233854f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 10:04:36.447434 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1303/2597] 10.222.0.74 () {58 vars in 1016 bytes} [Thu Oct 27 10:04:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 10:04:36.463498 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28544a2-fa72-4dae-a708-0f32e40dbb95 service nova] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:04:36.469406 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=59 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:04:36.477572 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28544a2-fa72-4dae-a708-0f32e40dbb95 service nova] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:04:36.483546 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8211b9f7-8b5c-4e4a-95ee-ff859d4a7698 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd0d23ef039d4f1591a589d302ef165f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc2e3a7a1bcc480891c0b433291c00b1', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:04:36.484077 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8211b9f7-8b5c-4e4a-95ee-ff859d4a7698 service nova] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:04:36.484362 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8211b9f7-8b5c-4e4a-95ee-ff859d4a7698 service nova] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:04:36.484688 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8211b9f7-8b5c-4e4a-95ee-ff859d4a7698 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:04:36.496031 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8211b9f7-8b5c-4e4a-95ee-ff859d4a7698 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:04:36.497640 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8211b9f7-8b5c-4e4a-95ee-ff859d4a7698 service nova] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:04:36.508032 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1295/2598] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Oct 27 10:04:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 10:04:46.473496 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=2 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:04:46.532294 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=5 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:04:51.411718 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9f2f84-b8d2-4a21-aa5e-f105233854f8 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:04:51.414003 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-6e9f2f84-b8d2-4a21-aa5e-f105233854f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 10:04:51.481876 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9f2f84-b8d2-4a21-aa5e-f105233854f8 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:04:51.485470 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7c6309-233c-4c30-8b82-2983cdd71d35 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6191cc41efa74f46b49022cf387f7a4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc2e3a7a1bcc480891c0b433291c00b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:04:51.486070 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7c6309-233c-4c30-8b82-2983cdd71d35 service neutron] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:04:51.486347 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7c6309-233c-4c30-8b82-2983cdd71d35 service neutron] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:04:51.486650 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7c6309-233c-4c30-8b82-2983cdd71d35 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:04:51.488364 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-da7c6309-233c-4c30-8b82-2983cdd71d35 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 10:04:51.499290 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7c6309-233c-4c30-8b82-2983cdd71d35 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:04:51.500713 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7c6309-233c-4c30-8b82-2983cdd71d35 service neutron] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:04:51.508974 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1304/2599] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Oct 27 10:04:51 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 10:04:51.583081 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8211b9f7-8b5c-4e4a-95ee-ff859d4a7698 service nova] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:04:51.585548 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-8211b9f7-8b5c-4e4a-95ee-ff859d4a7698 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 10:04:51.597833 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8211b9f7-8b5c-4e4a-95ee-ff859d4a7698 service nova] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:04:51.602296 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae28a3d-fb7e-40e3-ba29-98741c3a5039 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6191cc41efa74f46b49022cf387f7a4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc2e3a7a1bcc480891c0b433291c00b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:04:51.602935 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae28a3d-fb7e-40e3-ba29-98741c3a5039 service neutron] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:04:51.603212 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae28a3d-fb7e-40e3-ba29-98741c3a5039 service neutron] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:04:51.603486 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae28a3d-fb7e-40e3-ba29-98741c3a5039 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:04:51.605212 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-cae28a3d-fb7e-40e3-ba29-98741c3a5039 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 10:04:51.619477 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae28a3d-fb7e-40e3-ba29-98741c3a5039 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:04:51.620895 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae28a3d-fb7e-40e3-ba29-98741c3a5039 service neutron] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:04:51.632927 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1296/2600] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Oct 27 10:04:51 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 10:04:54.903464 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7c6309-233c-4c30-8b82-2983cdd71d35 service neutron] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:04:54.920717 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7c6309-233c-4c30-8b82-2983cdd71d35 service neutron] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:04:54.926895 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5a5a03-68d8-4e14-98aa-7c65ac771d62 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd0d23ef039d4f1591a589d302ef165f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc2e3a7a1bcc480891c0b433291c00b1', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:04:54.927518 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5a5a03-68d8-4e14-98aa-7c65ac771d62 service nova] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:04:54.927799 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5a5a03-68d8-4e14-98aa-7c65ac771d62 service nova] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:04:54.928071 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5a5a03-68d8-4e14-98aa-7c65ac771d62 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:04:54.930056 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-3e5a5a03-68d8-4e14-98aa-7c65ac771d62 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 10:04:54.943407 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5a5a03-68d8-4e14-98aa-7c65ac771d62 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:04:54.945032 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5a5a03-68d8-4e14-98aa-7c65ac771d62 service nova] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:04:54.957275 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1305/2601] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Oct 27 10:04:54 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 10:04:55.071471 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1200078-7d19-49a4-bb91-1d06f0dd1fdc None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:04:55.071988 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1200078-7d19-49a4-bb91-1d06f0dd1fdc None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:04:55.072107 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1200078-7d19-49a4-bb91-1d06f0dd1fdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:04:55.093008 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-d1200078-7d19-49a4-bb91-1d06f0dd1fdc None None] MFA Rules not processed for user `f0bf245ab7b9431291c42a56993c85ea`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 10:04:55.094220 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-d1200078-7d19-49a4-bb91-1d06f0dd1fdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 10:04:55.149866 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1297/2602] 10.222.0.65 () {58 vars in 958 bytes} [Thu Oct 27 10:04:55 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 10:04:55.387129 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5a5a03-68d8-4e14-98aa-7c65ac771d62 service nova] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:04:55.396870 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5a5a03-68d8-4e14-98aa-7c65ac771d62 service nova] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:04:55.401849 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4550f442-5f58-4e50-80a5-1e9a338b2f6c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6191cc41efa74f46b49022cf387f7a4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc2e3a7a1bcc480891c0b433291c00b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:04:55.402419 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4550f442-5f58-4e50-80a5-1e9a338b2f6c service neutron] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:04:55.402735 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4550f442-5f58-4e50-80a5-1e9a338b2f6c service neutron] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:04:55.403016 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4550f442-5f58-4e50-80a5-1e9a338b2f6c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:04:55.404742 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-4550f442-5f58-4e50-80a5-1e9a338b2f6c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 10:04:55.415490 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4550f442-5f58-4e50-80a5-1e9a338b2f6c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:04:55.416940 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4550f442-5f58-4e50-80a5-1e9a338b2f6c service neutron] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:04:55.425583 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1306/2603] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Oct 27 10:04:55 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 10:05:05.142676 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=31 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:05:05.421705 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=38 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:05:13.520767 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348a6c91-d556-46ce-82a0-479e17f10a95 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:05:13.521327 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348a6c91-d556-46ce-82a0-479e17f10a95 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:05:13.521327 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348a6c91-d556-46ce-82a0-479e17f10a95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:05:13.541325 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-348a6c91-d556-46ce-82a0-479e17f10a95 None None] MFA Rules not processed for user `b5065084bf664b99bdeac46067cb0f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 10:05:13.542558 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-348a6c91-d556-46ce-82a0-479e17f10a95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 10:05:13.551108 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1298/2604] 10.222.0.74 () {58 vars in 1016 bytes} [Thu Oct 27 10:05:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 10:05:13.577640 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4550f442-5f58-4e50-80a5-1e9a338b2f6c service neutron] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:05:13.590976 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4550f442-5f58-4e50-80a5-1e9a338b2f6c service neutron] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:05:13.597218 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d435eec-ba72-4a95-8d05-88f04ecb50a2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd0d23ef039d4f1591a589d302ef165f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc2e3a7a1bcc480891c0b433291c00b1', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:05:13.597808 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d435eec-ba72-4a95-8d05-88f04ecb50a2 service nova] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:05:13.598087 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d435eec-ba72-4a95-8d05-88f04ecb50a2 service nova] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:05:13.598358 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d435eec-ba72-4a95-8d05-88f04ecb50a2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:05:13.606671 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d435eec-ba72-4a95-8d05-88f04ecb50a2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:05:13.608248 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d435eec-ba72-4a95-8d05-88f04ecb50a2 service nova] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:05:13.619175 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1307/2605] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Oct 27 10:05:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 10:05:17.143286 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bc5a32-f790-4044-95a2-0fa2dc83a61a None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:05:17.143758 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bc5a32-f790-4044-95a2-0fa2dc83a61a None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:05:17.143870 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bc5a32-f790-4044-95a2-0fa2dc83a61a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:05:17.164385 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-34bc5a32-f790-4044-95a2-0fa2dc83a61a None None] MFA Rules not processed for user `b5065084bf664b99bdeac46067cb0f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 10:05:17.165604 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-34bc5a32-f790-4044-95a2-0fa2dc83a61a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 10:05:17.174220 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1299/2606] 10.222.0.74 () {58 vars in 1016 bytes} [Thu Oct 27 10:05:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 10:05:17.188409 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d435eec-ba72-4a95-8d05-88f04ecb50a2 service nova] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:05:17.199967 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d435eec-ba72-4a95-8d05-88f04ecb50a2 service nova] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:05:17.205451 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0715afd-6343-4c35-8884-0f4a26caf38d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd0d23ef039d4f1591a589d302ef165f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc2e3a7a1bcc480891c0b433291c00b1', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:05:17.206044 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0715afd-6343-4c35-8884-0f4a26caf38d service nova] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:05:17.206329 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0715afd-6343-4c35-8884-0f4a26caf38d service nova] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:05:17.206630 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0715afd-6343-4c35-8884-0f4a26caf38d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:05:17.215638 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0715afd-6343-4c35-8884-0f4a26caf38d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:05:17.217228 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0715afd-6343-4c35-8884-0f4a26caf38d service nova] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:05:17.228217 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1308/2607] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Oct 27 10:05:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 10:05:19.960687 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b029ea8c-a872-4a17-aa26-aba912dd8585 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:05:19.961181 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b029ea8c-a872-4a17-aa26-aba912dd8585 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:05:19.961316 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b029ea8c-a872-4a17-aa26-aba912dd8585 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:05:19.980593 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-b029ea8c-a872-4a17-aa26-aba912dd8585 None None] MFA Rules not processed for user `b5065084bf664b99bdeac46067cb0f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 10:05:19.981783 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-b029ea8c-a872-4a17-aa26-aba912dd8585 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 10:05:19.990126 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1300/2608] 10.222.0.74 () {58 vars in 1016 bytes} [Thu Oct 27 10:05:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 10:05:20.014617 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0715afd-6343-4c35-8884-0f4a26caf38d service nova] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:05:20.025905 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0715afd-6343-4c35-8884-0f4a26caf38d service nova] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:05:20.032353 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a85e3cf-3b87-4b31-82be-da063bdac071 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd0d23ef039d4f1591a589d302ef165f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc2e3a7a1bcc480891c0b433291c00b1', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:05:20.032983 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a85e3cf-3b87-4b31-82be-da063bdac071 service nova] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:05:20.033265 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a85e3cf-3b87-4b31-82be-da063bdac071 service nova] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:05:20.033549 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a85e3cf-3b87-4b31-82be-da063bdac071 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:05:20.042248 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a85e3cf-3b87-4b31-82be-da063bdac071 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:05:20.043900 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a85e3cf-3b87-4b31-82be-da063bdac071 service nova] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:05:20.054337 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1309/2609] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Oct 27 10:05:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 10:05:24.229938 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acc72a8-7c2a-4cbf-b696-ac26e2325fed None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:05:24.230427 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acc72a8-7c2a-4cbf-b696-ac26e2325fed None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:05:24.230580 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acc72a8-7c2a-4cbf-b696-ac26e2325fed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:05:24.250158 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-2acc72a8-7c2a-4cbf-b696-ac26e2325fed None None] MFA Rules not processed for user `b5065084bf664b99bdeac46067cb0f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 10:05:24.252036 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-2acc72a8-7c2a-4cbf-b696-ac26e2325fed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 10:05:24.260464 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1301/2610] 10.222.0.74 () {58 vars in 1016 bytes} [Thu Oct 27 10:05:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 10:05:24.277201 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a85e3cf-3b87-4b31-82be-da063bdac071 service nova] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:05:24.288656 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a85e3cf-3b87-4b31-82be-da063bdac071 service nova] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:05:24.294205 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46ddf83-cb0c-4ecc-896e-7c4f761945c0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd0d23ef039d4f1591a589d302ef165f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc2e3a7a1bcc480891c0b433291c00b1', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:05:24.294843 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46ddf83-cb0c-4ecc-896e-7c4f761945c0 service nova] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:05:24.295131 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46ddf83-cb0c-4ecc-896e-7c4f761945c0 service nova] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:05:24.295410 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46ddf83-cb0c-4ecc-896e-7c4f761945c0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:05:24.306344 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46ddf83-cb0c-4ecc-896e-7c4f761945c0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:05:24.306344 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46ddf83-cb0c-4ecc-896e-7c4f761945c0 service nova] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:05:24.316197 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1310/2611] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Oct 27 10:05:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 10:05:28.559202 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1807479-700b-48cf-a6fb-8af47b6d0bb2 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:05:28.559749 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1807479-700b-48cf-a6fb-8af47b6d0bb2 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:05:28.559749 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1807479-700b-48cf-a6fb-8af47b6d0bb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:05:28.579815 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-b1807479-700b-48cf-a6fb-8af47b6d0bb2 None None] MFA Rules not processed for user `b5065084bf664b99bdeac46067cb0f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 10:05:28.581660 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-b1807479-700b-48cf-a6fb-8af47b6d0bb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 10:05:28.589827 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1302/2612] 10.222.0.74 () {58 vars in 1016 bytes} [Thu Oct 27 10:05:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 10:05:28.604823 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46ddf83-cb0c-4ecc-896e-7c4f761945c0 service nova] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:05:28.616794 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46ddf83-cb0c-4ecc-896e-7c4f761945c0 service nova] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:05:28.622373 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78ea824-0d1d-41ec-a9c0-1af58e5f6d2a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd0d23ef039d4f1591a589d302ef165f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc2e3a7a1bcc480891c0b433291c00b1', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:05:28.623020 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78ea824-0d1d-41ec-a9c0-1af58e5f6d2a service nova] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:05:28.623306 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78ea824-0d1d-41ec-a9c0-1af58e5f6d2a service nova] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:05:28.623584 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78ea824-0d1d-41ec-a9c0-1af58e5f6d2a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:05:28.633199 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78ea824-0d1d-41ec-a9c0-1af58e5f6d2a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:05:28.634818 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78ea824-0d1d-41ec-a9c0-1af58e5f6d2a service nova] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:05:28.645215 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1311/2613] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Oct 27 10:05:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 10:05:38.574202 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=15 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:05:38.640108 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=30 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:05:39.004408 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1807479-700b-48cf-a6fb-8af47b6d0bb2 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:05:39.008673 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-b1807479-700b-48cf-a6fb-8af47b6d0bb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 10:05:39.079224 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1807479-700b-48cf-a6fb-8af47b6d0bb2 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:05:39.084431 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8335046-9f39-40ef-bbea-51ee362cf2b6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8c47ff5d72943f6bab09b5df6198d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc2e3a7a1bcc480891c0b433291c00b1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:05:39.085837 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8335046-9f39-40ef-bbea-51ee362cf2b6 service placement] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:05:39.086079 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8335046-9f39-40ef-bbea-51ee362cf2b6 service placement] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:05:39.086354 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8335046-9f39-40ef-bbea-51ee362cf2b6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:05:39.088102 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-a8335046-9f39-40ef-bbea-51ee362cf2b6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 10:05:39.099556 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8335046-9f39-40ef-bbea-51ee362cf2b6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:05:39.101056 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8335046-9f39-40ef-bbea-51ee362cf2b6 service placement] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:05:39.110809 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1303/2614] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Oct 27 10:05:39 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 10:05:49.107727 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=32 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:06:03.042485 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78ea824-0d1d-41ec-a9c0-1af58e5f6d2a service nova] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:06:03.043977 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-c78ea824-0d1d-41ec-a9c0-1af58e5f6d2a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 10:06:03.059508 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78ea824-0d1d-41ec-a9c0-1af58e5f6d2a service nova] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:06:03.065111 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c6b5f3-5036-4594-ab88-a83d9ca22f3e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8c47ff5d72943f6bab09b5df6198d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc2e3a7a1bcc480891c0b433291c00b1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:06:03.065711 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c6b5f3-5036-4594-ab88-a83d9ca22f3e service placement] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:06:03.065999 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c6b5f3-5036-4594-ab88-a83d9ca22f3e service placement] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:06:03.066281 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c6b5f3-5036-4594-ab88-a83d9ca22f3e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:06:03.068189 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-69c6b5f3-5036-4594-ab88-a83d9ca22f3e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 10:06:03.081139 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c6b5f3-5036-4594-ab88-a83d9ca22f3e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:06:03.083021 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c6b5f3-5036-4594-ab88-a83d9ca22f3e service placement] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:06:03.093855 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1312/2615] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Oct 27 10:06:03 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 10:06:03.166299 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8335046-9f39-40ef-bbea-51ee362cf2b6 service placement] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:06:03.167850 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-a8335046-9f39-40ef-bbea-51ee362cf2b6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 10:06:03.183615 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8335046-9f39-40ef-bbea-51ee362cf2b6 service placement] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:06:03.188355 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c503232a-29ce-4344-92f3-7e71c59a41a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:06:03.189256 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c503232a-29ce-4344-92f3-7e71c59a41a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:06:03.189570 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c503232a-29ce-4344-92f3-7e71c59a41a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:06:03.189851 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c503232a-29ce-4344-92f3-7e71c59a41a7 admin admin] PATH_INFO: `/v3/users/f0bf245ab7b9431291c42a56993c85ea` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:06:03.191017 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c503232a-29ce-4344-92f3-7e71c59a41a7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f0bf245ab7b9431291c42a56993c85ea)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:06:03.192956 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c503232a-29ce-4344-92f3-7e71c59a41a7 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:06:03.361850 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-c503232a-29ce-4344-92f3-7e71c59a41a7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f0bf245ab7b9431291c42a56993c85ea'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:06:03.362445 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-c503232a-29ce-4344-92f3-7e71c59a41a7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f0bf245ab7b9431291c42a56993c85ea'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:06:03.369819 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-c503232a-29ce-4344-92f3-7e71c59a41a7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f0bf245ab7b9431291c42a56993c85ea'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:06:03.370478 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-c503232a-29ce-4344-92f3-7e71c59a41a7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f0bf245ab7b9431291c42a56993c85ea'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:06:03.383294 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-c503232a-29ce-4344-92f3-7e71c59a41a7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f0bf245ab7b9431291c42a56993c85ea'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:06:03.490324 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1304/2616] 10.222.0.65 () {58 vars in 1224 bytes} [Thu Oct 27 10:06:03 2022] DELETE /identity/v3/users/f0bf245ab7b9431291c42a56993c85ea => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 10:06:03.729099 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c6b5f3-5036-4594-ab88-a83d9ca22f3e service placement] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:06:03.740774 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c6b5f3-5036-4594-ab88-a83d9ca22f3e service placement] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:06:03.802289 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d0b416-efa0-43af-9672-1ae384e55af6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:06:03.802952 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d0b416-efa0-43af-9672-1ae384e55af6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:06:03.803267 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d0b416-efa0-43af-9672-1ae384e55af6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:06:03.803545 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d0b416-efa0-43af-9672-1ae384e55af6 admin admin] PATH_INFO: `/v3/projects/594c861cc8664a9db28fba3c51aa9c0a` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:06:03.804668 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d0b416-efa0-43af-9672-1ae384e55af6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=594c861cc8664a9db28fba3c51aa9c0a)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:06:03.806610 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d0b416-efa0-43af-9672-1ae384e55af6 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:06:03.910001 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-f2d0b416-efa0-43af-9672-1ae384e55af6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '594c861cc8664a9db28fba3c51aa9c0a', 'request_id': 'req-f2d0b416-efa0-43af-9672-1ae384e55af6'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:06:03.967594 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-f2d0b416-efa0-43af-9672-1ae384e55af6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '594c861cc8664a9db28fba3c51aa9c0a', 'request_id': 'req-f2d0b416-efa0-43af-9672-1ae384e55af6'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:06:03.974201 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-f2d0b416-efa0-43af-9672-1ae384e55af6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '594c861cc8664a9db28fba3c51aa9c0a', 'request_id': 'req-f2d0b416-efa0-43af-9672-1ae384e55af6'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:06:03.986459 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-f2d0b416-efa0-43af-9672-1ae384e55af6 admin admin] The token cache is being invalidate because project 594c861cc8664a9db28fba3c51aa9c0a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 10:06:03.986774 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-f2d0b416-efa0-43af-9672-1ae384e55af6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:06:03.987485 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-f2d0b416-efa0-43af-9672-1ae384e55af6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:06:03.989080 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1313/2617] 10.222.0.65 () {58 vars in 1233 bytes} [Thu Oct 27 10:06:03 2022] DELETE /identity/v3/projects/594c861cc8664a9db28fba3c51aa9c0a => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 10:06:13.487293 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=29,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:06:13.982861 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=57,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:06:36.710415 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c503232a-29ce-4344-92f3-7e71c59a41a7 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:06:36.711880 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-c503232a-29ce-4344-92f3-7e71c59a41a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 10:06:36.772458 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c503232a-29ce-4344-92f3-7e71c59a41a7 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:06:36.820107 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458801ec-4a47-402c-b8c1-99d84571a153 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6191cc41efa74f46b49022cf387f7a4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc2e3a7a1bcc480891c0b433291c00b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:06:36.820723 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458801ec-4a47-402c-b8c1-99d84571a153 service neutron] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:06:36.821007 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458801ec-4a47-402c-b8c1-99d84571a153 service neutron] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:06:36.821284 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458801ec-4a47-402c-b8c1-99d84571a153 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:06:36.824143 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-458801ec-4a47-402c-b8c1-99d84571a153 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 10:06:36.886656 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458801ec-4a47-402c-b8c1-99d84571a153 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:06:36.888087 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458801ec-4a47-402c-b8c1-99d84571a153 service neutron] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:06:36.897148 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1305/2618] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Oct 27 10:06:36 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 10:06:42.215856 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d0b416-efa0-43af-9672-1ae384e55af6 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:06:42.217281 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-f2d0b416-efa0-43af-9672-1ae384e55af6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 10:06:42.230218 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d0b416-efa0-43af-9672-1ae384e55af6 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:06:42.233907 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c03af67-868f-49b2-bcdb-c629c09ca06c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6191cc41efa74f46b49022cf387f7a4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc2e3a7a1bcc480891c0b433291c00b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:06:42.234542 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c03af67-868f-49b2-bcdb-c629c09ca06c service neutron] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:06:42.234805 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c03af67-868f-49b2-bcdb-c629c09ca06c service neutron] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:06:42.235078 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c03af67-868f-49b2-bcdb-c629c09ca06c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:06:42.236774 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-3c03af67-868f-49b2-bcdb-c629c09ca06c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 10:06:42.300783 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c03af67-868f-49b2-bcdb-c629c09ca06c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:06:42.302222 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c03af67-868f-49b2-bcdb-c629c09ca06c service neutron] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:06:42.312998 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1314/2619] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Oct 27 10:06:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 10:06:46.892913 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=68 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:06:49.582702 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458801ec-4a47-402c-b8c1-99d84571a153 service neutron] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:06:49.584151 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-458801ec-4a47-402c-b8c1-99d84571a153 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 10:06:49.664001 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458801ec-4a47-402c-b8c1-99d84571a153 service neutron] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:06:49.669318 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67263683-aa4a-49c5-aa80-9b8c481adbbd service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8c47ff5d72943f6bab09b5df6198d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc2e3a7a1bcc480891c0b433291c00b1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:06:49.669924 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67263683-aa4a-49c5-aa80-9b8c481adbbd service placement] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:06:49.670207 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67263683-aa4a-49c5-aa80-9b8c481adbbd service placement] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:06:49.670483 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67263683-aa4a-49c5-aa80-9b8c481adbbd service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:06:49.672420 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-67263683-aa4a-49c5-aa80-9b8c481adbbd service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 10:06:49.684181 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67263683-aa4a-49c5-aa80-9b8c481adbbd service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:06:49.685777 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67263683-aa4a-49c5-aa80-9b8c481adbbd service placement] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:06:49.696156 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1306/2620] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Oct 27 10:06:49 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 10:06:49.728564 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c03af67-868f-49b2-bcdb-c629c09ca06c service neutron] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:06:49.730233 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-3c03af67-868f-49b2-bcdb-c629c09ca06c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 10:06:49.742830 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c03af67-868f-49b2-bcdb-c629c09ca06c service neutron] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:06:49.747687 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c96adca-49df-43a9-8f88-64e54505297f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:06:49.748878 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c96adca-49df-43a9-8f88-64e54505297f admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:06:49.748878 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c96adca-49df-43a9-8f88-64e54505297f admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:06:49.748878 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c96adca-49df-43a9-8f88-64e54505297f admin admin] PATH_INFO: `/v3/users/121e9c66cd1143ce912d269e484bbd2c` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:06:49.750082 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c96adca-49df-43a9-8f88-64e54505297f admin admin] RBAC: Authorizing `identity:delete_user(user_id=121e9c66cd1143ce912d269e484bbd2c)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:06:49.752170 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c96adca-49df-43a9-8f88-64e54505297f admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:06:49.951172 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-7c96adca-49df-43a9-8f88-64e54505297f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '121e9c66cd1143ce912d269e484bbd2c'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:06:49.964364 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-7c96adca-49df-43a9-8f88-64e54505297f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '121e9c66cd1143ce912d269e484bbd2c'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:06:49.965050 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-7c96adca-49df-43a9-8f88-64e54505297f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '121e9c66cd1143ce912d269e484bbd2c'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:06:49.972167 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-7c96adca-49df-43a9-8f88-64e54505297f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '121e9c66cd1143ce912d269e484bbd2c'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:06:50.076214 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-7c96adca-49df-43a9-8f88-64e54505297f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '121e9c66cd1143ce912d269e484bbd2c'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:06:50.082914 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1315/2621] 10.222.0.65 () {58 vars in 1224 bytes} [Thu Oct 27 10:06:49 2022] DELETE /identity/v3/users/121e9c66cd1143ce912d269e484bbd2c => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 10:06:50.331624 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67263683-aa4a-49c5-aa80-9b8c481adbbd service placement] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:06:50.344156 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67263683-aa4a-49c5-aa80-9b8c481adbbd service placement] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:06:50.402146 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e088bc-8966-463c-8412-9408ff71ef89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:06:50.402819 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e088bc-8966-463c-8412-9408ff71ef89 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:06:50.403201 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e088bc-8966-463c-8412-9408ff71ef89 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:06:50.403383 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e088bc-8966-463c-8412-9408ff71ef89 admin admin] PATH_INFO: `/v3/projects/7e79cf723b5240c9b62896b39fa61ff0` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:06:50.404532 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e088bc-8966-463c-8412-9408ff71ef89 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7e79cf723b5240c9b62896b39fa61ff0)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:06:50.406442 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e088bc-8966-463c-8412-9408ff71ef89 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:06:50.529558 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-a1e088bc-8966-463c-8412-9408ff71ef89 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7e79cf723b5240c9b62896b39fa61ff0', 'request_id': 'req-a1e088bc-8966-463c-8412-9408ff71ef89'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:06:50.536106 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-a1e088bc-8966-463c-8412-9408ff71ef89 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7e79cf723b5240c9b62896b39fa61ff0', 'request_id': 'req-a1e088bc-8966-463c-8412-9408ff71ef89'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:06:50.615094 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-a1e088bc-8966-463c-8412-9408ff71ef89 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7e79cf723b5240c9b62896b39fa61ff0', 'request_id': 'req-a1e088bc-8966-463c-8412-9408ff71ef89'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:06:50.626941 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-a1e088bc-8966-463c-8412-9408ff71ef89 admin admin] The token cache is being invalidate because project 7e79cf723b5240c9b62896b39fa61ff0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 10:06:50.627230 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-a1e088bc-8966-463c-8412-9408ff71ef89 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:06:50.627852 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-a1e088bc-8966-463c-8412-9408ff71ef89 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:06:50.629328 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1307/2622] 10.222.0.65 () {58 vars in 1233 bytes} [Thu Oct 27 10:06:50 2022] DELETE /identity/v3/projects/7e79cf723b5240c9b62896b39fa61ff0 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 10:06:50.633456 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c96adca-49df-43a9-8f88-64e54505297f admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:06:50.635012 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-7c96adca-49df-43a9-8f88-64e54505297f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 10:06:50.648279 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c96adca-49df-43a9-8f88-64e54505297f admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:06:50.711573 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9121d182-e34f-428d-9360-4897be0fd564 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:06:50.712176 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9121d182-e34f-428d-9360-4897be0fd564 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:06:50.713107 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9121d182-e34f-428d-9360-4897be0fd564 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:06:50.713397 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9121d182-e34f-428d-9360-4897be0fd564 admin admin] PATH_INFO: `/v3/users/9fb07b69706048a19b92998e95dad2f1` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:06:50.714740 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9121d182-e34f-428d-9360-4897be0fd564 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9fb07b69706048a19b92998e95dad2f1)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:06:50.716740 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9121d182-e34f-428d-9360-4897be0fd564 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:06:50.722093 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:06:50.922090 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-9121d182-e34f-428d-9360-4897be0fd564 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9fb07b69706048a19b92998e95dad2f1'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:06:50.934271 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-9121d182-e34f-428d-9360-4897be0fd564 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9fb07b69706048a19b92998e95dad2f1'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:06:50.934980 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-9121d182-e34f-428d-9360-4897be0fd564 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9fb07b69706048a19b92998e95dad2f1'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:06:50.941905 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-9121d182-e34f-428d-9360-4897be0fd564 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9fb07b69706048a19b92998e95dad2f1'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:06:51.004169 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-9121d182-e34f-428d-9360-4897be0fd564 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9fb07b69706048a19b92998e95dad2f1'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:06:51.011046 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1316/2623] 10.222.0.65 () {58 vars in 1224 bytes} [Thu Oct 27 10:06:50 2022] DELETE /identity/v3/users/9fb07b69706048a19b92998e95dad2f1 => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 10:06:51.263445 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e088bc-8966-463c-8412-9408ff71ef89 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:06:51.264884 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-a1e088bc-8966-463c-8412-9408ff71ef89 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 10:06:51.278589 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e088bc-8966-463c-8412-9408ff71ef89 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:06:51.295853 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:06:51.336478 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6eb8501-8c9e-470c-a276-bc4b8c568338 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5065084bf664b99bdeac46067cb0f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c03247ba584473d97a93650c876aafd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:06:51.337113 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6eb8501-8c9e-470c-a276-bc4b8c568338 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:06:51.337391 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6eb8501-8c9e-470c-a276-bc4b8c568338 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:06:51.337669 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6eb8501-8c9e-470c-a276-bc4b8c568338 admin admin] PATH_INFO: `/v3/projects/60470932eb7543248d8312da94173cfb` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:06:51.339467 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6eb8501-8c9e-470c-a276-bc4b8c568338 admin admin] RBAC: Authorizing `identity:delete_project(project_id=60470932eb7543248d8312da94173cfb)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:06:51.341384 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6eb8501-8c9e-470c-a276-bc4b8c568338 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:06:51.445067 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-c6eb8501-8c9e-470c-a276-bc4b8c568338 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '60470932eb7543248d8312da94173cfb', 'request_id': 'req-c6eb8501-8c9e-470c-a276-bc4b8c568338'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:06:51.452857 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-c6eb8501-8c9e-470c-a276-bc4b8c568338 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '60470932eb7543248d8312da94173cfb', 'request_id': 'req-c6eb8501-8c9e-470c-a276-bc4b8c568338'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:06:51.510612 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-c6eb8501-8c9e-470c-a276-bc4b8c568338 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '60470932eb7543248d8312da94173cfb', 'request_id': 'req-c6eb8501-8c9e-470c-a276-bc4b8c568338'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:06:51.522630 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-c6eb8501-8c9e-470c-a276-bc4b8c568338 admin admin] The token cache is being invalidate because project 60470932eb7543248d8312da94173cfb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 10:06:51.522923 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-c6eb8501-8c9e-470c-a276-bc4b8c568338 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:06:51.523562 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-c6eb8501-8c9e-470c-a276-bc4b8c568338 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 10:06:51.525051 dv-cinder-797970-7-smb devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1308/2624] 10.222.0.65 () {58 vars in 1233 bytes} [Thu Oct 27 10:06:51 2022] DELETE /identity/v3/projects/60470932eb7543248d8312da94173cfb => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 10:07:01.015303 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=23,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:07:01.519345 dv-cinder-797970-7-smb devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=42,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 10:10:47.615807 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9121d182-e34f-428d-9360-4897be0fd564 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 10:10:47.617357 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-9121d182-e34f-428d-9360-4897be0fd564 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 10:10:47.761400 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9121d182-e34f-428d-9360-4897be0fd564 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 10:10:47.823217 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557c4cd0-004e-49d4-b643-6a2517a3dcd7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8c47ff5d72943f6bab09b5df6198d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc2e3a7a1bcc480891c0b433291c00b1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 10:10:47.823825 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557c4cd0-004e-49d4-b643-6a2517a3dcd7 service placement] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 10:10:47.824110 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557c4cd0-004e-49d4-b643-6a2517a3dcd7 service placement] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 10:10:47.824388 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557c4cd0-004e-49d4-b643-6a2517a3dcd7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 10:10:47.826154 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-557c4cd0-004e-49d4-b643-6a2517a3dcd7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 10:10:47.839103 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557c4cd0-004e-49d4-b643-6a2517a3dcd7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 10:10:47.840717 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557c4cd0-004e-49d4-b643-6a2517a3dcd7 service placement] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 10:10:47.852187 dv-cinder-797970-7-smb devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1317/2625] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Oct 27 10:10:47 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 10:10:57.847261 dv-cinder-797970-7-smb devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=89 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}